AVID-2022-V004

Vulnerability from avid – Published: 2022-12-23 – Updated: 2022-12-23 AIID Incident
Summary
Facebook's automatic language translation software incorrectly translated an Arabic post saying "Good morning" into Hebrew saying "hurt them", leading to the arrest of a Palestinian man in Beitar Illit, Israel.
Risk domain
Performance
SEP view
P0401: Psychological Safety, P0402: Physical safety
Lifecycle
L06: Deployment
Organisations
Facebook (deployer), Facebook (developer)
References
URL Label
https://incidentdatabase.ai/cite/72 Incident 72: Facebook translates 'good morning' into 'attack them', leading to arrest
To clipboard 

{
  "affects": {
    "artifacts": [
      {
        "name": "",
        "type": "System"
      }
    ],
    "deployer": [
      "Facebook"
    ],
    "developer": [
      "Facebook"
    ]
  },
  "credit": [
    {
      "lang": "eng",
      "value": "Sean McGregor, Khoa Lam, AIID"
    }
  ],
  "data_type": "AVID",
  "data_version": "0.1",
  "description": {
    "lang": "eng",
    "value": "Facebook\u0027s automatic language translation software incorrectly translated an Arabic post saying \"Good morning\" into Hebrew saying \"hurt them\", leading to the arrest of a Palestinian man in Beitar Illit, Israel."
  },
  "impact": {
    "avid": {
      "lifecycle_view": [
        "L06: Deployment"
      ],
      "risk_domain": [
        "Performance"
      ],
      "sep_view": [
        "P0401: Psychological Safety",
        "P0402: Physical safety"
      ],
      "taxonomy_version": "0.1"
    }
  },
  "last_modified_date": "2022-12-23",
  "metadata": {
    "vuln_id": "AVID-2022-V004"
  },
  "problemtype": {
    "classof": "AIID Incident",
    "description": {
      "lang": "eng",
      "value": "Facebook translates \u0027good morning\u0027 into \u0027attack them\u0027, leading to arrest"
    }
  },
  "published_date": "2022-12-23",
  "references": [
    {
      "label": "Incident 72: Facebook translates \u0027good morning\u0027 into \u0027attack them\u0027, leading to arrest",
      "url": "https://incidentdatabase.ai/cite/72"
    }
  ],
  "reports": []
}


Log in or create an account to share your comment.




Tags
Taxonomy of the tags.





Forecast uses a logistic model when the trend is rising, or an exponential decay model when the trend is falling. Fitted via linearized least squares.

Sightings

Author Source Type Date Other

Nomenclature

  • Seen: The vulnerability was mentioned, discussed, or observed by the user.
  • Confirmed: The vulnerability has been validated from an analyst's perspective.
  • Published Proof of Concept: A public proof of concept is available for this vulnerability.
  • Exploited: The vulnerability was observed as exploited by the user who reported the sighting.
  • Patched: The vulnerability was observed as successfully patched by the user who reported the sighting.
  • Not exploited: The vulnerability was not observed as exploited by the user who reported the sighting.
  • Not confirmed: The user expressed doubt about the validity of the vulnerability.
  • Not patched: The vulnerability was not observed as successfully patched by the user who reported the sighting.


Detection rules are retrieved from Rulezet.