AVID-2022-V006

Vulnerability from avid – Published: 2022-12-23 – Updated: 2022-12-23 AIID Incident
Summary
Terms-of-service-violating videos related to suicide and self-harm reportedly bypassed YouTube's content moderation algorithms, allegedly resulting in exposure of graphic content to young users via recommended videos.
Risk domain
Performance
SEP view
P0401: Psychological Safety, P0402: Physical safety
Lifecycle
L06: Deployment
Organisations
YouTube (deployer), YouTube (developer)
References
URL Label
https://incidentdatabase.ai/cite/281 Incident 281: YouTube's Algorithms Failed to Remove Violating Content Related to Suicide and Self-Harm
To clipboard 

{
  "affects": {
    "artifacts": [
      {
        "name": "",
        "type": "System"
      }
    ],
    "deployer": [
      "YouTube"
    ],
    "developer": [
      "YouTube"
    ]
  },
  "credit": [
    {
      "lang": "eng",
      "value": "Khoa Lam, AIID"
    }
  ],
  "data_type": "AVID",
  "data_version": "0.1",
  "description": {
    "lang": "eng",
    "value": "Terms-of-service-violating videos related to suicide and self-harm reportedly bypassed YouTube\u0027s content moderation algorithms, allegedly resulting in exposure of graphic content to young users via recommended videos."
  },
  "impact": {
    "avid": {
      "lifecycle_view": [
        "L06: Deployment"
      ],
      "risk_domain": [
        "Performance"
      ],
      "sep_view": [
        "P0401: Psychological Safety",
        "P0402: Physical safety"
      ],
      "taxonomy_version": "0.1"
    }
  },
  "last_modified_date": "2022-12-23",
  "metadata": {
    "vuln_id": "AVID-2022-V006"
  },
  "problemtype": {
    "classof": "AIID Incident",
    "description": {
      "lang": "eng",
      "value": "YouTube\u0027s Algorithms Failed to Remove Violating Content Related to Suicide and Self-Harm"
    }
  },
  "published_date": "2022-12-23",
  "references": [
    {
      "label": "Incident 281: YouTube\u0027s Algorithms Failed to Remove Violating Content Related to Suicide and Self-Harm",
      "url": "https://incidentdatabase.ai/cite/281"
    }
  ],
  "reports": []
}


Log in or create an account to share your comment.




Tags
Taxonomy of the tags.





Forecast uses a logistic model when the trend is rising, or an exponential decay model when the trend is falling. Fitted via linearized least squares.

Sightings

Author Source Type Date Other

Nomenclature

  • Seen: The vulnerability was mentioned, discussed, or observed by the user.
  • Confirmed: The vulnerability has been validated from an analyst's perspective.
  • Published Proof of Concept: A public proof of concept is available for this vulnerability.
  • Exploited: The vulnerability was observed as exploited by the user who reported the sighting.
  • Patched: The vulnerability was observed as successfully patched by the user who reported the sighting.
  • Not exploited: The vulnerability was not observed as exploited by the user who reported the sighting.
  • Not confirmed: The user expressed doubt about the validity of the vulnerability.
  • Not patched: The vulnerability was not observed as successfully patched by the user who reported the sighting.


Detection rules are retrieved from Rulezet.