Search

Find a vulnerability

Search criteria ⓘ Use this form to refine search results.
Full-text search supports keyword queries with ranking and filtering.
You can combine vendor, product, and sources to narrow results.
Enable “Apply ordering” to sort by date instead of relevance.

    1 vulnerability found for xlm-roberta-base

    AVID-2022-V002

    Vulnerability from avid – Published: 2022-12-23 – Updated: 2022-12-23 LLM Evaluation
    Summary
    Sentence Completion Tasks performed by xlm-roberta-base demonstrate significant gender bias, perpetuating negative social and professional stereotypes against females.
    Risk domain
    Ethics
    SEP view
    E0101: Group fairness
    Lifecycle
    L05: Evaluation
    Organisations
    HuggingFace (deployer)
    Affected artifacts
    Artifact Type
    xlm-roberta-base Model
    References
    URL Label
    https://huggingface.co/xlm-roberta-base xlm-roberta-base on Hugging Face
    To clipboard 

    {
  "affects": {
    "artifacts": [
      {
        "name": "xlm-roberta-base",
        "type": "Model"
      }
    ],
    "deployer": [
      "HuggingFace"
    ],
    "developer": []
  },
  "credit": [
    {
      "lang": "eng",
      "value": "Harry Saini, AVID"
    },
    {
      "lang": "eng",
      "value": "Sasha Luccioni, Hugging Face"
    }
  ],
  "data_type": "AVID",
  "data_version": "0.1",
  "description": {
    "lang": "eng",
    "value": "Sentence Completion Tasks performed by xlm-roberta-base demonstrate significant gender bias, perpetuating negative social and professional stereotypes against females."
  },
  "impact": {
    "avid": {
      "lifecycle_view": [
        "L05: Evaluation"
      ],
      "risk_domain": [
        "Ethics"
      ],
      "sep_view": [
        "E0101: Group fairness"
      ],
      "taxonomy_version": "0.1"
    }
  },
  "last_modified_date": "2022-12-23",
  "metadata": {
    "vuln_id": "AVID-2022-V002"
  },
  "problemtype": {
    "classof": "LLM Evaluation",
    "description": {
      "lang": "eng",
      "value": "Gender Bias in Sentence Completion Tasks performed by xlm-roberta-base"
    }
  },
  "published_date": "2022-12-23",
  "references": [
    {
      "label": "xlm-roberta-base on Hugging Face",
      "url": "https://huggingface.co/xlm-roberta-base"
    }
  ],
  "reports": [
    {
      "name": "Gender Bias in Sentence Completion Tasks performed by xlm-roberta-base using the HONEST metric",
      "report_id": "AVID-2022-R0002",
      "type": "Detection"
    },
    {
      "name": "Profession bias reinforcing gender stereotypes found in xlm-roberta-base, as measured on the Winobias dataset",
      "report_id": "AVID-2022-R0004",
      "type": "Detection"
    }
  ]
}