QCRI/AraDICE-HellaSwag

38 downloads in 30 days0 likesLast modified 18 May 2025View on Hugging Face

The declared licence (cc-by-nc-sa-4.0) is classified as having use restrictions.

Declared licence: cc-by-nc-sa-4.0, from the tagEvidence: README.md at 6cf4e07
Licence files: No licence file at the top level of the repositoryEvidence: file list at 6cf4e07
Declared sources: None listed in the card metadata
Access gated on Hugging Face: No

Each cell links to what was checked: a file, a file list or a Hub record.

Citation text from the card

@inproceedings{mousi-etal-2025-aradice,
    title = "{A}ra{D}i{CE}: Benchmarks for Dialectal and Cultural Capabilities in {LLM}s",
    author = "Mousi, Basel  and
      Durrani, Nadir  and
      Ahmad, Fatema  and
      Hasan, Md. Arid  and
      Hasanain, Maram  and
      Kabbani, Tameem  and
      Dalvi, Fahim  and
      Chowdhury, Shammur Absar  and
      Alam, Firoj",
    editor = "Rambow, Owen  and
      Wanner, Leo  and
      Apidianaki, Marianna  and
      Al-Khalifa, Hend  and
      Eugenio, Barbara Di  and
      Schockaert, Steven",
    booktitle = "Proceedings of the 31st International Conference on Computational Linguistics",
    month = jan,
    year = "2025",
    address = "Abu Dhabi, UAE",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2025.coling-main.283/",
    pages = "4186--4218",
    abstract = "Arabic, with its rich diversity of dialects, remains significantly underrepresented in Large Language Models, particularly in dialectal variations. We address this gap by introducing seven synthetic datasets in dialects alongside Modern Standard Arabic (MSA), created using Machine Translation (MT) combined with human post-editing. We present AraDiCE, a benchmark for Arabic Dialect and Cultural Evaluation. We evaluate LLMs on dialect comprehension and generation, focusing specifically on low-resource Arabic dialects. Additionally, we introduce the first-ever fine-grained benchmark designed to e

All datasets marked Use restrictions | JSON

The same facts for your agent

A free MCP server at mcp.datalicense.uk/mcp. Connect it from an MCP client such as Claude or Cursor.

dataset_licence({ "id": "QCRI/AraDICE-HellaSwag" })
signal: "restrictive"
stated_licence: "cc-by-nc-sa-4.0"
sources: 0