All datasets / CohereLabsCommunity

CohereLabsCommunity/multilingual-reward-bench

1,827 downloads in 30 days37 likesLast modified 23 Jul 2025View on Hugging Face

The declared licence (odc-by) is classified as permissive.

Declared licence: odc-by, from the tagEvidence: README.md at 04120fd
Licence files: No licence file at the top level of the repositoryEvidence: file list at 04120fd
Declared sources: None listed in the card metadata
Access gated on Hugging Face: No

Each cell links to what was checked: a file, a file list or a Hub record.

Citation text from the card

@inproceedings{gureja-etal-2025-rewardbench,
    title = "{M}-{R}eward{B}ench: Evaluating Reward Models in Multilingual Settings",
    author = "Gureja, Srishti  and
      Miranda, Lester James Validad  and
      Islam, Shayekh Bin  and
      Maheshwary, Rishabh  and
      Sharma, Drishti  and
      Winata, Gusti Triandi  and
      Lambert, Nathan  and
      Ruder, Sebastian  and
      Hooker, Sara  and
      Fadaee, Marzieh",
    editor = "Che, Wanxiang  and
      Nabende, Joyce  and
      Shutova, Ekaterina  and
      Pilehvar, Mohammad Taher",
    booktitle = "Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)",
    month = jul,
    year = "2025",
    address = "Vienna, Austria",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2025.acl-long.3/",
    pages = "43--58",
    ISBN = "979-8-89176-251-0",
    abstract = "Reward models (RMs) have driven the state-of-the-art performance of LLMs today by enabling the integration of human feedback into the language modeling process. However, RMs are primarily trained and evaluated in English, and their capabilities in multilingual settings remain largely understudied. In this work, we conduct a systematic evaluation of several reward models in multilingual settings. We first construct the first-of-its-kind multilingual RM evaluation benchmark, M-RewardBench, consisting of 2.87k preference instances for 23 typologically divers

All datasets marked Permissive or share-alike | JSON

The same facts for your agent

A free MCP server at mcp.datalicense.uk/mcp. Connect it from an MCP client such as Claude or Cursor.

dataset_licence({ "id": "CohereLabsCommunity/multilingual-reward-bench" })
signal: "permissive"
stated_licence: "odc-by"
sources: 0