inigomartinez/MASEU

56 downloads in 30 days0 likesLast modified 12 Jun 2026View on Hugging Face

The declared licence (mit) is classified as permissive.

Declared licence: mit, from the tagEvidence: README.md at ebb9b37
Licence files: No licence file at the top level of the repositoryEvidence: file list at ebb9b37
Declared sources: None listed in the card metadata
Access gated on Hugging Face: No

Each cell links to what was checked: a file, a file list or a Hub record.

Tasks

Citation text from the card

@inproceedings{martinezcriado-etal-2026-benchmarking,
  title = {Benchmarking Mathematical Reasoning in a Low-Resource Language: Structured Prompting and Evaluation in Basque},
  author = {Martinez-Criado, Inigo and Soroa, Aitor and Barnes, Jeremy},
  booktitle = {Proceedings of the Fifteenth Language Resources and Evaluation Conference (LREC 2026)},
  month = {May},
  year = {2026},
  pages = {5268--5289},
  address = {Palma, Mallorca, Spain},
  publisher = {European Language Resources Association (ELRA)},
  editor = {Piperidis, Stelios and Bel, Núria and van den Heuvel, Henk and Ide, Nancy and Krek, Simon and Toral, Antonio},
  doi = {10.63317/48gd2ysjuh8s},
  abstract = {Large Language Models (LLMs) have shown impressive performance on tasks requiring complex reasoning, but most evaluations tend to focus on English and other high-resource languages. This work investigates how well LLMs perform mathematical reasoning in low-resource languages, using Basque as a primary case study. To support this analysis, we introduce MASEU, a benchmark designed to evaluate reasoning in Basque across arithmetic, algebraic, and logical tasks. We then use this dataset to address three key questions: 1) how well do LLMs support Basque in reasoning tasks, 2) to what extent can including English in prompts improve results, and 3) what is the effect of continued pretraining in Basque? To explore these aspects, we use prompting strategies adapted for mathematical reasoning, building upon the foun

All datasets marked Permissive or share-alike | JSON

The same facts for your agent

A free MCP server at mcp.datalicense.uk/mcp. Connect it from an MCP client such as Claude or Cursor.

dataset_licence({ "id": "inigomartinez/MASEU" })
signal: "permissive"
stated_licence: "mit"
sources: 0