All datasets / floatai

floatai/TKEval

85 downloads in 30 days2 likesLast modified 11 Dec 2024View on Hugging Face

Permissive or share-alike

The declared licence (apache-2.0) is classified as permissive.

Declared licence: apache-2.0, from the tagEvidence: README.md at ecd7fa2
Licence files: No licence file at the top level of the repositoryEvidence: file list at ecd7fa2
Declared sources: None listed in the card metadata
Access gated on Hugging Face: No

Each cell links to what was checked: a file, a file list or a Hub record.

Tasks

text2text-generation

Citation text from the card

@inproceedings{chai2024tokenization,
  title={Tokenization Falling Short: On Subword Robustness in Large Language Models},
  author={Chai, Yekun and Fang, Yewei and Peng, Qiwei and Li, Xuhong},
  booktitle={Findings of the Association for Computational Linguistics: EMNLP 2024},
  pages={1582--1599},
  year={2024}
}

All datasets marked Permissive or share-alike | JSON

The same facts for your agent

A free MCP server at mcp.datalicense.uk/mcp. Connect it from an MCP client such as Claude or Cursor.

dataset_licence({ "id": "floatai/TKEval" })
signal: "permissive"
stated_licence: "apache-2.0"
sources: 0