datalicense

All datasets / huggingface

huggingface/tokbench-corpora

1,021 downloads in 30 days0 likesLast modified 21 Sep 2026View on Hugging Face
Unclear

The checks could not identify a recognised licence ID in the dataset's metadata.

Declared licence
other, from the tagEvidence: README.md at bafa2fb
Licence name on the card
mixed-per-corpus, link: https://huggingface.co/datasets/huggingface/tokbench-corpora#provenance-and-licencesEvidence: README.md at bafa2fb
Licence files
No licence file at the top level of the repositoryEvidence: file list at bafa2fb
Declared sources
None listed in the card metadata
Access gated on Hugging Face
No
Each cell links to what was checked: a file, a file list or a Hub record.

Tasks

Citation text from the card

@software{tokbench,
  title  = {tokbench: a tokenizer implementation benchmark},
  author = {Hugging Face},
  url    = {https://github.com/huggingface/tokbench}
}

The same facts for your agent

A free MCP server at mcp.datalicense.uk/mcp. Connect it from an MCP client such as Claude or Cursor.

dataset_licence({ "id": "huggingface/tokbench-corpora" })
signal: "unclear"
stated_licence: "other"
sources: 0