All datasets / twinkle-ai

twinkle-ai/tw-tokenizer-bench

9 downloads in 30 days0 likesLast modified 27 Aug 2026View on Hugging Face

Use restrictions

The declared licence (cc-by-nc-sa-4.0) is classified as having use restrictions.

Declared licence: cc-by-nc-sa-4.0, from the tagEvidence: README.md at 38de40c
Licence files: No licence file at the top level of the repositoryEvidence: file list at 38de40c
Declared sources: None listed in the card metadata
Access gated on Hugging Face: Yes, manual approval required

Each cell links to what was checked: a file, a file list or a Hub record.

Tasks

text-generation

Citation text from the card

@misc{twtokenizerbench2026,
  title = {tw-tokenizer-bench: A Traditional Chinese (Taiwan) Tokenizer Benchmark},
  author = {Liang Hsun Huang},
  year = {2026},
  howpublished = {\url{https://huggingface.co/datasets/twinkle-ai/tw-tokenizer-bench}},
  note = {v0.1, formal register, 24,294 samples across 5 domains.}
}

All datasets marked Use restrictions | JSON

The same facts for your agent

A free MCP server at mcp.datalicense.uk/mcp. Connect it from an MCP client such as Claude or Cursor.

dataset_licence({ "id": "twinkle-ai/tw-tokenizer-bench" })
signal: "restrictive"
stated_licence: "cc-by-nc-sa-4.0"
sources: 0