anisoleai/fineweb-tokenized

Permissive or share-alike

The declared licence (odc-by) is classified as permissive.

Licence facts reported by the dataset and its declared sources. Not legal advice, and not a grant of permission to use the dataset.

Evidence

• Declared licence: odc-by (from the tag)
• Licence files: no licence file at the top level of the repository
• Access gated on Hugging Face: no

Declared sources

No source datasets listed in the card metadata.

Signal

See all datasets marked Permissive or share-alike.

Tasks

• text-generation

Citation text from the card

@misc{anisoleai2026fineweb-tokenized,
  title        = {FineWeb Tokenized},
  author       = {AnisoleAI},
  year         = {2026},
  howpublished = {Hugging Face Datasets},
  url          = {https://huggingface.co/datasets/anisoleai/fineweb-tokenized},
}

@misc{penedo2024fineweb,
  title         = {FineWeb: decanting the web for the finest text data at scale},
  author        = {Guilherme Penedo and Hynek Kydl{\'i}{\v{c}}ek and Loubna Ben allal
                   and Anton Lozhkov and Margaret Mitchell and Colin Raffel
                   and Leandro Von Werra and Thomas Wolf},
  year          = {2024},
  eprint        = {2406.17557},
  archivePrefix = {arXiv},
  primaryClass  = {cs.NE},
}

Downloads (30 days): 88891. Likes: 39. Last modified: 2026-05-29T12:35:53.000Z.

View anisoleai/fineweb-tokenized on Hugging Face | JSON