andstor/the_pile_github

488 downloads in 30 days10 likesLast modified 2 Oct 2025View on Hugging Face

The checks could not identify a recognised licence ID in the dataset's metadata.

Declared licence: other, from the tagEvidence: README.md at 02333b3
Licence files: No licence file at the top level of the repositoryEvidence: file list at 02333b3
Declared sources: None listed in the card metadata
Access gated on Hugging Face: No

Each cell links to what was checked: a file, a file list or a Hub record.

Tasks

Citation text from the card

@article{pile,
    title={The {P}ile: An 800GB Dataset of Diverse Text for Language Modeling},
    author={Gao, Leo and Biderman, Stella and Black, Sid and Golding, Laurence and Hoppe, Travis and Foster, Charles and Phang, Jason and He, Horace and Thite, Anish and Nabeshima, Noa and Presser, Shawn and Leahy, Connor},
    journal={arXiv preprint arXiv:2101.00027},
    year={2020}
}

All datasets marked Unclear | JSON

The same facts for your agent

A free MCP server at mcp.datalicense.uk/mcp. Connect it from an MCP client such as Claude or Cursor.

dataset_licence({ "id": "andstor/the_pile_github" })
signal: "unclear"
stated_licence: "other"
sources: 0