Dataset licence facts About

EleutherAI/pile

Unclear

The checks could not identify a recognised licence ID in the dataset's metadata.

Licence facts reported by the dataset and its declared sources. Not legal advice, and not a grant of permission to use the dataset.

Evidence

Declared sources

No source datasets listed in the card metadata.

Signal

See all datasets marked Unclear.

Tasks

Citation text from the card

@article{gao2020pile,
  title={The {P}ile: An 800{GB} dataset of diverse text for language modeling},
  author={Gao, Leo and Biderman, Stella and Black, Sid and Golding, Laurence and Hoppe, Travis and Foster, Charles and Phang, Jason and He, Horace and Thite, Anish and Nabeshima, Noa and others},
  journal={arXiv preprint arXiv:2101.00027},
  year={2020}
}


@article{biderman2022datasheet,
  title={Datasheet for the pile},
  author={Biderman, Stella and Bicheno, Kieran and Gao, Leo},
  journal={arXiv preprint arXiv:2201.07311},
  year={2022}
}

Downloads (30 days): 6761. Likes: 517. Last modified: 2023-05-03T15:58:14.000Z.

View EleutherAI/pile on Hugging Face | JSON