All datasets / oscar-corpus
oscar-corpus/OSCAR-2301
The declared licence (cc0-1.0) is classified as permissive.
- Declared licence
- cc0-1.0, from the tagEvidence: README.md at c293046
- Licence files
- No licence file at the top level of the repositoryEvidence: file list at c293046
- Declared sources
- None listed in the card metadata
- Access gated on Hugging Face
- Yes, manual approval required
Tasks
Citation text from the card
@ARTICLE{2022arXiv221210440J,
author = {{Jansen}, Tim and {Tong}, Yangling and {Zevallos}, Victoria and {Ortiz Suarez}, Pedro},
title = "{Perplexed by Quality: A Perplexity-based Method for Adult and Harmful Content Detection in Multilingual Heterogeneous Web Data}",
journal = {arXiv e-prints},
keywords = {Computer Science - Computation and Language},
year = 2022,
month = dec,
eid = {arXiv:2212.10440},
pages = {arXiv:2212.10440},
doi = {10.48550/arXiv.2212.10440},
archivePrefix = {arXiv},
eprint = {2212.10440},
primaryClass = {cs.CL},
adsurl = {https://ui.adsabs.harvard.edu/abs/2022arXiv221210440J},
adsnote = {Provided by the SAO/NASA Astrophysics Data System}
}
@inproceedings{abadji-etal-2022-towards,
title = "Towards a Cleaner Document-Oriented Multilingual Crawled Corpus",
author = "Abadji, Julien and
Ortiz Suarez, Pedro and
Romary, Laurent and
Sagot, Beno{\^\i}t",
booktitle = "Proceedings of the Thirteenth Language Resources and Evaluation Conference",
month = jun,
year = "2022",
address = "Marseille, France",
publisher = "European Language Resources Association",
url = "https://aclanthology.org/2022.lrec-1.463",
pages = "4344--4355",
abstract = "The need for large corpora raw corpora has dramatically increased in recent years with the introduction of transfer learning and semi-supervised learning methods to Natural Lang
The same facts for your agent
A free MCP server at mcp.datalicense.uk/mcp. Connect it from an MCP client such as Claude or Cursor.
dataset_licence({ "id": "oscar-corpus/OSCAR-2301" })
signal: "permissive"
stated_licence: "cc0-1.0"
sources: 0