All datasets / turkish-nlp-suite
turkish-nlp-suite/OzenliDerlem
The declared licence (cc-by-sa-4.0) is classified as share-alike.
- Declared licence
- cc-by-sa-4.0, from the tagEvidence: README.md at 539fc60
- Licence files
- No licence file at the top level of the repositoryEvidence: file list at 539fc60
- Declared sources
- None listed in the card metadata
- Access gated on Hugging Face
- No
Citation text from the card
@InProceedings{10.1007/978-3-031-70563-2_16,
author="Altinok, Duygu",
editor="N{\"o}th, Elmar
and Hor{\'a}k, Ale{\v{s}}
and Sojka, Petr",
title="Bella Turca: A Large-Scale Dataset of Diverse Text Sources for Turkish Language Modeling",
booktitle="Text, Speech, and Dialogue",
year="2024",
publisher="Springer Nature Switzerland",
address="Cham",
pages="196--213",
abstract="In recent studies, it has been demonstrated that incorporating diverse training datasets enhances the overall knowledge and generalization capabilities of large-scale language models, especially in cross-domain scenarios. In line with this, we introduce Bella Turca: a comprehensive Turkish text corpus, totaling 265GB, specifically curated for training language models. Bella Turca encompasses 25 distinct subsets of 4 genre, carefully chosen to ensure diversity and high quality. While Turkish is spoken widely across three continents, it suffers from a dearth of robust data resources for language modelling. Existing transformers and language models have primarily relied on repetitive corpora such as OSCAR and/or Wiki, which lack the desired diversity. Our work aims to break free from this monotony by introducing a fresh perspective to Turkish corpora resources. To the best of our knowledge, this release marks the first instance of such a vast and diverse dataset tailored for the Turkish language. Additionally, we contribute to the community by providing the code used in the dataset's construction and cleaning, f
The same facts for your agent
A free MCP server at mcp.datalicense.uk/mcp. Connect it from an MCP client such as Claude or Cursor.
dataset_licence({ "id": "turkish-nlp-suite/OzenliDerlem" })
signal: "permissive"
stated_licence: "cc-by-sa-4.0"
sources: 0