Hoshikuzu/ccmatrix-en-ja

115 downloads in 30 days1 likesLast modified 3 Aug 2024View on Hugging Face

The checks could not identify a recognised licence ID in the dataset's metadata.

Declared licence: unknown, from the tagEvidence: README.md at 95536b0
Licence files: No licence file at the top level of the repositoryEvidence: file list at 95536b0
Declared sources: None listed in the card metadata
Access gated on Hugging Face: No

Each cell links to what was checked: a file, a file list or a Hub record.

Tasks

Citation text from the card

Follow the instructions described in the **[yhavinga/ccmatrix](https://huggingface.co/datasets/yhavinga/ccmatrix)** readme.
The following is taken from **[yhavinga/ccmatrix](https://huggingface.co/datasets/yhavinga/ccmatrix)**:

IMPORTANT: Please cite reference [2][3] if you use this data.

1. **[CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data](https://arxiv.org/abs/1911.00359)**
   by *Guillaume Wenzek, Marie-Anne Lachaux, Alexis Conneau, Vishrav Chaudhary, Francisco Guzmán, Armand Jouli
    and Edouard Grave*.
2. **[CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEB](https://arxiv.org/abs/1911.04944)** by *Holger Schwenk, Guillaume Wenzek, Sergey Edunov, Edouard Grave and Armand Joulin*.
3. **[Beyond English-Centric Multilingual Machine Translation](https://arxiv.org/abs/2010.11125)** by *Angela Fan, Shruti Bhosale, Holger Schwenk, Zhiyi Ma, Ahmed El-Kishky, Siddharth Goyal, Mandeep Baines,
    Onur Celebi, Guillaume Wenzek, Vishrav Chaudhary, Naman Goyal, Tom Birch, Vitaliy Liptchinsky,
    Sergey Edunov, Edouard Grave, Michael Auli, and Armand Joulin.*

This HuggingFace CCMatrix dataset is a wrapper around the service and files prepared and hosted by OPUS:

* **[Parallel Data, Tools and Interfaces in OPUS](https://www.aclweb.org/anthology/L12-1246/)** by *Jörg Tiedemann*.

All datasets marked Unclear | JSON

The same facts for your agent

A free MCP server at mcp.datalicense.uk/mcp. Connect it from an MCP client such as Claude or Cursor.

dataset_licence({ "id": "Hoshikuzu/ccmatrix-en-ja" })
signal: "unclear"
stated_licence: "unknown"
sources: 0