All datasets / SEACrowd

SEACrowd/khmer_alt_pos

39 downloads in 30 days1 likesLast modified 24 Jun 2024View on Hugging Face

Use restrictions

The declared licence (cc-by-nc-sa-4.0) is classified as having use restrictions.

Declared licence: cc-by-nc-sa-4.0, from the tagEvidence: README.md at c00596b
Licence files: LICENSE, detected as cc-by-nc-sa-4.0Evidence: LICENSE at c00596b
Declared sources: None listed in the card metadata
Access gated on Hugging Face: No

Each cell links to what was checked: a file, a file list or a Hub record.

Tasks

pos-tagging

Citation text from the card

@article{10.1145/3464378,
author = {Kaing, Hour and Ding, Chenchen and Utiyama, Masao and Sumita, Eiichiro and Sam, Sethserey and Seng, Sopheap and Sudoh, Katsuhito and Nakamura, Satoshi},
title = {Towards Tokenization and Part-of-Speech Tagging for Khmer: Data and Discussion},
year = {2021},
issue_date = {November 2021},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
volume = {20},
number = {6},
issn = {2375-4699},
url = {https://doi.org/10.1145/3464378},
doi = {10.1145/3464378},
abstract = {As a highly analytic language, Khmer has considerable ambiguities in tokenization and part-of-speech (POS) tagging processing. This topic is investigated in this study. Specifically, a 20,000-sentence Khmer corpus with manual tokenization and POS-tagging annotation is released after a series of work over the last 4 years. This is the largest morphologically annotated Khmer dataset as of 2020, when this article was prepared. Based on the annotated data, experiments were conducted to establish a comprehensive benchmark on the automatic processing of tokenization and POS-tagging for Khmer. Specifically, a support vector machine, a conditional random field (CRF), a long short-term memory (LSTM)-based recurrent neural network, and an integrated LSTM-CRF model have been investigated and discussed. As a primary conclusion, processing at morpheme-level is satisfactory for the provided data. However, it is intrinsically difficult to identify further grammatical

All datasets marked Use restrictions | JSON

The same facts for your agent

A free MCP server at mcp.datalicense.uk/mcp. Connect it from an MCP client such as Claude or Cursor.

dataset_licence({ "id": "SEACrowd/khmer_alt_pos" })
signal: "restrictive"
stated_licence: "cc-by-nc-sa-4.0"
sources: 0