fdelucaf/IdioTS

35 downloads in 30 days1 likesLast modified 29 Nov 2024View on Hugging Face

The declared licence (cc-by-nc-sa-4.0) is classified as having use restrictions.

Declared licence: cc-by-nc-sa-4.0, from the tagEvidence: README.md at bb6c0eb
Licence files: No licence file at the top level of the repositoryEvidence: file list at bb6c0eb
Declared sources: None listed in the card metadata
Access gated on Hugging Face: No

Each cell links to what was checked: a file, a file list or a Hub record.

Tasks

Citation text from the card

@inproceedings{de-luca-fornaciari-etal-2024-hard,
    title = "A Hard Nut to Crack: Idiom Detection with Conversational Large Language Models",
    author = "De Luca Fornaciari, Francesca  and
      Altuna, Bego{\~n}a  and
      Gonzalez-Dios, Itziar  and
      Melero, Maite",
    editor = "Ghosh, Debanjan  and
      Muresan, Smaranda  and
      Feldman, Anna  and
      Chakrabarty, Tuhin  and
      Liu, Emmy",
    booktitle = "Proceedings of the 4th Workshop on Figurative Language Processing (FigLang 2024)",
    month = jun,
    year = "2024",
    address = "Mexico City, Mexico (Hybrid)",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2024.figlang-1.5",
    doi = "10.18653/v1/2024.figlang-1.5",
    pages = "35--44",
    abstract = "In this work, we explore idiomatic language processing with Large Language Models (LLMs). We introduce the Idiomatic language Test Suite IdioTS, a dataset of difficult examples specifically designed by language experts to assess the capabilities of LLMs to process figurative language at sentence level. We propose a comprehensive evaluation methodology based on an idiom detection task, where LLMs are prompted with detecting an idiomatic expression in a given English sentence. We present a thorough automatic and manual evaluation of the results and a comprehensive error analysis.",
}

All datasets marked Use restrictions | JSON

The same facts for your agent

A free MCP server at mcp.datalicense.uk/mcp. Connect it from an MCP client such as Claude or Cursor.

dataset_licence({ "id": "fdelucaf/IdioTS" })
signal: "restrictive"
stated_licence: "cc-by-nc-sa-4.0"
sources: 0