datalicense

All datasets / dtk-llms

dtk-llms/lm-diagnostics-negsimp

5 downloads in 30 days0 likesLast modified 7 Sep 2025View on Hugging Face
Permissive or share-alike

The declared licence (mit) is classified as permissive.

Declared licence
mit, from the tagEvidence: README.md at 128dca7
Licence files
No licence file at the top level of the repositoryEvidence: file list at 128dca7
Declared sources
None listed in the card metadata
Access gated on Hugging Face
No
Each cell links to what was checked: a file, a file list or a Hub record.

Citation text from the card

@article{10.1162/tacl_a_00298,
    author = {Ettinger, Allyson},
    title = {What BERT Is Not: Lessons from a New Suite of Psycholinguistic Diagnostics for Language Models},
    journal = {Transactions of the Association for Computational Linguistics},
    volume = {8},
    pages = {34-48},
    year = {2020},
    month = {01},
    abstract = {Pre-training by language modeling has become a popular and successful approach to NLP tasks, but we have yet to understand exactly what linguistic capacities these pre-training processes confer upon models. In this paper we introduce a suite of diagnostics drawn from human language experiments, which allow us to ask targeted questions about information used by language models for generating predictions in context. As a case study, we apply these diagnostics to the popular BERT model, finding that it can generally distinguish good from bad completions involving shared category or role reversal, albeit with less sensitivity than humans, and it robustly retrieves noun hypernyms, but it struggles with challenging inference and role-based event prediction— and, in particular, it shows clear insensitivity to the contextual impacts of negation.},
    issn = {2307-387X},
    doi = {10.1162/tacl_a_00298},
    url = {https://doi.org/10.1162/tacl_a_00298},
    eprint = {https://direct.mit.edu/tacl/article-pdf/doi/10.1162/tacl_a_00298/1923116/tacl_a_00298.pdf},
}

The same facts for your agent

A free MCP server at mcp.datalicense.uk/mcp. Connect it from an MCP client such as Claude or Cursor.

dataset_licence({ "id": "dtk-llms/lm-diagnostics-negsimp" })
signal: "permissive"
stated_licence: "mit"
sources: 0