All datasets / Robert-Morabito

Robert-Morabito/STOP

74 downloads in 30 days0 likesLast modified 10 Feb 2025View on Hugging Face

Permissive or share-alike

The declared licence (cc-by-4.0) is classified as permissive.

Declared licence: cc-by-4.0, from the tagEvidence: README.md at 0d3b5a4
Licence files: No licence file at the top level of the repositoryEvidence: file list at 0d3b5a4
Declared sources: None listed in the card metadata
Access gated on Hugging Face: No

Each cell links to what was checked: a file, a file list or a Hub record.

Tasks

question-answering

Citation text from the card

@inproceedings{morabito-etal-2024-stop,
    title = "{STOP}! Benchmarking Large Language Models with Sensitivity Testing on Offensive Progressions",
    author = "Morabito, Robert  and
      Madhusudan, Sangmitra  and
      McDonald, Tyler  and
      Emami, Ali",
    editor = "Al-Onaizan, Yaser  and
      Bansal, Mohit  and
      Chen, Yun-Nung",
    booktitle = "Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing",
    month = nov,
    year = "2024",
    address = "Miami, Florida, USA",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2024.emnlp-main.243/",
    doi = "10.18653/v1/2024.emnlp-main.243",
    pages = "4221--4243",
    abstract = "Mitigating explicit and implicit biases in Large Language Models (LLMs) has become a critical focus in the field of natural language processing. However, many current methodologies evaluate scenarios in isolation, without considering the broader context or the spectrum of potential biases within each situation. To address this, we introduce the Sensitivity Testing on Offensive Progressions (STOP) dataset, which includes 450 offensive progressions containing 2,700 unique sentences of varying severity that progressively escalate from less to more explicitly offensive. Covering a broad spectrum of 9 demographics and 46 sub-demographics, STOP ensures inclusivity and comprehensive coverage. We evaluate several leading closed- and open-source models, including

All datasets marked Permissive or share-alike | JSON

The same facts for your agent

A free MCP server at mcp.datalicense.uk/mcp. Connect it from an MCP client such as Claude or Cursor.

dataset_licence({ "id": "Robert-Morabito/STOP" })
signal: "permissive"
stated_licence: "cc-by-4.0"
sources: 0