{
 "id": "sal4ahm/RealCQA",
 "owner": "sal4ahm",
 "name": "RealCQA",
 "downloads": 4963,
 "likes": 5,
 "last_modified": "2024-09-09T18:14:20.000Z",
 "stated_licence": "mit",
 "stated_from": "tag",
 "licence_name": null,
 "licence_link": null,
 "file_licence": null,
 "licence_files": [],
 "sources": [],
 "gated": false,
 "tasks": [],
 "citation": "@InProceedings{10.1007/978-3-031-41682-8_5,\nauthor=\"Ahmed, Saleem\nand Jawade, Bhavin\nand Pandey, Shubham\nand Setlur, Srirangaraj\nand Govindaraju, Venu\",\neditor=\"Fink, Gernot A.\nand Jain, Rajiv\nand Kise, Koichi\nand Zanibbi, Richard\",\ntitle=\"RealCQA: Scientific Chart Question Answering as a Test-Bed for First-Order Logic\",\nbooktitle=\"Document Analysis and Recognition - ICDAR 2023\",\nyear=\"2023\",\npublisher=\"Springer Nature Switzerland\",\naddress=\"Cham\",\npages=\"66--83\",\nabstract=\"We present a comprehensive study of chart visual question-answering(QA) task, to address the challenges faced in comprehending and extracting data from chart visualizations within documents. Despite efforts to tackle this problem using synthetic charts, solutions are limited by the shortage of annotated real-world data. To fill this gap, we introduce a benchmark and dataset for chart visual QA on real-world charts, offering a systematic analysis of the task and a novel taxonomy for template-based chart question creation. Our contribution includes the introduction of a new answer type, `list', with both ranked and unranked variations. Our study is conducted on a real-world chart dataset from scientific literature, showcasing higher visual complexity compared to other works. Our focus is on template-based QA and how it can serve as a standard for evaluating the first-order logic capabilities of models. The results of our experiments, conducted on a real-world out-of-distribution dataset, provide a robust eva",
 "signal": "permissive",
 "reason": "The declared licence (mit) is classified as permissive.",
 "revision": "fc0f3c1852e66a2ce3d04610bd0bdace6858f518",
 "stated_evidence": "https://huggingface.co/datasets/sal4ahm/RealCQA/blob/fc0f3c1852e66a2ce3d04610bd0bdace6858f518/README.md",
 "file_evidence": "https://huggingface.co/datasets/sal4ahm/RealCQA/tree/fc0f3c1852e66a2ce3d04610bd0bdace6858f518",
 "card_nc": false
}