{
 "id": "PaulineLi/QuantiPhy-validation",
 "owner": "PaulineLi",
 "name": "QuantiPhy-validation",
 "downloads": 2144,
 "likes": 9,
 "last_modified": "2026-10-09T03:55:50.000Z",
 "stated_licence": "cc-by-4.0",
 "stated_from": "tag",
 "licence_name": null,
 "licence_link": null,
 "file_licence": null,
 "licence_files": [],
 "sources": [],
 "gated": false,
 "tasks": [
  "video-text-to-text",
  "visual-question-answering"
 ],
 "citation": "If you use this validation set in your work, please cite:\n\n```bibtex\n@article{li2025quantiphy,\n  title   = {QuantiPhy: A Quantitative Benchmark Evaluating Physical Reasoning Abilities of Vision-Language Models},\n  author  = {Li, Puyin and Xiang, Tiange and Mao, Ella and Wei, Shirley and Chen, Xinye and Masood, Adnan and Li, Fei-Fei and Adeli, Ehsan},\n  journal = {arXiv preprint arXiv:2512.19526},\n  year    = {2025}\n}\n\n## Measurement Conventions\n\n- **Wingspan / width of flying animals**: the fully spread, wing-tip-to-wing-tip extent, i.e. the maximum width attained during flight.\n- **Body length of animals** (e.g. the prior \"length of the small bird\"): the object's axis-aligned bounding-box length in the simulator.\n- **`depth_info` for lab clips with an `s`/`x` suffix**: these are SAM-masked variants of the base clip; their depth references describe the original scene and may name objects that are masked out of the variant.\n\n## Changelog\n\n- 2026-10-07: fixed spelling errors in several questions; `video_source` value `segmentaion` corrected to `segmentation`; removed the BOM, trailing empty columns and stray `#NAME?` cells from `validation_dataset.csv`. Ground-truth values and row order are unchanged.\n- 2026-10-08 (erratum): removed the row \"What is the shoulder breadth of the person in cm?\" listed under `captured_0027s` (index 2607). That clip is a SAM-masked variant in which the person is not visible, so the question could not be answered; it belonged to the base clip, which ",
 "signal": "permissive",
 "reason": "The declared licence (cc-by-4.0) is classified as permissive.",
 "revision": "2d56ff31c22c12bf377b2c2092ff229d291fd830",
 "stated_evidence": "https://huggingface.co/datasets/PaulineLi/QuantiPhy-validation/blob/2d56ff31c22c12bf377b2c2092ff229d291fd830/README.md",
 "file_evidence": "https://huggingface.co/datasets/PaulineLi/QuantiPhy-validation/tree/2d56ff31c22c12bf377b2c2092ff229d291fd830",
 "card_nc": false
}