Skip to content

Pull requests: open-compass/VLMEvalKit

New pull request New
52 Open 942 Closed
52 Open 942 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Benchmark] Add support for realdoc-bench benchmark
#1577 opened Jun 13, 2026 by Helen1p Loading…
[Benchmark] Add support for olmOCR-bench benchmark
#1576 opened Jun 13, 2026 by Helen1p Loading…
[Benchmark] Add support for ParseBench benchmark
#1575 opened Jun 12, 2026 by Helen1p Loading…
Enhance SciDocBench evaluation handling
#1574 opened Jun 11, 2026 by yuhangzang Collaborator Loading…
[Feature] Support dataset-wise config in cli
#1573 opened Jun 11, 2026 by mzr1996 Collaborator Loading…
[Benchmark] Add support for OmniDocBench v1.6 benchmark
#1572 opened Jun 10, 2026 by Helen1p Loading…
[Mode] add support for flyai-vl
#1571 opened Jun 10, 2026 by zhangxuewei-xirui Loading…
1
Add BGPT REFUTE benchmark
#1569 opened Jun 5, 2026 by connerlambden Loading…
1
[Feature] Support DiffSpot (fine-grained visual change detection on web UIs)
#1568 opened Jun 4, 2026 by banyinjushi Loading…
3 tasks done
1
[Feature] Add Rebellions (RBLN) NPU evaluation backend
#1566 opened Jun 2, 2026 by rebel-hwkim Loading…
[Feature] Add MiniMax-M3 model and set as default
#1565 opened Jun 1, 2026 by octo-patch Contributor Loading…
3 tasks done
[Benchmark] Add support for MaRVL, xGQA and ALM-Bench
#1564 opened Jun 1, 2026 by inakiLakunza Contributor Loading…
[Benchmark]Add TextHalu-Bench
#1561 opened May 31, 2026 by Sammy20207109 Loading…
[Fix] Restore missing commas in extract_characters_regex prefix list
#1560 opened May 30, 2026 by YoungZSh Loading…
1
Handle recoverable truncated image payloads
#1554 opened May 25, 2026 by rajantripathi Loading…
1
[Fix] Match verbose Chain-of-Thought in eval
#1552 opened May 21, 2026 by ptonso Loading…
[Fix] Video-MME-v2: improve acc calculation and data preparation
#1551 opened May 20, 2026 by EliYuan30 Loading…
fix: guard choices[0] and message=None before content access
#1550 opened May 17, 2026 by qizwiz Loading…
[Cleanup] Remove unused Polygon3 dependency (#1528)
#1548 opened May 16, 2026 by SHAI-Akshay-Tripathi Contributor Loading…
1
[Benchmark] Add Spatial-DISE benchmark
#1542 opened May 9, 2026 by shinmohuang Loading…
[Fix] Fix default judge model selection conflict in run.py and tools.py
#1532 opened May 6, 2026 by TianhaoLiang2000 Collaborator Loading…
1
[Fix] Fix judge intermediate result caching and resume support
#1531 opened May 6, 2026 by TianhaoLiang2000 Collaborator Loading…
[Benchmark] Add support for MMOral-Uni benchmark
#1527 opened Apr 26, 2026 by isjinghao Contributor Loading…
5
[Benchmark] Add support for ReVSI Benchmark
#1526 opened Apr 25, 2026 by eamonn-zh Loading…
[Benchmark] Add support for Ref-L4_test benchmark
#1525 opened Apr 22, 2026 by rshube Loading…
ProTip! Exclude everything labeled bug with -label:bug.