- Notifications
You must be signed in to change notification settings - Fork 531
Pull requests: open-compass/VLMEvalKit
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Fix: Molmo Crash - AttributeError: 'NoneType' object has no attribute 'size'
#1297 opened Oct 30, 2025 by DrishtiShrrrma Loading…
README: Pin exact transformers for LLaVA-Next to avoid “Got USER: <image>” error
#1294 opened Oct 28, 2025 by DrishtiShrrrma Loading…
Official evaluation implementation of HiPhO Benchmark
#1293 opened Oct 28, 2025 by MarkovChain-why Loading…
add support for internvideo, videollama, keye and llava-onevision-1.5 WIP
#1244 opened Sep 22, 2025 by FangXinyu-0913 Loading…
[major] add tsv, xlsx, json fo PRED_FORMAT and csv, json for EVAL_FORMAT
#1172 opened Jul 20, 2025 by OliverLeeXZ Loading…
[Model] Add new model provider: AI/ML API
#1093 opened Jun 19, 2025 by D1m7asis Loading…
4 tasks done
[Minor] Align MMMU evaluation method with official Pending
#966 opened Apr 28, 2025 by FangXinyu-0913 Loading…
[Benchmark] Support Video MCQ with TaskMeAnything-v1-video-random as an example
#359 opened Aug 5, 2024 by weikaih04 Loading…
[Support] multiple process parallel inference large model on multi-gpu WIP
#298 opened Jul 19, 2024 by junming-yang Loading…
ProTip! no:milestone will show everything without a milestone.