Search results

VLM2Bench counting metric silently degenerates to exact match (image_seq_len always defaults to 2)

Status: Open.

#1606 In open-compass/VLMEvalKit;

· veerendrav opened on Jul 21, 2026

LiveMMBench空链接

Status: Open.

#1600 In open-compass/VLMEvalKit;

· yangyangyang127 opened on Jul 16, 2026

请问flyai-vl模型的评测什么时候可以支持？

Status: Open.

#1598 In open-compass/VLMEvalKit;

· zhangxuewei-xirui opened on Jul 7, 2026

[Bug] Thyme: sandbox image fed in assistant turn + KV-cache reused across re-encoded turns corrupts multi-round vision context

Status: Open.

#1590 In open-compass/VLMEvalKit;

· Irisicy4 opened on Jun 28, 2026

[Bug] run.py: LOCAL_RANK defaults to 1 instead of 0

Status: Open.

#1589 In open-compass/VLMEvalKit;

· Irisicy4 opened on Jun 28, 2026

Adding [BenchCAD]: would you accept execution-based image→CadQuery-code tasks (heavier deps)?

Status: Open.

#1582 In open-compass/VLMEvalKit;

· HaozheZhang6 opened on Jun 25, 2026

[Bug] CharXiv_descriptive_val DATASET_MD5 appears to be incorrect after #1555

Status: Open.

#1580 In open-compass/VLMEvalKit;

· kail8 opened on Jun 23, 2026

Qwen 3.5支持

Status: Open.

#1562 In open-compass/VLMEvalKit;

· identzz-ai opened on Jun 1, 2026

SEEDBench_IMG & MMStar: option text "None" parsed as NaN by pandas

Status: Open.

#1559 In open-compass/VLMEvalKit;

· identzz-ai opened on May 28, 2026

Ovis2.6-80B-A3B 评测模型预计什么时候可以支持？

Status: Open.

#1553 In open-compass/VLMEvalKit;

· 1359347500cwc opened on May 25, 2026

RFC: Ascend NPU device support

Status: Open.

#1549 In open-compass/VLMEvalKit;

· pjgao opened on May 17, 2026

是否能发布pypi源

Status: Open.

#1537 In open-compass/VLMEvalKit;

· zq1134241486-beep opened on May 8, 2026