HumanEval-V

community

AI & ML interests

Visual Centric Coding Tasks for Large Multimodal Models

in HumanEval-V/HumanEval-V-Benchmark about 1 year ago

Set task category to image-text-to-text

#2 opened about 1 year ago by

updated a Space about 1 year ago

HumanEval V Benchmark Viewer

A simple data viewer for the HumanEval-V benchmark.

updated a dataset about 1 year ago

HumanEval-V/HumanEval-V-Benchmark

Viewer • Updated Feb 21, 2025 • 253 • 191 • 1

updated a Space about 1 year ago

README

published a dataset about 1 year ago

HumanEval-V/HumanEval-V-Benchmark

Viewer • Updated Feb 21, 2025 • 253 • 191 • 1

authored 5 papers over 1 year ago

RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation

Paper • 2303.12570 • Published Mar 22, 2023

Private-Library-Oriented Code Generation with Large Language Models

Paper • 2307.15370 • Published Jul 28, 2023 • 1

CodeT: Code Generation with Generated Tests

Paper • 2207.10397 • Published Jul 21, 2022

Large Language Models Meet NL2Code: A Survey

Paper • 2212.09420 • Published Dec 19, 2022 • 1

HumanEval-V: Benchmarking High-Level Visual Reasoning with Complex Diagrams in Coding Tasks

Paper • 2410.12381 • Published Oct 16, 2024 • 43

authored a paper about 2 years ago

CMMMU: A Chinese Massive Multi-discipline Multimodal Understanding Benchmark

Paper • 2401.11944 • Published Jan 22, 2024 • 27

authored a paper over 2 years ago

SoTaNa: The Open-Source Software Development Assistant

Paper • 2308.13416 • Published Aug 25, 2023 • 14