Description

MMCircuitEval is the first multimodal benchmark specifically designed to comprehensively evaluate MLLMs on electronic design automation (EDA) tasks in digital and analog circuit design. It contains 3614 expert-reviewed question-answer pairs drawn from textbooks, technical question banks, datasheets and real-world documentation, categorized by design stage, circuit type, tested abilities (knowledge, comprehension, reasoning, computation) and difficulty to enable detailed analysis of model capabilities.