K12-KGraph: A Curriculum-Aligned Knowledge Graph for Benchmarking and Training Educational LLMs
The authors build K12-KGraph, a knowledge graph extracted from Chinese K-12 textbooks (math, physics, chemistry, biology), and derive two resources from it: K12-Bench, a 23,640-question benchmark spanning five task categories testing curriculum and prerequisite understanding, and K12-Train, a fine-tuning dataset with text and visual question-answer pairs. Evaluation shows current LLMs struggle with prerequisite and concept-relationship reasoning, while domain-specific fine-tuning on K12-Train substantially closes the gap.
Why it matters
Provides one of the first curriculum-structured, prerequisite-aware benchmarks for educational LLMs rather than flat QA-style tests, useful for gauging whether models actually understand pedagogical dependency structure.
Importance: 2/5
Notable curriculum-aligned benchmark paper; below the 100-upvote HF Daily bump threshold.