Instrument Like a Learning Scientist
The most valuable thing the Dartmouth team built wasn't the grader. It was the fact that they could answer "did completing this lesson's quiz correlate with doing better on the exam?" — per…
Posts tagged “ed-tech”
The Biggest Effect Size Was the Boring Feature
The feature with the largest effect size in the Dartmouth pilot is the one no startup would put on a landing page. Not the AI grader. Not the chatbot. Cumulative module reviews: a big quiz…
The Grader Was Right and the Students Quit Anyway
The most dangerous failure in the Dartmouth Phosphor pilot wasn't a wrong grade. Students found the constructed-response grader "rigid and discouraging," complained loudly enough that the team…
Your LLM Judge Needs a Test Suite
Nobody ships a payment system without tests, but teams ship LLM judges into production on vibes every day. A grader, a triage classifier, an eval pipeline's scoring model — if an LLM's judgment…
Grading Written Answers with an LLM, Properly
The most common mistake in LLM grading is asking the model for a grade.
The AI Tutor Everyone Builds Is the One Students Ignore
Every student now carries a competent tutor in their pocket, and academic performance hasn't moved. That's the puzzle worth sitting with. The answer, based on a deployment study published this…