PRM-as-a-Judge
Blog
Technical write-ups, release previews, and collaboration notes from the PRM-as-a-Judge team.
PRM-as-a-Judge 1.5: A Toolkit for Robot Process Assessment
Our latest technical article introduces PRM-as-a-Judge 1.5, a toolkit that turns rollout videos into dense progress curves and fine-grained process assessments. Building on the 1.0 OPD suite, it adds FNS, DRR, and SQS for failure proximity, recovery, and success quality; evaluates mainstream embodied models; and introduces RoboPulse++ for auditing progress judges.
Introducing PRM-as-a-Judge
Our main technical article: why binary success rate is insufficient, how OPD decomposes robotic execution into Outcome, Process, and Diagnosis, and how dense trajectory auditing turns rollout videos into actionable model diagnostics.