PRM-as-a-Judge

Blog

Technical write-ups, release previews, and collaboration notes from the PRM-as-a-Judge team.

Mid-July 2026 June 30, 2026

PRM-as-a-Judge 1.5 Is Coming

A short preview of the 1.5 toolkit planned for mid-July 2026: a PPL correction found through close collaboration with the Orca team, higher-level trajectory diagnostics, and a call for broader benchmark and model collaborations.

Read the short update
🔥 Featured Published March 23, 2026 · Updated March 30, 2026

Introducing PRM-as-a-Judge

Our main technical article: why binary success rate is insufficient, how OPD decomposes robotic execution into Outcome, Process, and Diagnosis, and how dense trajectory auditing turns rollout videos into actionable model diagnostics.

Read the main article