Blog

• 2026-10-16Porting GBA Eval to the NES

  What changed when the method moved to a different console: palette indices instead of colours, a power-on state that has to be specified, determinism from the reference cache to the JSON output, and the grader bugs I found before any model ran.

• 2026-10-16Did any model hack the grader?

  Four models, 24 hours each. No model special-cased a test ROM, but one constant fitted to the reference is worth 0.36 of a score, one model worked out which emulator it was graded against, and the harness itself had a bug that ended a run early.