The inability of NAPLAN to reflect broader developments in society is being exposed by the transition to NAPLAN online. The latest NAPLAN controversy is not the result of a glitch or technical incompetence. Instead, the controversy exposes a broader conceptual problem in Australian education. Australian policy-makers and commentators have been spoiled by Australia coming of high-base of educational performance, and by an abundance of educational data that allows for broad and sweeping policy commentary. However, this approach is leading to a continued decline in Australian educational achievement. NAPLAN online exposes the need to reconnect educational assessment with the world that students experience.