Monday, February 25, 2013

The education prime minister fails stats, misleading us about literacy

Why not simply tell us the truth?

In launching a new school literacy program prime minister Julia Gillard appears to have committed a statistical howler.

Declaring that around 75,000 students failed to meet national minimum standards in the NAPLAN test last year she said, “without improvement that number could climb to more than 150,000 by 2025”.

The doubling is the result of extrapolating forward the change over one year for 13 years.

Responding to Fairfax Media the education minister’s office said the calculation was “a Commonwealth analysis based on Year 3 NAPLAN data and assumes the change seen between 2011 and 2012 continues out to 2025.”

Extending forward only the most recent change in a statistic is widely regarded as bad practice, likely to produce nonsense.

“One change does not a trend make,” said Deloitte Access director Chris Richardson, a former treasury economist.

If for example the Commonwealth had extended forward only the most recent change in employment (between December and January) it would have looked as if employment was on track to climb 124,800 in the coming year. But if it had extended forward the previous change (between November and December) employment would have looked on track to slide 45,600.

“It’s good practice to use all of the comparable data, not just one change,” said Mr Richardson. “The trend is your friend. To construct it you should use all the comparable data.”

NAPLAN data going back to 2008 show reading, spelling and grammar on an improving trend...

The proportion of Year 3 students failing to meet minimum reading standards fell from 7.9 per cent to 6.5 per cent. The proportion failing to meet minimum spelling standards fell from 7.5 to 6 per cent.

“We will make this reading blitz one of the aims of our school funding reforms,” Ms Gillard told parents and children gathered for the launch at her residence in Canberra. “We want to make sure that every child is assessed, every child's strengths and weaknesses on reading are known and every child gets the opportunity to become a great reader.”

The Federal Government will ask all schools, state and private, to sign up to an intensive four-year program in which year teachers from years K to 3 maintain a running record of each student’s progress and set out a reading plan which includes the sounding out of words as one of the teaching methods.

No specific funding is allocated for the program which will be “embedded in the work we are already doing for school funding reform”.

State education ministers welcomed the program saying it was along the same lines as work they were doing themselves.

“Our Early Action for Success strategy will see an additional 900 teachers employed across all school sectors. The first 50 literacy and numeracy specialists have already been placed,” said NSW minister Adrian Piccoli.

“Obviously any new idea will need to be consistent with Victoria's nation-leading commitment to early years literacy and numeracy,” said Victorian minister Martin Dixon. “It should also be noted that in Victoria's long experience, "blitzes" are never a substitute for long term implementation.”

In today's Sydney Morning Herald and Age


Related Posts

. It's happened before. The PM's rubbery figures

. If the Employment Minister and the Assistant Treasurer don't know what the employment forecasts are...