SLS

PISA [return]
What is PISA?
It is the Programme for International Student Assessment run by the Organisation for Economic Co-operation and Development (OECD). 30 countries are members of the OECD and another 33 are partner countries.

What is its purpose?
The programme aims to measure how far students approaching the end of compulsory education have acquired some of the knowledge and skills essential for full participation in a knowledge society. The OECD’s Directorate for Education collects the data and provides comparative indicators of education systems in OECD member and partner countries.

How is it organised?
Each participating country is asked to identify a cross section of secondary schools and a random group of 35 15year old pupils is selected at those schools to take part in the tests. An 85% or more participation rate is required for the results to be considered valid. If any country is not able to reach that target, its results do not count.

At present, they are 2 hour paper and pencil tests held every three years measuring reading, mathematical and science literacy. Pupils also fill out a questionnaire about themselves while Head Teachers complete one about the school. The tests started in 2000 with the focus on Reading, then Maths and finally Science, so the 2009 tests will again focus on Reading. The 2006 tests covered countries which account for 90% of the world’s economy. The tests are developed by the Australian Council for Educational Research.

What are the key features?
Policy emphasis which lets governments compare and draw policy lessons.
The “literacy” concept where knowledge and skills are applied to solve and interpret problems. Relevance to lifelong learning.
Regular pattern encourages monitoring.

Future development of PISA
Several areas being investigated include:

Tracking student progress possibly comparing primary with later progress.
Making closer comparisons between performance and instruction.
Make use of computer-based assessment.
Optional parental questionnaire.
Focus on the pupil’s proficiency in applying knowledge to a wider context.
Other International Tests

TIMSS (Trends in International Mathematics and Science Study) – results often contradict PISA since they measure different aspects. TIMSS measure more traditional classroom content while PISA deals with application to real-life problems. PIRLS is a programme for reading and literacy study which focuses on the understanding of the text not the pupil’s ability to write well.

Issues
Are all countries applying the rules the same way – for example is the full spectrum of ability represented? Uptake in Scotland was the lowest in the UK last time and nearly resulted in results being declared invalid. What inducements can be given to help schools take part? Government policies are often influenced by the results. How can we put them into context? The last round of tests saw Scotland outperform the rest of the U.K. in Maths and Reading while being joint leaders in Science. In Science, for example, when you drill down below the headline figures, Scotland has fewer pupils down at both the bottom and the top points in the scale but above average in the middle. Once Socio-economic status is extracted there is no difference in the results of independent and state schools.
How much impact do recruitment problems have? Teacher turnover? Equipment shortages? Competition for places?

Since so much attention is paid by Governments to the PISA results and policies are changed accordingly, it is very important that School Leaders Scotland encourages participation so that the successes in our schools can be recognised and that the organisation ensures that Government policy is influenced correctly.

Posted on 11 August, 2008