This chapter presents the change in maths education teaching and learning practices aimed at developing student content and procedural knowledge. The change within countries is presented as an increase or decrease in the share of students exposed to the practice. The percentage point change is also expressed as a standardised effect size in the final table.
Measuring Innovation in Education 2019
What Has Changed in the Classroom?
Educational Research and Innovation
Chapter 2. Innovation in practices to develop technical skills in mathematics
Abstract
The statistical data for Israel are supplied by and under the responsibility of the relevant Israeli authorities. The use of such data by the OECD is without prejudice to the status of the Golan Heights, East Jerusalem and Israeli settlements in the West Bank under the terms of international law.
1. Memorising rules, procedures and facts as a pedagogical technique in mathematics
Why it matters
Memorising facts, rules and procedures is part of all learning strategies. Often associated to “traditional” and relatively “teacher-centred” approaches to teaching and learning, memorisation should be seen as part of the mix of pedagogical practices that teachers should use. Good teachers will find the right dosage with other, more active learning practices. An increase of these practices is often related to the existence of high-stakes exams or assessments in education systems.
Primary education
Change at the OECD level: large
In primary education, this practice has mainly expanded in the OECD area. On average it has increased by 21 percentage points, with 43% of mathematics students being asked to memorise facts and procedures in at least half of their lessons in 2015 against 22% in 2007. The absolute change of also 21 percentage points, including both positive and negative changes, corresponds to a large effect size of 0.5. There are large disparities in the shares of students regularly asked to memorise for learning: from 22% in Germany in 2015, to almost 80% in Slovenia.
Countries where there has been the most change
Turkey is by far the country that has experienced the largest decrease in this pedagogical practice, with a decrease of over 33.5 percentage points between 2007 and 2015. In Slovenia the share of students concerned has increased by more than 50 percentage points. Lithuania, the Netherlands, England (United Kingdom) and Quebec (Canada) have also highly innovated in the use of this practice with increases by more than 30 percentage points.
Secondary education
Change at the OECD level: large
In secondary education, most OECD countries have experienced an expansion of this practice resulting in an average increase of 14 percentage points. The change, be it positive or negative, has amounted to 19 percentage points on average, corresponding to a large effect size of 0.4. In 8th grade mathematics, this practice is common across countries in spite of large variations. For instance, 32% of 8th grade students were asked to memorise rules, procedures and facts in at least half of their mathematics lessons in Ontario (Canada) in 2015, compared to 80% in Slovenia.
Countries where there has been the most change
Secondary education presents similar patterns as primary education. Turkey shows the largest decrease in this pedagogical practice with a contraction of over 29 percentage points between 2007 and 2015. Italy and Slovenia registered the largest increases, over 40 percentage points. The spread of this practice in Sweden, England, Australia and Indonesia was also remarkable.
Figure 2.1. 4th grade students memorising rules, procedures and facts in maths
Note: Darker tones correspond to statistically significant values.
* refers to calculations based on other years, based on data availability.
The OECD average is based on OECD countries with available data in 2007, 2011 and 2015.
Source: Authors' calculations based on TIMSS Databases.
Figure 2.2. 8th grade students memorising rules, procedures and facts in maths
Note: Darker tones correspond to statistically significant values.
* refers to calculations based on other years, based on data availability.
The OECD average is based on OECD countries with available data in 2007, 2011 and 2015.
Source: Authors' calculations based on TIMSS Databases.
2. Practising skills and procedures in computers in mathematics
Why it matters
Practice makes perfect. Part of the mastery of mathematics relies on implementing and practising the procedural knowledge one has acquired. While computers can now make complex calculations with perfect accuracy, part of this procedural knowledge allows students to understand how mathematicians think and assess how to deal with mathematical problems. This pedagogical practice needs to be supplemented by other pedagogical practices requiring more thinking from the student, but computers are a good medium for this kind of learning.
Primary education
Change at the OECD level: large
Across the OECD area, the share of students using computers regularly for practising skills and procedures during 4th grade mathematics lessons increased by 42 percentage points on average between 2007 and 2015. The average absolute change during this time period is also at 42 percentage points, corresponding to a very large effect size of 1. The extent to which students are exposed to this practice varies significantly across countries, from 5% in Japan to over 77% in the Netherlands in 2015.
Countries where there has been the most change
This practice has been a significant pedagogical innovation in New Zealand, where it expanded the most between 2007 and 2015 (74 percentage points), followed by Australia and the United States (over 60 percentage points). Korea, Chile, Belgium (Fl.) and Portugal have experienced declines above 12 percentage points in this practice, although these more modest negative changes were only measured between 2011 and 2015.
Secondary education
Change at the OECD level: large
The share of students frequently using computers for practising skills and procedures during 8th grade mathematics lessons has expanded by 23 percentage points on average. Only Chilean students experienced a contraction in this domain (between 2011 and 2015). The average change between 2007 and 2015 has been positive for all OECD countries, around 23 percentage points, corresponding to a very large effect size of 0.6. At the OECD level, the share of 8th grade students regularly using this learning strategy ranged from nearly 8% in Slovenia to over 57% in the United States in 2015.
Countries where there has been the most change
The share of students using this practice has increased by 44 percentage points in Australia and the United States between 2007 and 2015. Chile is the only country where it has contracted, by 15 percentage points between 2011 and 2015.
Figure 2.3. 4th grade students using computers to practice skills and procedures in maths
Note: Darker tones correspond to statistically significant values.
* refers to calculations based on other years, based on data availability.
The OECD average is based on OECD countries with available data in 2007, 2011 and 2015.
Source: Authors' calculations based on TIMSS Databases.
Figure 2.4. 8th grade students using computers to practice skills and procedures in maths
Note: Darker tones correspond to statistically significant values.
* refers to calculations based on other years, based on data availability.
The OECD average is based on OECD countries with available data in 2007, 2011 and 2015.
Source: Authors' calculations based on TIMSS Databases.
3. Using digital devices for practising and drilling such as for foreign language learning and mathematics
Why it matters
Computers and digital devices are well suited to support the acquisition of procedural knowledge through repetition and drilling. This is true in a variety of domains where computers represent very good tutors: mathematics, algorithmic, but also some aspects of foreign and domestic language acquisition. Computers also already support more or less complex forms of adaptive learning, for example by automatically adjusting the difficulty of the proposed tasks to the current level of mastery of the student.
Change at the OECD level: moderate
Students in most OECD countries have experienced an increase in the use of digital devices for practising and drilling. Between 2009 and 2015, the share of 15-year-old students using this learning practice at least once a month has increased by 12 percentage points on average. Only in Finland, Spain and Switzerland has it decreased, albeit to a lesser extent. Whether through expansion or contraction, change in the use of this practice was over 14 percentage points on average and represented a moderate effect size of 0.28. This pedagogical activity is frequent in most countries although levels strongly vary across the sample. For instance, in 2015, 10% of students in Japan used it at least once a month, against 74% in Denmark.
Countries where there has been the most change
Large expansions of this practice were experienced in Latvia, Denmark and Sweden, all three with increases above 30 percentage points. Finland recorded the largest decline in this domain, of about 16 percentage points.
Figure 2.5. 15 year old students using digital devices for practising and drilling
Note: Darker tones correspond to statistically significant values.
Source: Authors' calculations based on PISA Databases.
4. Solving problems without an immediately obvious method of solution
Why it matters
Many real life problems do not have an immediately obvious solution. Increasingly, most problems people will have to solve in their working life will be certain forms of complex problems: computers and robots will take care of simple problems – and actually some complex ones as well. The preparation to complex problem solving has thus become critical – and is also often more interesting to students.
Change at the OECD level: moderate-low
At the OECD level, the use of this practice increased on average by 4 percentage points between 2007 and 2015. With a modest effect size of 0.21, positive and negative changes led to an average absolute change of 9 percentage points. In 2015, this teaching and learning practice was not used in a systematic way in 8th grade mathematics lessons, concerning about 29% of the students on average.
Countries where there has been the most change
Chile recorded the largest decline in the use of this practice, by almost 30 percentage points (measured between 2011 and 2015). Following Chile, Quebec (Canada) and Turkey registered declines of 18 and 14 percentage points respectively. Positive changes are of a great magnitude in Hong Kong, Minnesota (United States), Australia and Italy, all of them recording increases above 15 percentage points.
Figure 2.6. 8th grade students solving problems without an immediately obvious method of solution in maths
Note: Darker tones correspond to statistically significant values.
* refers to calculations based on other years, based on data availability.
The OECD average is based on OECD countries with available data in 2007, 2011 and 2015.
Source: Authors' calculations based on TIMSS Databases.
5. Processing and analysing data on computers
Why it matters
Nowadays most of the computing and a lot of data processing in mathematics tend to be handled by computers. After all, they have a clear competitive advantage when it comes to computing power. While it does not have to fully replace other forms of data processing in maths, being able to use computers for those purposes has become an important technical skill in mathematics.
Change at the OECD level: large
The share of students regularly using computers for processing and analysing data in 8th grade mathematics lessons increased by 13 percentage points on average. The positive and negative variations together amounted to a total absolute change of 13 percentage points, corresponding to a large effect size of 0.44. In most countries, only a small share of students systematically participated in this pedagogical activity in 2015, ranging from 6% in Sweden to 35% in the United States.
Countries where there has been the most change
This pedagogical activity was a big innovation in the United States where the share of students using it increased by 31 percentage points between 2007 and 2015. In Australia and Ontario (Canada), the prevalence of this practice expanded by about 25 percentage points during the same period. By contrast, Chile registered the only significant decline in this domain, with a contraction by 12 percentage points between 2011 and 2015.
Figure 2.7. 8th grade students using computers to process and analyse data in math
Note: Darker tones correspond to statistically significant values.
* refers to calculations based on other years, based on data availability.
The OECD average is based on OECD countries with available data in 2007, 2011 and 2015.
Source: Authors' calculations based on TIMSS Databases.
Table 2.1. Effect sizes for changes in practices to develop technical skills in mathematics
Effect size from -0.5 to -0.2 and from 0.2 and 0.5
Effect size from -0.8 to -0.5 and from 0.5 and 0.8
Effect size equals or less than -0.8 and equals or greater than 0.8
Source: Authors' calculations based on TIMSS (2007, 2011 and 2015) and PISA (2006, 2009 and 2015).