In 2022, the Programme for International Student Assessment (PISA) assessed the creative thinking abilities of 15-year-old students. The test explores how well students can generate diverse and creative ideas, and how well they can evaluate and improve others’ ideas to reach creative outcomes. Tasks in the test are situated in four domain contexts: written expression, visual expression, social problem solving and scientific problem solving. Volume III of PISA 2022 Results gives insights into how well education systems are preparing students to think outside the box and to come up with creative ideas in a range of different contexts. By comparing results internationally, policymakers and educators in the Ukrainian regions (18 of 27) can learn from other countries’ policies and practices.
PISA Results 2022 (Volume III) - Factsheets: Ukrainian regions (18 of 27)
How well did 15-year-old students in the Ukrainian regions (18 of 27) do on the creative thinking test?
Creative thinking proficiency
Figure 1. PISA 2022 Creative Thinking performance
Notes: Comparison countries include the six highest-performing countries (overall and relatively), or the six countries with the smallest share of variance in creative thinking uniquely explained by mathematics performance, and five neighbouring or comparable countries. Horizontal lines that extend beyond the markers represent a measure of uncertainty associated with mean estimates (the 95% confidence interval).
Source: OECD, PISA 2022 Database, Tables III.B1.2.1, III.B1.2.4 and III.B1.2.3.
With a mean score of 27 out of 60 possible points, students in the Ukrainian regions (18 of 27) scored significantly lower than the OECD average in creative thinking (33).
Students’ relative results in creative thinking are below what could be expected from the Ukrainian regions (18 of 27) based on their performance in mathematics; and aligned with what could be expected based on their performance in reading.
In the Ukrainian regions (18 of 27), 33% of the variation in creative thinking performance can be uniquely attributed to variation in mathematics performance, which is above the OECD average. Within the Ukrainian regions (18 of 27), the correlation between students’ creative thinking and mathematic performance is 0.72, and 0.67 between creative thinking and reading performance (OECD averages: 0.67 and 0.66). For comparison, on average across OECD countries, the correlation between students’ mathematics and reading performance is 0.80.
What students can do in creative thinking
Figure 2. Top-performing and low-performing students in creative thinking
Note: Numbers inside the figure correspond to percentages.
Source: OECD, PISA 2022 Database, Table III.B1.2.2.
In the Ukrainian regions (18 of 27), 60% of students attained at least a baseline proficiency in creative thinking (Level 3), significantly less than on average across OECD countries (78%). At a minimum, these students can generate appropriate ideas for simple to moderately complex expressive and problem-solving tasks, and they also begin to demonstrate the ability to generate original ideas or solutions in familiar task contexts. In 21 countries and economies out of 64 tested, more than 1 in 2 students did not reach this baseline level of proficiency in creative thinking.
14% of students in the Ukrainian regions (18 of 27) are top performers in creative thinking, meaning that they attained Level 5 or 6 in the PISA Creative Thinking test (OECD average: 27%). In Australia*, Finland, New Zealand*, Canada* and Korea, around 4 in 10 students are top performers, and in Singapore, more than 1 in 2. At these proficiency levels, students can generate, evaluate and improve creative ideas in diverse and complex tasks, including abstract design tasks or more constrained/unfamiliar scientific and social problem scenarios. Only in 20 out of 64 countries and economies taking the PISA 2022 Creative Thinking test can more than 25% of students be considered top performers.
In the Ukrainian regions (18 of 27), just about 17% of top performers in creative thinking are also top performers in mathematics, and 7% are top performers in reading (OECD averages: 20% and 17%). This suggests that one can excel in creative thinking without excelling in academic domains (and vice-versa), though a baseline level of proficiency in one domain complements proficiency in the others (see Figure III.2.4 in the report).
How does the Ukrainian regions (18 of 27) compare across the ideation processes and domain contexts of the creative thinking test?
Figure 3. Relative success across the three ideation processes of the test
Notes: The relative success is the difference between the percentage of correct responses in one ideation process and average percent correct on all other tasks (full credit only). This difference accounts for the international difficulty of each task. Comparison countries include the six countries with the highest relative performance in each ideation process, and five neighbouring or comparable countries. Horizontal lines that extend beyond the markers represent a measure of uncertainty associated with mean estimates (the 95% confidence interval).
Source: OECD, PISA 2022 Database, Table III.B1.4.3.
The PISA 2022 Creative Thinking test explored students’ proficiency across three ideation processes: generating diverse ideas, generating creative ideas, and evaluating and improving ideas. In light of their overall performance in the test, and accounting for tasks’ respective difficulty, students in the Ukrainian regions (18 of 27) scored relatively higher in tasks that required evaluating and improving ideas than in others.
Across all participating countries and economies, students struggled relatively more with tasks that required generating diverse ideas, accounting for their respective difficulty.
Figure 4. Relative success across the four domain contexts of the test
Notes: The relative success is the difference between the percentage of correct responses in one domain context and average percent correct on all other tasks (full credit only). This difference accounts for the international difficulty of each task. Comparison countries include the six countries with the highest relative performance in each domain context, and five neighbouring or comparable countries. Horizontal lines that extend beyond the markers represent a measure of uncertainty associated with mean estimates (the 95% confidence interval).
Source: OECD, PISA 2022 Database, Table III.B1.4.4.
All 32 tasks in the test were also situated in four domain contexts: written expression, visual expression, social problem solving, and scientific problem solving. Relative to their performance in all other tasks, and accounting for their respective difficulty, students in the Ukrainian regions (18 of 27) showed higher proficiency in tasks that involved written expression, visual expression and scientific problem solving.
Across all participating countries and economies, and accounting for their respective difficulty, students struggled more with tasks that involved solving both social and scientific problems with creative ideas.
A special edition of PISA
This PISA test was originally due to be conducted in 2021 but was delayed by one year due to the COVID-19 pandemic. The exceptional circumstances throughout this period, including lockdowns and school closures in many countries, led to occasional difficulties in collecting some data. While the vast majority of countries and economies met PISA’s technical standards, a small number did not. A country or economy in this note with an asterisk (*) next to its name means that caution is required when interpreting estimates because one or more PISA sampling standards were not reached. Two asterisks (**) means that caution is required when comparing estimates with other countries/economies as a strong linkage to the international PISA creative thinking scale could not be established. Further information can be found in the Reader’s Guide and in Annexes A2 and A4 of the main report.
Performance gaps within the Ukrainian regions (18 of 27)
Socio-economic divides
Figure 5. Mean performance in creative thinking by national quartiles of socio-economic status
Notes: Vertical bars that extend beyond the markers represent a measure of uncertainty associated with each estimate (the 95% confidence interval). Horizontal, dashed lines represent the uncertainty associated with the mean score of the most advantaged group of students (the top quartiles) within the Ukrainian regions (18 of 27).
Source: OECD, PISA 2022 Database, Table III.B1.3.7.
In the Ukrainian regions (18 of 27), socio-economically advantaged students outperformed disadvantaged students in creative thinking by 11.1 score points, on a scale that counts 60 points. This is similar to the average difference between the two groups across OECD countries (9.5 score points).
Like student performance in the mathematics, reading and science assessments, socio-economic status was a strong predictor of performance in creative thinking in all PISA participating countries and economies. It explained 13% of the variation in creative thinking performance in the Ukrainian regions (18 of 27) (compared to 12% on average across OECD countries). However, in general, the association between socio-economic status and performance in creative thinking was weaker than the equivalent association with mathematics performance.
Some 10% of disadvantaged students in the Ukrainian regions (18 of 27) were able to score in the top quarter of creative thinking performance within the Ukrainian regions (18 of 27). These students can be considered resilient creative thinkers because, despite their socio-economic disadvantage, they have attained excellence in performance by comparison with students in their own country. On average across OECD countries, 13% of disadvantaged students scored in the top quarter of creative thinking performance in their own countries/economies.
Gender gap
On average, girls outperformed boys in creative thinking by 1.9 score points in the Ukrainian regions (18 of 27). This is on par with the average gender gap across OECD countries (2.7 score points). In no PISA participating country or economy did boys score above girls in creative thinking.
The gender gap disappears towards the top of the distribution between high-achieving girls and boys (i.e. those who score at or above the 75th percentile in the Ukrainian regions (18 of 27)).
The share of students attaining Level 5 or 6 in creative thinking (the top performers) in the Ukrainian regions (18 of 27) is larger among girls (14%) than among boys (13%) (OECD averages: 31% and 23%). At the other end, the share of students who do not reach the baseline Level 3 is larger among boys (44%) than among girls (35%) (OECD averages: 25% and 18%).
How do students perceive creativity in the Ukrainian regions (18 of 27)?
Figure 6. Beliefs, attitudes and social-emotional characteristics that positively relate to creative thinking
Note: Numbers inside the figure correspond to percentages.
Source: OECD, PISA 2022 Database, Tables III.B1.5.2, III.B1.5.4, III.B1.5.11, III.B1.5.19, III.B1.5.23, III.B1.5.29, and III.B1.5.33.
In the Ukrainian regions (18 of 27), 86% of students agreed or strongly agreed that it is possible to be creative in nearly any subject, compared to 82% on average across OECD countries. These students outscored those with a narrower view of creativity, by 5.8 points accounting for students’ and schools’ socio-economic characteristics. Yet, 53% of students in the Ukrainian regions (18 of 27) think that their creativity is something about them that they cannot change very much – a “fixed mindset” that is associated with a 0.9-point lower score on average across OECD countries, accounting for the same characteristics.
In general, students reported relatively high levels of imagination, openness to intellect, and creative self-efficacy. These are attitudes that relate positively to their creative thinking performance, on average across OECD countries. In the Ukrainian regions (18 of 27), 81% of students agreed or strongly agreed that doing something creative satisfies them, while only 30% said they have difficulty using their imagination. On average across OECD countries, those students scored respectively 2.9 score-points higher and 2.3 score-points lower than their peers, accounting for students’ and schools’ characteristics.
Some social-emotional characteristics, such as curiosity, perspective taking, and persistence, were also identified as distinctive markers of creative thinkers. In the Ukrainian regions (18 of 27), 56% of students like to know how things work, 58% want to understand why people behave the way they do, and 41% complete tasks even when they become more difficult than they thought. Those students performed significantly better on the creative thinking test than their peers with similar socio-economic characteristics.
In the Ukrainian regions (18 of 27), 70% of 15-year-old students expect to complete at least a higher education degree (ISCED 5 or higher; OECD average: 70%). On average across OECD countries, those students demonstrated a stronger creative thinking proficiency than their peers, even after accounting for their mathematics and reading performance and socio-economic characteristics. Furthermore, 6% of students in the Ukrainian regions (18 of 27) expect to work a job in the creative and cultural sectors at 30 years old – while 1% report having a parent working such a job. On average across OECD countries, accounting for gender and socio-economic characteristics, students aspiring to a career in the creative and cultural sectors scored significantly higher than their peers on the creative thinking test, by 1.1 points. For comparison, those who expect to work as managers or professionals outscored their peers by 0.7 points.
How conducive to creativity is the school environment in the Ukrainian regions (18 of 27)?
Pedagogies and activities encouraging creative thinking
Figure 7. Pedagogies conducive to creative thinking
Note: Numbers inside the figure correspond to percentages.
Source: OECD, PISA 2022 Database, Table III.B1.6.1.
In the Ukrainian regions (18 of 27), 69% of students reported that their teachers give them enough time to come up with creative solutions on assignments (OECD average: 63%). Across participating countries and economies, students who said their teachers value student creativity (81% in the Ukrainian regions (18 of 27)) are more likely to score well in the creative thinking test, especially on tasks that require evaluating and improving ideas, an ideation process that appears generally more easily amenable than generating diverse or creative ideas.
Students in the Ukrainian regions (18 of 27) also have access to art (55%), drama (20%), creative writing (14%) or computer programming (39%) classes/activities once a week or more at school, according to their school principals; they are attended by respectively 21%, 17%, 19% and 25% of students (OECD averages: 27%, 11%, 16%, and 17%).
Digital activities
Digitalisation is transforming the social environment of 15-year-old students, at school as well as outside of it. In the Ukrainian regions (18 of 27), 71% of students use digital tools for learning purposes for one hour a day or more at school, and 68% outside of school on a typical weekend day (OECD averages: 55% and 50%). In general, this type of use appears positively but modestly associated with students’ performance in creative thinking, up to a certain point – as is the case with their performance in mathematics.
Using digital tools for leisure purposes, however, plays out differently on students’ creative thinking performance. In the Ukrainian regions (18 of 27), 50% of students spend more than one hour a day on digital leisure activities while at school (OECD average: 35%). On average across OECD countries, this context and type of use relate negatively to students creative thinking performance. However, students in the Ukrainian regions (18 of 27) who spend more than one hour a day on digital tools for leisure outside of school, e.g. on a typical weekend day, scored 1.9 points higher than their peers, accounting for gender and students’ and schools’ socio-economic profiles. This represents 79% of students in the Ukrainian regions (18 of 27), and 80% on average across OECD countries.
Key features of the PISA 2022 Creative Thinking test
PISA in 2022
PISA 2022 was implemented in 81 countries and economies. Results for mathematics, reading and science were released on 5 December 2023, and reported in PISA 2022 Volumes I and II as well as in this factsheet for the Ukrainian regions (18 of 27).
For the first time in 2022, 64 countries and economies also implemented the PISA Creative Thinking cognitive test, including the Ukrainian regions (18 of 27). Ten more countries and economies implemented the creative thinking items in the background questionnaires.
The Creative Thinking test
PISA defines creative thinking as the ability to generate, evaluate and improve ideas to produce original and effective solutions, advance knowledge and create impactful expressions of imagination”.
The PISA 2022 Creative Thinking test consists of 32 tasks designed to measure three ideation processes: generating diverse ideas, generating creative ideas, and evaluating and improving ideas. It encompasses both divergent and convergent cognitive processes associated with “little‑c” creativity; in other words, it measures the types of creative thinking skills that 15-year-old students around the world can reasonably demonstrate in “everyday” contexts.
The test also aimed to measure different applications of creative thinking, given that the capacity to generate relevant and innovative ideas depends on knowledge and practice in specific domains. The tasks are thus situated in four domain contexts: written expression, visual expression, social problem solving, and scientific problem solving.
Every task being open-ended, they were essentially infinite ways of demonstrating creative thinking. Scoring for this assessment therefore relied on human judgement following detailed scoring rubrics and well-defined coding procedures. Find more details on the test’s items and coding procedures in Chapter 1, Annex A1, and Annex C of the PISA 2022 Results (Volume III); or have a go at some of the creative thinking tasks here.
Students, teachers, school principals and parents also answered questions on their beliefs, attitudes and practices related to creativity and creative thinking, as part of the PISA background questionnaires.
The students
Some 690 000 students took the assessment in 2022, representing about 29 million 15-year-olds in the schools of the 81 participating countries and economies.
In the Ukrainian regions (18 of 27), 3876 students, in 164 schools, completed the assessment in mathematics, reading or science, representing about 165 600 15-year-old students.
References
OECD (2023), “PISA 2022 Creative Thinking Framework”, in PISA 2022 Assessment and Analytical Framework, OECD Publishing, Paris, https://doi.org/10.1787/471ae22e-en
OECD (2023), PISA 2022 Results (Volume I): The State of Learning and Equity in Education, PISA, OECD Publishing, Paris, https://doi.org/10.1787/53f23881-en
OECD (2023), PISA 2022 Results (Volume II): Learning During – and From – Disruption, PISA, OECD Publishing, Paris, https://doi.org/10.1787/a97db61c-en
OECD (2024), PISA 2022 Results (Volume III): Creative Minds, Creatives Schools, PISA, OECD Publishing, Paris, https://doi.org/10.1787/765ee8c2-en
OECD (2024), PISA 2022 Technical Report, PISA, OECD Publishing, Paris, https://doi.org/10.1787/01820d6d-en
For more information about PISA 2022 visit www.oecd.org/pisa
Explore, compare and visualise more data and analysis using http://gpseducation.oecd.org.
Questions can be directed to the PISA team at the Directorate for Education and Skills: edu.pisa@oecd.org.
This work is available under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 IGO (CC BY-NC-SA 3.0 IGO). For specific information regarding the scope and terms of the licence as well as possible commercial use of this work or the use of PISA data please consult Terms and Conditions on www.oecd.org.
This work is published under the responsibility of the Secretary-General of the OECD. The opinions expressed and arguments employed herein do not necessarily reflect the official views of the Member countries of the OECD.
This document, as well as any data and map included herein, are without prejudice to the status of or sovereignty over any territory, to the delimitation of international frontiers and boundaries and to the name of any territory, city or area.
The statistical data for Israel are supplied by and under the responsibility of the relevant Israeli authorities. The use of such data by the OECD is without prejudice to the status of the Golan Heights, East Jerusalem and Israeli settlements in the West Bank under the terms of international law.
Note by the Republic of Türkiye
The information in this document with reference to “Cyprus” relates to the southern part of the Island. There is no single authority representing both Turkish and Greek Cypriot people on the Island. Türkiye recognises the Turkish Republic of Northern Cyprus (TRNC). Until a lasting and equitable solution is found within the context of the United Nations, Türkiye shall preserve its position concerning the “Cyprus issue”.
Note by all the European Union Member States of the OECD and the European Union
The Republic of Cyprus is recognised by all members of the United Nations with the exception of Türkiye. The information in this document relates to the area under the effective control of the Government of the Republic of Cyprus.
Kosovo*: This designation is without prejudice to positions on status, and is in line with United Nations Security Council Resolution 1244/99 and the Advisory Opinion of the International Court of Justice on Kosovo’s declaration of independence.