TIMSS8 Science ConceptsItems PDF

8
SCIENCE CONCEPTS
&
SCIENCE ITEMS
The Science Concepts and Science Items book contains the released TIMSS science assessment items.
These are the released items from the 1995 and 2003 assessments (as distinct from the secure items,
which are kept confidential so that they may be used in subsequent cycles to monitor trends).
Guide to Using the Science Concepts and Science Items Materials

The materials contained in this book can be used in a number of ways as a tool to assist teachers
in making a formative assessment of student knowledge and skills. Some of these ways include
the following:
Teacher-designed formative assessments. A teacher might, for example, decide to

examine how well his or her class can understand complex information. In such a case, the first
step would be to review the questions in Science Concepts and Science Items, selecting the ones
of interest. Ready-to-use versions of these items can be found in the Science Items book. The
teacher can print these items or present them to students on an overhead. Student responses can
be scored by referring to the appropriate page in Science Concepts and Science Items. The teacher
can also compare the overall percentage of students responding correctly to the international
benchmark for that item.
Feedback on teaching.To the extent that the items coincide with concepts taught, the teacher
might follow the same process to gain rapid feedback on the success of the teaching episode.
Understanding misunderstandings. Again, a teacher might decide to examine the incorrect

or partially correct responses of the class for insight into any general misunderstandings, with a
view to re-teaching a particular topic or skill.
Identifying individual difficulties. In the same way, the teacher might use the items to
identify particular difficulties experienced by individual students, as the basis for some remedial
teaching or focused practice.
18680.0206
5
Guide to the Content and Layout of This Book
This book contains the released items from both TIMSS 1995 and TIMSS 2003. Due to slight revisions in terminology
and released information between cycles, the format for the items in each cycle differs slightly. Each item appears on
a single page and is accompanied by a number of descriptors.
1999 Content Domains:

• Earth science
• Life science
• Physics
• Chemistry
• Environmental and resource issues
• Scientific enquiry and the nature of science
2003 Content Domains:
• Chemistry
• Earth science
• Environmental science
• Life science
• Physics
1999 Cognitive Domains:
• Understanding simple information
• Understanding complex information
• Theorizing, analyzing and solving problems
• Using tools, routine procedures and science processes
• Investigating the natural world
2003 Cognitive Domains:
• Factual knowledge
• Conceptual understanding
• Reasoning and analysis
Take a look at Layers of Earth, the name given to the first item in this book. As specified in boxes at the top of the page,
the content domain for this item is earth science and the cognitive domain is understanding simple information. Looking
at Litmus test, the first item from TIMSS 2003 (page 75), the content domain (chemistry) and the cognitive domain
(conceptual understanding) are also accompanied by the Main Topic (acids and bases).
International item numbers identify each item. This number appears just below the item box.
Correct answers are shown beneath each item. These correct answers take two forms:
• Letter code. This form is used for the correct response on multiple-choice items. Layers of Earth provides an
example of the letter code type—the correct answer is C.
• Scoring guide. This form is used to assist in scoring write-in responses. Life on other planets (J09) further along
in the Earth Science domain (page 11), provides an example of the scoring guide approach, indicating the general
nature of correct and incorrect responses. In some cases, partial credit may be awarded and these items will
provide guidelines for fully correct, partially correct, and incorrect responses.
Sample student responses are provided for TIMSS 2003 extended response items. An example of an actual U.S.
fourth-grade student’s response is provided for each scoring category. See item S032057 on page 76.
International benchmarks are provided in a table next to each item.These consist of statistics on the percentage of
students in each country who answered the question correctly. The countries are ordered in terms of this percentage.
The international average is included as well, and this display also indicates which countries scored significantly higher,
significantly lower, and not significantly different from this international average.
TIMSS 1999 8th-Grade Science Concepts and Science Items
Content Domain Cognitive Domain
Understanding Simple
Earth Science
Information
Layers of Earth Overall Percent Correct
Slovenia 96
Slovak Republic 95
Canada 94
Bulgaria 94
Netherlands 93
Finland 93
England 93
United States 92
Hungary 92
Italy 91
Czech Republic 91
Russian Federation 90
Australia 90
New Zealand 89
Japan 89
Belgium (Flemish) 89
Hong Kong, SAR 88
Korea, Rep. of 85
Chinese Taipei 84 O
Singapore 84 O
Lithuania 83 O
Latvia (LSS) 83 O
International Average 82
Israel 80 O
Moldova 79 O
Jordan 79
Malaysia 78
Macedonia, Rep. of 77
Cyprus 77
Turkey 75
Chile 74
Iran, Islamic Rep. 72
Thailand 72
Romania 70
Philippines 67
Tunisia 67
Indonesia 64
Item Number: B01 South Africa 61
Morocco 54
Country average vs.

International average:
Higher
Not different O
Lower
Correct Response: C
3
Using Tools, Routine Procedures

Earth Science
and Science Processes
Elevation diagram of wind/temperature Overall Percent Correct
Hungary 69
Slovak Republic 65
Slovenia 62
Netherlands 62
Israel 59
Latvia (LSS) 59
Canada 57
Finland 56
Bulgaria 55
Lithuania 55
Korea, Rep. of 55
Czech Republic 55
New Zealand 54
Japan 54
Belgium (Flemish) 50 O
Australia 49 O
United States 49 O
Russian Federation 49 O
Turkey 47 O
Jordan 47 O
England 44 O
Romania 44 O
Chinese Taipei 44 O
Macedonia, Rep. of 44 O
Moldova 44 O
Cyprus 43 O
Hong Kong, SAR 42
Philippines 41
Chile 41
Italy 38
Morocco 37
Malaysia 37
Thailand 34
South Africa 32
Singapore 30
Item Number: B05 Indonesia 30
Tunisia 25
Country average vs.

Higher
Not different O
Lower
Correct Response: A
4

Earth Science
Contour map showing river Overall Percent Correct
Chinese Taipei 61
Hong Kong, SAR 61
Slovenia 59
Australia 53
Japan 52
Malaysia 51
England 51
Korea, Rep. of 50
Netherlands 49
Finland 48
United States 48
Canada 46
Singapore 44 O
Hungary 44
Slovak Republic 43 O
Bulgaria 41 O
New Zealand 41 O
Czech Republic 40 O
Lithuania 38 O
Latvia (LSS) 37 O
Moldova 32 O
Thailand 26
Turkey 26
Romania 26
Israel 25
Italy 21
Cyprus 21
South Africa 21
Jordan 19
Indonesia 18
Morocco 17
Philippines 16
Item Number: D03 Tunisia 16
Chile 14
Country average vs.

Higher
Not different O
Lower
Correct Response: B
5
Understanding Complex
Earth Science
Information
Oxygen equipment on mountain tops Overall Percent Correct
Singapore 95
Why do mountain climbers use oxygen equipment at the top
Hong Kong, SAR 94
of the world's highest mountains? Chinese Taipei 94
Korea, Rep. of 93
A. There is less oxygen in the air at great heights. Czech Republic 92
Canada 92
Netherlands 91
B. There is little nitrogen in the air at great heights. Slovak Republic 91
Bulgaria 91
C. There is a hole in the ozone layer. Malaysia 90
United States 90
England 90
D. There is no air at the top of very high mountains. Hungary 90
Australia 90
Finland 90
New Zealand 87
Slovenia 87
Israel 80 O
Lithuania 80 O
Iran, Islamic Rep. 79 O
Italy 78 O
Thailand 76 O
Chile 75 O
Japan 74
Cyprus 70
Romania 70
Latvia (LSS) 69
Indonesia 67
Turkey 65
Moldova 64
Jordan 63
Tunisia 56
Philippines 48
Item Number: F05 South Africa 44
Morocco 39
Country average vs.

Higher
Not different O
Lower
Correct Response: A
6
Earth Science
Information
Why moon shines Overall Percent Correct
Hong Kong, SAR 96

The Moon produces no light, and yet it shines at night. Why
Singapore 95
is this? Chinese Taipei 95
Bulgaria 93
A. The Moon reflects the light from the Sun. Netherlands 91
Japan 89
England 88
B. The Moon rotates at very high speed. Malaysia 87
Canada 87
C. The Moon is covered with a thin layer of ice. Belgium (Flemish) 86
United States 86
Finland 86
D. The Moon has many craters. Hungary 86
Czech Republic 86
New Zealand 84 O
Cyprus 84 O
Turkey 84 O
Australia 83 O
Latvia (LSS) 83 O
Jordan 83 O
Korea, Rep. of 80 O
Slovenia 79 O
Thailand 78 O
Romania 78 O
Indonesia 76
Italy 75
Moldova 75
Philippines 73
Israel 72
Lithuania 72
Tunisia 71
Morocco 64
Item Number: H03 Chile 64
South Africa 57
Country average vs.

Higher
Not different O
Lower
Correct Response: A
7
Earth Science
Information
Diagram of soil layers Overall Percent Correct
Slovenia 75
Czech Republic 71
Lithuania 67
Romania 63
Hungary 60
Latvia (LSS) 59
Slovak Republic 57
Italy 53 O
Netherlands 53 O
Korea, Rep. of 53
Moldova 51 O
Australia 50 O
Japan 50 O
Canada 50 O
Bulgaria 50 O
Thailand 49 O
England 48 O
Finland 48 O
Cyprus 47 O
Chile 47 O
New Zealand 46 O
Philippines 44 O
Singapore 43 O
Tunisia 42
Indonesia 41
United States 40
Morocco 36
South Africa 35
Jordan 32
Turkey 29
Chinese Taipei 28
Israel 28
Item Number: H04 Malaysia 22
Hong Kong, SAR 15
Country average vs.

Higher
Not different O
Lower
Correct Response: A
8
Earth Science
Information
Earth's plates over millions of years Overall Percent Correct
Hungary 93
Which BEST describes the movement of the plates that
Canada 91
make up Earth's surface over millions of years? Australia 89
Slovak Republic 89
A. They moved for millions of years but have now stopped. Singapore 89
Chinese Taipei 87
Czech Republic 87
B. They stayed the same for millions of years but are now England 86
moving. Hong Kong, SAR 85
United States 84
Korea, Rep. of 83
C. They have been continually moving. Slovenia 82
Finland 82 O
D. They have never moved. Netherlands 81 O
New Zealand 81 O
Bulgaria 81 O
Latvia (LSS) 80 O
Lithuania 80 O
Moldova 80 O
Japan 79
Italy 77 O
Romania 75 O
Thailand 75 O
Chile 73 O
Israel 73 O
Malaysia 68
Cyprus 68 O
Turkey 65
Indonesia 60
Jordan 56
Philippines 55
Tunisia 52
Item Number: J01 South Africa 32
Morocco 29
Country average vs.

Higher
Not different O
Lower
Correct Response: C
9
Earth Science
Information
Factor explaining seasons on Earth Overall Percent Correct
Japan 52
Which of the following is an important factor in explaining
Hong Kong, SAR 48
why seasons occur on Earth? England 44
Italy 44
A. Earth rotates on its axis. Australia 41
Chinese Taipei 40
Canada 38
B. The Sun rotates on its axis. New Zealand 38
United States 37
C. Earth's axis is tilted. Finland 34 O
Bulgaria 34 O
Korea, Rep. of 30 O
D. The Sun's axis is tilted. Slovak Republic 30 O
Slovenia 29 O
Czech Republic 28 O
Israel 28 O
Netherlands 27 O
Lithuania 26 O
Malaysia 25 O
Cyprus 24 O
Hungary 23 O
Moldova 22 O
Thailand 21 O
Turkey 18
Singapore 18
Morocco 18
Jordan 17
Romania 17
South Africa 15
Chile 15
Latvia (LSS) 13
Tunisia 13
Philippines 13
Item Number: J06 Macedonia, Rep. of 12
Indonesia 7
Country average vs.

Higher
Not different O
Lower
Correct Response: C
10
Theorizing, Analyzing
Earth Science
and Solving Problems
Life on other planets Overall Percent Correct
Slovak Republic 89
Singapore 86
Australia 83
Hungary 83
Canada 82
England 82
Netherlands 81
Latvia (LSS) 80
New Zealand 80
Finland 80
Chinese Taipei 79
Slovenia 78
United States 78
Korea, Rep. of 77
Czech Republic 75 O
Italy 70 O
Hong Kong, SAR 70 O
Japan 69 O
Lithuania 67 O
Malaysia 67 O
Bulgaria 65 O
Tunisia 64 O
Thailand 62 O
Israel 62 O
Jordan 59 O
Indonesia 59 O
Item Number: J09 Macedonia, Rep. of 58 O
Chile 57
SCORING Cyprus 51
Note: A correct response must clearly indicate the reason why a condition listed in the table Moldova 51
makes it hard for humans to live on Proto. Responses referencing insufficient (too little, Romania 48
less, not enough, etc.) oxygen with or without explicitly mentioning breathing will be given Turkey 47
credit due to the assumption of common knowledge. If more than one reason is given,
assign credit corresponding to the first correct reason.
Philippines 26
Correct Response Morocco 25
South Africa 21
• States that there would be insufficient (too little, less, not enough, etc.) oxygen (to breath).
• States that the atmospheric pressure would be too low with an explanation based on low Country average vs.
air/oxygen levels or effects of lower boiling point, etc. International average:
• States that there is no ozone layer to protect people (against star’s UV radiation). Higher
Not different O
• States that no cloud cover means no (low) water.
Lower
• States that it is too cold (due to distance from the star).
• Other correct.
Incorrect Response
• Merely repeats information in table and/or stem with no explanation.
• States that it is too hot due to no ozone layer.
• States that there is little (no) gravity (confuses atmospheric pressure with gravity).
• Other incorrect (including crossed out/erased, stray marks, illegible, or off task).
11
Earth Science
Information
Atmospheric conditions in jets Overall Percent Correct
Slovak Republic 65
Jet aircraft typically fly at altitudes of approximately 10,000
Chinese Taipei 55
meters. Atmospheric conditions at this altitude are different Belgium (Flemish) 51
from those at ground level. Write down one difference that Canada 50
exists and explain why it must be controlled for in order for Australia 49
people to survive inside jet aircraft. Thailand 47
Singapore 46
Korea, Rep. of 45
Lithuania 45
New Zealand 45
England 44
Finland 42 O
Bulgaria 40 O
Latvia (LSS) 38 O
Slovenia 38 O
Hong Kong, SAR 35 O
Indonesia 35 O
Italy 34 O
Hungary 33 O
Israel 32 O
Moldova 31 O
Czech Republic 29 O
Japan 28 O
Romania 27 O
Turkey 25
Netherlands 24 O
Malaysia 23
Cyprus 21
Item Number: R04
Tunisia 17
SCORING United States 17
Jordan 17
Note: A correct response must include an explanation identifying an atmospheric condition
Chile 10
that is different at high altitudes and why it must be controlled for. Responses referencing
low oxygen level (too little, less, not enough) with or without explicitly mentioning breathing Philippines 6
will be given credit due to the assumption of prior knowledge. South Africa 5
Morocco 2
Correct Response
• Refers to controlling for low oxygen level and/or little air (“thin atmosphere”) in order to Country average vs.
breath. International average:
• Refers to controlling for low atmospheric pressure with explanation relating to the effect on Higher
humans. Not different O
Lower
• Refers to controlling for low atmospheric temperature.
• Other correct.
Incorrect Response
• Mentions pressure, temperature or oxygen with incorrect or no further explanation.
• Mentions gravity.
• Refers only to effects of wind, air currents, or turbulence, etc.
12
Earth Science
Diagram of rain from sea Overall Percent Correct
Draw a diagram to show how water from the sea can fall as
Singapore 76
rain on land. England 74
Hungary 67
Malaysia 66
Australia 66
Netherlands 65
New Zealand 60
Canada 58
Slovenia 56
Japan 54
Finland 52
Czech Republic 47 O
Korea, Rep. of 43 O
Chinese Taipei 43 O
Italy 42 O
Thailand 41 O
Jordan 41 O
Item Number: Z02 Latvia (LSS) 41 O
SCORING Cyprus 35 O
Note: A fully correct response must show clear evidence of the following 4 steps: Slovak Republic 35 O
Chile 27
(i) Evaporation of water from the sea Romania 26
(ii) Condensation (as clouds) Macedonia, Rep. of 26
(iii) Transportation (from sea to land) Tunisia 25
(iv) Precipitation.
Turkey 25
The steps do not have to be indicated on a labeled diagram for full credit, but the drawing Lithuania 20
and/or accompanying explanatory text must be clear with respect to the direction of water Philippines 19
flow. Steps (ii) and (iii) may be clearly indicated as two steps (e.g. formation of clouds and Indonesia 17
transportation by wind) or as a single step showing a series of clouds extending over land Moldova 14
and sea.
Israel 14
Correct Response United States 13
South Africa 11
•Response includes a diagram indicating all 4 steps (i, ii, iii and iv above) and direction of Bulgaria 11
water flow. Iran, Islamic Rep. 10
•No diagram is shown, but response includes a complete and correct textual description of the Morocco 5
water cycle.
•Other fully correct.
Country average vs.
Partial Response International average:
• As in correct response but evaporation is unclear or omitted. Higher
Not different O
• As in correct response but condensation is unclear or omitted.
Lower
• As in correct response but transportation is unclear or omitted.
• As in correct response but precipitation is unclear or omitted.
• Other partially correct.
Incorrect Response
• Response clearly indicates evaporation and/or condensation only.
• Response clearly indicates precipitation only (may also show clouds).
13
Life Science
Information
Pulse/breathing rate after exercise Overall Percent Correct
Japan 98
Immediately before and after running a 50 meter race, your
Hungary 97
pulse and breathing rates are taken. What changes would you Singapore 96
expect to find? Netherlands 95
England 95
A. no change in pulse but a decrease in breathing rate
Slovenia 95
Korea, Rep. of 95
B. an increase in pulse but no change in breathing rate Lithuania 95
Canada 94
Chinese Taipei 94
C. an increase in pulse and breathing rate Finland 94
Czech Republic 94
D. a decrease in pulse and breathing rate Australia 94
Hong Kong, SAR 93
Tunisia 92
E. no change in either Slovak Republic 92
Bulgaria 92
Latvia (LSS) 92
United States 91
New Zealand 90
Malaysia 89 O
Italy 89 O
Cyprus 88 O
Thailand 87 O
Israel 86 O
Moldova 85 O
Romania 84 O
Chile 83
Indonesia 83
Jordan 83
Turkey 79
Philippines 59
Item Number: B04 Morocco 58
South Africa 36
Country average vs.

Higher
Not different O
Lower
Correct Response: C
14
Life Science
Information
Sensory messages to the brain Overall Percent Correct
Czech Republic 89
Sensory messages are taken to the brain by
Netherlands 83
Bulgaria 82
A. arteries and veins Thailand 82
Latvia (LSS) 82
Korea, Rep. of 80
B. arteries and hormones Lithuania 80
C. nerves and hormones Slovenia 78
Slovak Republic 78
D. muscles and veins Hungary 78
Tunisia 76
Japan 75
England 74
Chinese Taipei 72 O
Moldova 72 O
Finland 71 O
Australia 71 O
United States 71 O
Israel 70 O
Singapore 68 O
Canada 68 O
Hong Kong, SAR 67 O
Indonesia 66 O
Italy 64 O
Jordan 64 O
Romania 64 O
New Zealand 61
Malaysia 60
Cyprus 53
Turkey 53
Philippines 45
Morocco 42
Item Number: D05 South Africa 36
Chile 35
Country average vs.

Higher
Not different O
Lower
Correct Response: C
15
Life Science
Information
Seed development from plant part Overall Percent Correct
Czech Republic 94
Seeds develop from which part of a plant?
Slovak Republic 93
Latvia (LSS) 92
A. Flower Lithuania 89
Hungary 87
B. Leaf Romania 85
Slovenia 84
C. Root Japan 83
Moldova 82
Italy 82
D. Stem Singapore 82
Finland 82
Indonesia 80
Bulgaria 78
Korea, Rep. of 77
Netherlands 72 O
Hong Kong, SAR 69 O
Thailand 69 O
Australia 68 O
Malaysia 67 O
Jordan 67 O
New Zealand 65
Tunisia 65
England 63
Chinese Taipei 63
Canada 61
Chile 57
Cyprus 57
United States 57
Turkey 56
Israel 52
Philippines 39
Item Number: D06 South Africa 36
Morocco 34
Country average vs.

Higher
Not different O
Lower
Correct Response: A
16
Life Science
Information
Characteristic of mammal Overall Percent Correct
Slovenia 89
A small animal called the duckbilled platypus lives in
Japan 86
Australia. Which characteristic of this animal shows that it Bulgaria 85
is a mammal? Iran, Islamic Rep. 84
Hong Kong, SAR 83
Slovak Republic 81
A. It eats other animals.
Chinese Taipei 80
Latvia (LSS) 80
B. It feeds its young milk. Cyprus 80
Czech Republic 79
Malaysia 78
C. It makes a nest and lays eggs. Hungary 78
Korea, Rep. of 77
D. It has webbed feet. Singapore 77
Romania 73 O
Thailand 71 O
Finland 71 O
Lithuania 70 O
Italy 70 O
Chile 68 O
Moldova 68 O
Tunisia 67 O
Canada 66
Turkey 65
United States 65
Indonesia 64
Jordan 63
Australia 63
Netherlands 62
Israel 60
New Zealand 54
England 52
South Africa 46
Item Number: F01 Morocco 45
Philippines 30
Country average vs.

Higher
Not different O
Lower
Correct Response: B
17
Life Science
Information
Interpretation of senses Overall Percent Correct
Bulgaria 91
Humans interpret seeing, hearing, tasting and smelling in the
Hong Kong, SAR 91
Singapore 86
A. brain Malaysia 85
United States 85
Netherlands 83
B. spinal cord Russian Federation 82
England 81
C. receptors New Zealand 81
Canada 81
Chinese Taipei 80
D. skin Moldova 78
Turkey 78
Hungary 76
Australia 72
Finland 69 O
Lithuania 67 O
Czech Republic 67 O
Chile 65 O
Latvia (LSS) 65 O
Romania 63 O
Indonesia 61 O
Israel 60
Philippines 58
Jordan 58
Korea, Rep. of 55
Japan 54
Italy 44
Slovenia 43
Morocco 43
South Africa 32
Thailand 30
Tunisia 24
Item Number: F03
Country average vs.

Higher
Not different O
Lower
Correct Response: A
18
Life Science
Information
NOT a function of blood Overall Percent Correct
Thailand 90
Which of these is NOT a function of the blood?
Chinese Taipei 88
Czech Republic 88
A. Digesting food Hungary 85
Japan 84
United States 83
B. Protecting against disease Canada 81
England 81
C. Carrying waste materials away from the cells Slovak Republic 81
Finland 80
Australia 80
D. Carrying oxygen to different parts of the body Bulgaria 79
Netherlands 79
Korea, Rep. of 77
Italy 77
Hong Kong, SAR 76
Singapore 74 O
Slovenia 73 O
New Zealand 72 O
Lithuania 69 O
Chile 69 O
Romania 66 O
Israel 64
Jordan 63
Latvia (LSS) 58
Malaysia 57
Moldova 56
Indonesia 53
Turkey 51
Philippines 50
Tunisia 44
Morocco 43
Item Number: H01 South Africa 35
Country average vs.

Higher
Not different O
Lower
Correct Response: A
19
Life Science
Information
Role of vitamins Overall Percent Correct
Latvia (LSS) 95
What are vitamins?
Hungary 95
A. Substances that break down food Netherlands 93
Korea, Rep. of 92
Slovenia 90
B. Bacteria that people get when they eat some foods Slovak Republic 89
Finland 88
C. Substances that people make from protein Bulgaria 87
Malaysia 86
D. Substances that people need in small amounts in order Lithuania 86
for their bodies to function normally Czech Republic 84
Indonesia 84
England 83
Italy 83
Australia 83
Canada 82 O
Singapore 80 O
Thailand 79 O
Chile 79 O
United States 78 O
New Zealand 76 O
Israel 75 O
Romania 74 O
Jordan 73
Moldova 71
Chinese Taipei 71
Turkey 69
Hong Kong, SAR 69
Cyprus 68
Philippines 68
Japan 65
Morocco 59
Item Number: H02 Tunisia 54
South Africa 35
Country average vs.

Higher
Not different O
Lower
Correct Response: D
20
Life Science
Information
Feature shared by all insects Overall Percent Correct
Canada 81
What feature is shared by ALL insects?
United States 78
England 78
A. External skeleton New Zealand 76
Netherlands 75
Australia 74
B. Two pairs of wings Japan 72
Hungary 66
C. Jumping legs Singapore 62
Turkey 58
Latvia (LSS) 58 O
D. Stinging mechanism Chinese Taipei 57
Finland 55 O
Korea, Rep. of 54 O
Italy 53 O
Hong Kong, SAR 51 O
Israel 50 O
Slovenia 49 O
Bulgaria 45 O
Malaysia 45 O
Czech Republic 43 O
South Africa 41
Indonesia 39
Romania 37
Cyprus 36
Thailand 36
Moldova 36
Lithuania 32
Philippines 32
Chile 32
Jordan 29
Slovak Republic 29
Item Number: J02 Tunisia 19
Morocco 18
Country average vs.

Higher
Not different O
Lower
Correct Response: A
21
Life Science
Information
Reason for protein in diet Overall Percent Correct
Chinese Taipei 62
The BEST reason for including protein in a healthy diet is
Finland 61
because it is the main source of Malaysia 60
A. energy for the body Hong Kong, SAR 53
Slovenia 53
Thailand 50
B. fiber for digestion Indonesia 49
Czech Republic 47
C. raw materials for cell growth and repair Singapore 45
Hungary 44
Slovak Republic 42
D. vitamins for fighting disease Korea, Rep. of 41
Italy 36 O
Cyprus 34 O
England 33 O
Latvia (LSS) 29 O
Japan 29 O
Australia 27 O
Jordan 27 O
Bulgaria 26 O
Israel 24
Chile 24
Morocco 23
Lithuania 22
Tunisia 22
Netherlands 22
Canada 22
New Zealand 21
Moldova 20
United States 20
Turkey 20
Romania 16
Philippines 16
Item Number: J07 Macedonia, Rep. of 11
South Africa 11
Country average vs.

Higher
Not different O
Lower
Correct Response: C
22
Life Science
Information
Large leaves on seedlings Overall Percent Correct
Thailand 92
What is the primary function of the large leaves found on
Japan 89
seedlings growing in a forest? Korea, Rep. of 88
Slovenia 84
A. To provide shade for the root systems Hong Kong, SAR 83
Finland 82
Italy 82
B. To get rid of excess water that is entering through the roots Singapore 81
Hungary 80
C. To allow for leaf damage by insects Slovak Republic 80 O
Lithuania 79 O
England 79 O
D. To gather as much light as possible for photosynthesis Russian Federation 79
Malaysia 78
Czech Republic 77 O
Turkey 73 O
Canada 73 O
Romania 73 O
Bulgaria 73 O
Cyprus 73 O
Chinese Taipei 71 O
Netherlands 70 O
Chile 69 O
Jordan 68 O
Australia 68 O
Israel 66 O
Latvia (LSS) 65 O
Tunisia 65
United States 63
Moldova 63
New Zealand 62
Indonesia 62
Philippines 55
Item Number: L02 Morocco 42
South Africa 38
Country average vs.

Higher
Not different O
Lower
Correct Response: D
23
Life Science
Information
Physical characteristic of prey Overall Percent Correct
Which one of the following characteristics is most likely to
Japan 61
be found in mammals that are preyed on by other mammals Korea, Rep. of 55
for food? England 54
New Zealand 50
Netherlands 50
A. Eyes on the sides of the head
Finland 48
Malaysia 46
B. Teeth that are long and pointed Chinese Taipei 46
Australia 45
United States 43 O
C. Claws on the feet Canada 42 O
Slovenia 40 O
D. Ears that cannot move Czech Republic 40 O
Lithuania 37 O
Italy 37 O
Bulgaria 35 O
Moldova 35 O
Singapore 34 O
Hong Kong, SAR 34 O
Jordan 34 O
Cyprus 33 O
Turkey 32 O
Indonesia 29
Romania 29 O
South Africa 28
Israel 27
Chile 25
Tunisia 24
Thailand 23
Hungary 22
Philippines 22
Item Number: L03 Morocco 16
Country average vs.

Higher
Not different O
Lower
Correct Response: A
24
Life Science
Information
Wolves marking territory Overall Percent Correct
Finland 92
When male wolves place their scent on trees, they most
Korea, Rep. of 91
likely are doing this in order to Canada 89
Latvia (LSS) 86
A. attract female wolves Australia 84
Japan 83
B. attract prey Belgium (Flemish) 81
Netherlands 80
C. mark their territory against other wolves New Zealand 80
Hungary 79
United States 78
D. mark the location of food supplies England 75
Czech Republic 74
Lithuania 72
Slovak Republic 71
Bulgaria 71
Italy 70
Chile 66
Thailand 65 O
Slovenia 63 O
Hong Kong, SAR 54 O
Chinese Taipei 50
Malaysia 46
Romania 45
Israel 44
Singapore 44
Moldova 44
Indonesia 33
Jordan 33
Turkey 32
Philippines 31
Cyprus 27
South Africa 26
Item Number: L05 Tunisia 19
Morocco 19
Country average vs.

Higher
Not different O
Lower
Correct Response: C
25
Life Science
Information
Complete food web Overall Percent Correct
Chinese Taipei 89
Singapore 89
Korea, Rep. of 85
Malaysia 84
England 75
Bulgaria 70
Hungary 70
Japan 68
Indonesia 66
Romania 65 O
Hong Kong, SAR 64
Canada 63 O
Czech Republic 60 O
Australia 60 O
Netherlands 58 O
Thailand 58 O
Finland 57 O
Moldova 56 O
United States 56 O
Jordan 51 O
Latvia (LSS) 50 O
Slovenia 48 O
Italy 48 O
New Zealand 48 O
Philippines 39
Item Number: L08 Lithuania 37
Cyprus 37
SCORING Turkey 36
Tunisia 36
Israel 35
Chile 28
Morocco 16
South Africa 12
Country average vs.

Higher
Not different O
Note: There are two possible food webs that are accepted as correct. An alternative, but less pre- Lower
ferred, food web with the hawk (3) and snake (4) reversed is also scored as correct.
Correct Response
• Four placed correctly: 2,1,4,3 or names of animals/plants (corn, caterpillar, snake, hawk)
as shown in the diagram above.
• Same as above but with hawk and snake reversed.
Incorrect Response
26
Life Science
Food web: effect of crop failure Overall Percent Correct
Singapore 72
Chinese Taipei 55
Korea, Rep. of 54
England 46
Australia 44
Canada 38
New Zealand 38
Hong Kong, SAR 36
Netherlands 36 O
United States 35
Malaysia 31 O
Japan 28 O
Hungary 28 O
Finland 26 O
Czech Republic 26 O
Slovenia 23 O
Turkey 23 O
Italy 22 O
Latvia (LSS) 20 O
Bulgaria 20 O
Item Number: N02 Indonesia 19
Romania 19 O
SCORING Philippines 17
Note: A correct response must include a feasible explanation directly relating the predicted Israel 15
change in robin population to the effect of corn crop failure on prey/predator relationships Lithuania 14
indicated in the food web. Responses do not have to use the specific terms decrease, Thailand 14
increase, and same, as long as the explanation is clear with respect to the effect on the
Tunisia 13
robin population. If more than one effect is given, assign credit corresponding to the first
correct explanation. Cyprus 13
Jordan 12
Correct Response Chile 11
• Robin population may decrease. Explanation based on predators (snakes/hawks) eating
more robins if mice die. Moldova 8
South Africa 3
• Robin population may increase. Explanation based on predators (snakes/hawks) dying due to Morocco 2
lack of food (mice).
• Robin population would stay the same with a feasible explanation. Country average vs.
• Other acceptable explanation. International average:
Higher
Incorrect Response
Not different O
• Robin population would decrease. Incorrect explanation based on robins starving if snakes Lower
die (confuses prey/predator relationship).
• Robin population would decrease. Incorrect explanation based on the robin needing corn to
survive.
• Robin population would stay the same. Incorrect explanation based on the robins not needing
corn to survive or not being connected to corn in the food web. (Does not consider the effect
of predators.)
• Mentions only that the whole food web will be upset and/or all the animals will die.
27
Life Science
Information
Bacteria to convert milk to yogurt Overall Percent Correct
Japan 86
Which of the following organisms are used to convert milk to
Chinese Taipei 86
yogurt? Korea, Rep. of 75
Hong Kong, SAR 73
A. Bacteria Russian Federation 73
Czech Republic 71
Jordan 71
B. Protozoa Iran, Islamic Rep. 67
Cyprus 65
C. Viruses Turkey 64
Finland 64
Bulgaria 62 O
D. Algae Italy 62 O
Moldova 60 O
Latvia (LSS) 59 O
Netherlands 58 O
Lithuania 58 O
Thailand 57 O
Romania 56 O
Slovenia 54 O
Canada 52 O
Tunisia 52 O
Hungary 47 O
England 44
Australia 44
New Zealand 43
United States 43
Morocco 42
Israel 40
Indonesia 37
Singapore 36
South Africa 35
Malaysia 34
Philippines 27
Item Number: N03 Chile 26
Country average vs.

Higher
Not different O
Lower
Correct Response: A
28
Life Science
Information
Bone meal for plant growth Overall Percent Correct
Latvia (LSS) 82
Some plants grow better if bone meal (ground-up bones) is
Thailand 81
spread around their roots. What does bone meal supply to Singapore 80
plants that makes them grow better? Lithuania 79
Hungary 78
Malaysia 75
A. Energy
Finland 73
B. Minerals Chinese Taipei 72
Czech Republic 69
Japan 67
C. Vitamins Slovenia 65
Canada 65
D. Carbon dioxide Italy 60 O
United States 60 O
Moldova 59 O
E. Water England 59 O
Hong Kong, SAR 58 O
Korea, Rep. of 58 O
New Zealand 58 O
Tunisia 57 O
Bulgaria 57 O
Australia 57 O
Romania 49 O
Slovak Republic 45
Turkey 44
Netherlands 43
Cyprus 42
Chile 41
Jordan 39
Indonesia 34
Philippines 31
Israel 30
Item Number: N05 South Africa 27
Morocco 19
Country average vs.

Higher
Not different O
Lower
Correct Response: B
29
Life Science
Information
Definition of tissue Overall Percent Correct
Bulgaria 67
Tissues are found in living things. What is the definition of a
tissue? Chinese Taipei 60
Slovenia 57
A. A group of cells with similar structure and function Lithuania 56
Cyprus 56
Korea, Rep. of 54
B. A group of cells with different structure and function Czech Republic 52 O
Slovak Republic 52
C. A group of organelles contained inside a cell Macedonia, Rep. of 50
Jordan 49
D. A group of substances that make up the walls of a cell Romania 47 O
United States 46 O
Netherlands 46 O
Moldova 46 O
Hungary 44 O
Canada 42 O
Israel 41 O
England 41 O
Singapore 40 O
Italy 38 O
Australia 37 O
Hong Kong, SAR 37 O
Japan 37 O
Latvia (LSS) 36 O
New Zealand 33
Finland 30
Philippines 29
Morocco 27
Turkey 26
Malaysia 25
Thailand 24
Chile 23
Indonesia 22
Item Number: N06 Tunisia 21
South Africa 17
Country average vs.

Higher
Not different O
Lower
Correct Response: A
30
Life Science
Information
Mammal/lizards living in cold regions Overall Percent Correct
Which statement best explains why mammals are found in
Bulgaria 59
very cold regions of the world but lizards are not? Korea, Rep. of 58
Japan 56
A. Both mammals and lizards are cold-blooded, but Netherlands 53
Canada 52
mammals have fur to keep them warm.
Hong Kong, SAR 51
Chinese Taipei 49
B. Both mammals and lizards are warm-blooded, but lizards Slovak Republic 49 O
get too cold when they shed their skin. Thailand 49
United States 47
Singapore 47 O
C. Since mammals, but not lizards, are warm blooded, their Australia 46 O
body temperature will adjust to match the external Latvia (LSS) 45 O
temperature. Lithuania 44 O
Italy 44 O
Finland 43 O
D. Since mammals, but not lizards, are warm-blooded, they Czech Republic 41 O
will maintain their body temperature using heat from International Average 40
metabolic processes. England 40 O
New Zealand 40 O
Hungary 39 O
Malaysia 39 O
Romania 38 O
Cyprus 35 O
Philippines 35 O
Israel 34 O
Moldova 32
Slovenia 30
Chile 30
Jordan 29
Indonesia 27
Tunisia 24
Turkey 23
Item Number: N08 Morocco 21
South Africa 15
Country average vs.

Higher
Not different O
Lower
Correct Response: D
31
Life Science
Tree growth Overall Percent Correct
Ethan hammered a nail into the trunk of a young tree.
Finland 64
Explain why the nail was still at the same height from the Canada 59
ground twenty years later even though the tree had grown Australia 57
to a height of 22 meters. Japan 57
Netherlands 56
New Zealand 56
Thailand 55
Slovak Republic 55
England 55
Chinese Taipei 53
Moldova 53
Hungary 50 O
Singapore 49 O
Czech Republic 48 O
Cyprus 47 O
Slovenia 45 O
United States 45 O
Turkey 44 O
Italy 43 O
Latvia (LSS) 42 O
Hong Kong, SAR 40 O
Israel 38 O
Lithuania 36 O
Romania 36 O
Malaysia 33
Korea, Rep. of 33
Chile 30
Bulgaria 29
Jordan 24
Indonesia 23
Tunisia 22
Item Number: P03 Macedonia, Rep. of 21
Philippines 9
SCORING South Africa 8
Morocco 2
Note: A correct response is based on trees increasing in height as a result of growth at the tips
of stems/branches (apical meristem) and trunk growth only resulting in increased diameter.
Responses should be scored as correct if either of these two factors are included. Country average vs.
Correct Response
Higher
• Mentions that trees grow in height at the tips of stems/branches. (May also mention trunk Not different O
growth increasing in diameter.) Lower
• Mentions ONLY that the trunk grows in width or diameter but not height (without mentioning
growth of the stem or branches).
• Other correct.
Incorrect Response
• Mentions only that the trunk does not grow (is dead).
• Mentions that the nail stops or prevents growth.
32
Life Science
Information
Hibernating animals Overall Percent Correct
Lithuania 77
Animals hibernate to survive cold weather and poor food
Hungary 75
supplies. Which of the following occurs in animals when they Czech Republic 75
hibernate? Slovak Republic 74
Bulgaria 72
Thailand 69
A. Their blood stops circulating.
Finland 67
B. Their body temperature increases. Latvia (LSS) 64
Indonesia 63
Slovenia 54 O
C. Their body fat remains constant. Moldova 54 O
Netherlands 54 O
D. Their rate of metabolism decreases. Singapore 53 O
Australia 51 O
Chinese Taipei 50 O
Cyprus 50 O
Italy 50 O
Canada 50 O
Malaysia 49 O
United States 47 O
Hong Kong, SAR 47 O
Romania 46 O
Israel 44 O
New Zealand 33
England 33
Jordan 31
Chile 30
Philippines 29
Japan 28
Turkey 25
Tunisia 23
Korea, Rep. of 22
Item Number: P04 South Africa 20
Morocco 16
Country average vs.

Higher
Not different O
Lower
Correct Response: D
33
Life Science
Information
Digestion in stomach Overall Percent Correct
Slovak Republic 75
What digestive substance is found in the stomach? What
Czech Republic 64
does it do? Hong Kong, SAR 64
Slovenia 62
Romania 62
Moldova 60
Hungary 59
Latvia (LSS) 57
Singapore 56
Bulgaria 55
Netherlands 54 O
Chinese Taipei 54
Japan 53
England 51
Australia 49 O
Lithuania 49 O
New Zealand 49 O
United States 46 O
Canada 43 O
Korea, Rep. of 42 O
Thailand 41 O
Jordan 37 O
Italy 35 O
Finland 34 O
Malaysia 29
Item Number: P06 Chile 24
Indonesia 22
SCORING Israel 19
Note: To be correct, a response must name a specific digestive substance found in the stomach Cyprus 14
(enzyme, hydrochloric acid, or gastric juices) with or without a full description of its function. A Turkey 13
general response related to “acid” will be accepted as correct, but an incorrect acid will be Tunisia 6
scored as incorrect.
Philippines 6
Correct Response South Africa 4
Morocco 1
• Names enzyme, hydrochloric acid or gastric juices with an explanation based on breaking
down food (particles) or protein.
Country average vs.
• Names enzyme, hydrochloric acid or gastric juices without a complete explanation. International average:
• Names acid with or without a complete explanation (does not explicitly name hydrochloric Higher
acid). Not different O
Lower
• Other correct.
Incorrect Response
• Names an incorrect acid not involved in digestion in stomach (lactic acid, amino acid,
sulfuric acid, etc.).
• Names a substance (or body part) not found in the stomach but involved in digestion
(saliva, bile salts, bacteria, intestines, etc.).
• Mentions digesting (breaking down) food but no specific substance or body part is named.
34
Life Science
Information
Two outcomes of introducing new species Overall Percent Correct
Australia 74
A new species of fish was released into a lake. State two
New Zealand 60
unwanted outcomes that could arise from the introduction of Slovak Republic 58
this new species. Canada 57
Singapore 57
Thailand 57
1.
England 56
Finland 56
Latvia (LSS) 53
Chinese Taipei 52
Moldova 48 O
Netherlands 47 O
2. Israel 47 O
Lithuania 46 O
Hungary 44 O
Slovenia 43 O
Bulgaria 43 O
United States 42 O
Italy 40 O
Japan 39 O
Romania 36 O
Tunisia 35 O
Cyprus 35 O
Czech Republic 34 O
Korea, Rep. of 33
Malaysia 32
Hong Kong, SAR 29
Item Number: R03D Chile 28
Indonesia 23
SCORING Iran, Islamic Rep. 22
Note: Each of the two outcomes are scored separately. The same score may be used twice, Turkey 22
since they are based on general outcome categories. However, if the two outcomes are Jordan 21
essentially the same, the second outcome should be scored as incorrect. If only one out- Morocco 19
come is given, the second should be scored as incorrect. South Africa 8
Philippines 7
Correct Response
• Mentions competition with native species (e.g. overpopulation, eating the limited food supply). Country average vs.
• Mentions new species introducing diseases (bacteria, parasites, etc.). International average:
Higher
• Mentions effects of predation (new species killing off existing species or vice-versa).
Not different O
• Mentions that the new species cannot survive in the lake (extinction due to inhospitable habi- Lower
tat).
• Mentions upsetting food web or ecological balance.
• Mentions mating with existing species.
• Other correct.
Incorrect Response
• Response too general.
35
Life Science
Importance of trees/sun in rain forest Overall Percent Correct
Singapore 93
Australia 91
Canada 90
England 88
Chinese Taipei 87
Korea, Rep. of 87
Thailand 87
United States 85
New Zealand 83
Finland 83
Japan 83
Hong Kong, SAR 82
Slovak Republic 80
Hungary 79
Netherlands 79 O
Cyprus 79
Malaysia 79
Latvia (LSS) 79
Slovenia 78 O
Tunisia 77
Czech Republic 76 O
Indonesia 72 O
Italy 71 O
Jordan 69 O
A. The Tree Russian Federation 64
Lithuania 63
Turkey 61
B. The Sun
Bulgaria 60
Romania 60
Item Number: X02A Israel 59
Philippines 59
SCORING Moldova 56
A: Scoring for Trees Macedonia, Rep. of 49
Chile 48
Note: If student response refers to oxygen/carbon dioxide cycle, score as correct even if other
Morocco 44
reasons are given. If more than one reason is given, assign credit corresponding to the
first correct reason. Iran, Islamic Rep. 42
South Africa 30
Correct Response
• Trees produce oxygen and/or use carbon dioxide. Country average vs.
• Trees provide food or energy.
Higher
• Trees provide a place to hide/shelter. Not different O
Lower
• Trees provide shade or protection from the Sun.
• Other correct.
Incorrect Response
• Response too vague.
36
Life Science
Importance of trees/sun in rain forest Overall Percent Correct
Singapore 91
Canada 88
Australia 88
Korea, Rep. of 86
Japan 85
Thailand 84
England 84
Chinese Taipei 82
New Zealand 82
Finland 81
United States 81
Hong Kong, SAR 79
Latvia (LSS) 79
Malaysia 78
Slovenia 77
Netherlands 76
Tunisia 69 O
Czech Republic 69 O
Jordan 68 O
Cyprus 66 O
Indonesia 65 O
Hungary 64 O
Italy 62 O
A. The Tree Russian Federation 60
Philippines 59
Romania 57
B. The Sun
Turkey 56
Lithuania 56
Item Number: X02B Israel 55
Moldova 55
B: Scoring for Sun Bulgaria 48
Chile 46
Note: If response refers explicitly to photosynthesis, score as correct even if other reasons are given.
If more than one reason is given, assign credit corresponding to the first correct reason.
Morocco 35
• Sun is needed for photosynthesis (by plants).

Country average vs.
• Sun is needed in order for chlorophyll in plants to produce food. (Does not explicitly International average:
mention photosynthesis).
Higher
• Sun provides energy and/or is needed for plant growth. (No mention of photosynthesis or Not different O
chlorophyll). Lower
• Sun provides heat (warmth) or maintains the temperature. (No mention of photosynthesis or
chlorophyll).
• Sun provides light and/or enables animals to see.
• Other correct.
Incorrect Response
37
Physics
Information
Energy released from car engine Overall Percent Correct
Hungary 76
Most of the chemical energy released when gasoline burns in
Korea, Rep. of 74
a car engine is not used to move the car, but is changed into Russian Federation 72
Bulgaria 71
A. electricity Slovenia 67
England 67
Finland 66
B. heat Czech Republic 66
Israel 65
C. magnetism Japan 64
Canada 63
Netherlands 63 O
D. sound Cyprus 63
Moldova 62 O
Singapore 60 O
Turkey 60 O
Romania 59 O
United States 59 O
Australia 59 O
Latvia (LSS) 59 O
New Zealand 58 O
Jordan 56 O
Thailand 56 O
Italy 53 O
Lithuania 52
Chinese Taipei 52
Philippines 51
Malaysia 50
Hong Kong, SAR 49
Tunisia 46
Indonesia 42
Morocco 40
Chile 34
Country average vs.

Higher
Not different O
Lower
Correct Response: B
38
Physics
Greatest density from mass/volume table Overall Percent Correct
Chinese Taipei 52
Hong Kong, SAR 50
Korea, Rep. of 47
Finland 46
Israel 44
Singapore 44
Japan 42
Netherlands 38
Hungary 36
Bulgaria 35 O
Slovenia 32 O
Canada 32 O
Malaysia 31 O
Latvia (LSS) 30 O
Lithuania 30 O
Czech Republic 29 O
Australia 25 O
Romania 25 O
Moldova 23 O
United States 23
Italy 23
Turkey 21
Cyprus 21
Thailand 20
Philippines 19
England 19
Jordan 18
South Africa 17
New Zealand 17
Chile 11
Tunisia 10
Item Number: B03 Indonesia 8
Morocco 7
Country average vs.

Higher
Not different O
Lower
Correct Response: C
39
Physics
Information
Color reflecting most light Overall Percent Correct
The walls of a building are to be painted to reflect as much
Hungary 94
light as possible. What color should they be painted? Slovak Republic 92
Netherlands 92
A. White Singapore 91
Slovenia 91
Czech Republic 90
B. Red Russian Federation 90
Australia 89
C. Black England 89
Chinese Taipei 89
Lithuania 88
D. Pink Malaysia 87
Japan 87
Bulgaria 86
Romania 86 O
Latvia (LSS) 86
Hong Kong, SAR 85
Finland 85 O
Israel 85
Canada 83 O
United States 83 O
Italy 82 O
New Zealand 81 O
Philippines 80 O
Korea, Rep. of 78
Indonesia 78
Cyprus 76
Moldova 75
Turkey 75
Chile 75
Thailand 73
Tunisia 73
Jordan 70
Morocco 56
Country average vs.

Higher
Not different O
Lower
Correct Response: A
40
Physics
Information
Light rays through magnifying glass Overall Percent Correct
Japan 88
Chinese Taipei 73
Bulgaria 70
Korea, Rep. of 61
Singapore 54
Malaysia 52
Lithuania 51
Finland 50
Czech Republic 49 O
Moldova 48 O
Australia 48 O
Hungary 47 O
Netherlands 47 O
Canada 46
Hong Kong, SAR 43 O
Romania 43 O
Slovenia 41 O
New Zealand 40 O
Thailand 40 O
Latvia (LSS) 38 O
Chile 37
Jordan 37
United States 36
Italy 34
Morocco 31
Israel 31
England 29
Cyprus 28
Indonesia 24
Turkey 23
Tunisia 21
Item Number: D01 Philippines 19
South Africa 14
Country average vs.

Higher
Not different O
Lower
Correct Response: B
41
Physics
Information
Magnetic substances Overall Percent Correct
Hungary 92
Czech Republic 91
Bulgaria 91
Korea, Rep. of 90
Singapore 89
England 89
Slovak Republic 88
Japan 85
Slovenia 84
Australia 83
Lithuania 82
Finland 82
Canada 81
Romania 79
Chinese Taipei 77
Malaysia 75 O
Jordan 75 O
Netherlands 74 O
Hong Kong, SAR 74 O
New Zealand 73 O
Italy 73 O
United States 72 O
Moldova 71 O
Turkey 70 O
Cyprus 69 O
Israel 67 O
Thailand 58
Latvia (LSS) 58
Chile 53
Tunisia 53
Indonesia 47
South Africa 36
Item Number: D02 Morocco 29
Philippines 27
Country average vs.

Higher
Not different O
Lower
Correct Response: C
42
Physics
Information
Sequence of energy changes Overall Percent Correct
Singapore 77
Hungary 74
Chinese Taipei 72
England 71
Slovak Republic 67
Cyprus 67
Australia 67
Israel 66
Hong Kong, SAR 66
Italy 66
Netherlands 65
Thailand 64
United States 64
Bulgaria 64 O
Japan 63
New Zealand 61 O
Canada 61 O
Korea, Rep. of 60 O
Slovenia 59 O
Jordan 58 O
Romania 56 O
Tunisia 55
Czech Republic 55 O
Latvia (LSS) 54 O
Moldova 53 O
Indonesia 53
Malaysia 52
Lithuania 51
Chile 50
Morocco 48
Finland 45
Philippines 39
Item Number: D04 Turkey 36
South Africa 20
Country average vs.

Higher
Not different O
Lower
Correct Response: C
43
Physics
Information
Why light-colored clothes are cooler Overall Percent Correct
Hungary 88
On a warm sunny day, you will feel cooler wearing light-
Netherlands 88
colored clothes because they Chinese Taipei 87
A. reflect more radiation Czech Republic 86
Slovak Republic 85
Korea, Rep. of 85
B. prevent sweating Hong Kong, SAR 84
Singapore 83
C. are not as heavy as dark clothes Russian Federation 83
Slovenia 81
Japan 79
D. let more air in Malaysia 79
Australia 77
Latvia (LSS) 77
Lithuania 75
England 74
Israel 72
Bulgaria 71 O
Finland 71
Canada 69 O
United States 61 O
Italy 61 O
Romania 58 O
New Zealand 55
Moldova 55
Indonesia 52
Cyprus 52
Jordan 47
Philippines 43
Thailand 39
Morocco 38
Chile 37
Turkey 34
Item Number: F02 Tunisia 31
South Africa 18
Country average vs.

Higher
Not different O
Lower
Correct Response: A
44
Physics
Information
Energy stored in food Overall Percent Correct
Singapore 55
People get energy from the food they eat. Where does the
energy stored in food come from? Japan 45
Malaysia 44
A. Fertilizer England 42
Korea, Rep. of 41
Hong Kong, SAR 39
B. The Sun Finland 38
Philippines 38
C. Vitamins Jordan 34
Australia 33
Indonesia 32
D. The soil Russian Federation 29 O
United States 26 O
Chinese Taipei 25 O
New Zealand 25 O
Canada 23 O
Bulgaria 22 O
Thailand 21 O
Hungary 19
Netherlands 19
Czech Republic 18
Italy 18
Slovak Republic 17
Cyprus 16
South Africa 15
Latvia (LSS) 15
Slovenia 14
Turkey 14
Moldova 14
Morocco 12
Chile 11
Romania 11
Lithuania 11
Israel 11
Item Number: H05 Belgium (Flemish) 9
Tunisia 6
Country average vs.

Higher
Not different O
Lower
Correct Response: B
45
Physics
Information
Evaporation rate by surface area Overall Percent Correct
Singapore 98
Hungary 95
Korea, Rep. of 95
Czech Republic 94
Japan 94
Slovak Republic 94
Hong Kong, SAR 93
Moldova 93
Bulgaria 93
Malaysia 93
Chinese Taipei 93
England 92
Canada 91
Australia 90
Latvia (LSS) 90
Lithuania 90 O
Israel 89
Netherlands 89 O
Romania 88 O
Cyprus 88 O
New Zealand 88 O
Jordan 87 O
Finland 86 O
Thailand 85 O
United States 84 O
Slovenia 83 O
Indonesia 75
Tunisia 75
Turkey 74
Chile 72
Italy 70
Philippines 60
Morocco 45
Country average vs.

Higher
Not different O
Lower
Correct Response: C
46
Physics
Information
Gravity acting on rocket Overall Percent Correct
Slovak Republic 68
Czech Republic 65
Hungary 65
Finland 53
Singapore 49
Chinese Taipei 48
Lithuania 48
Slovenia 46
United States 46
Australia 45
Canada 45 O
England 43 O
Moldova 42 O
Japan 40 O
New Zealand 39 O
Netherlands 39 O
Jordan 36 O
Bulgaria 35 O
Thailand 30 O
Cyprus 30 O
Romania 29 O
Korea, Rep. of 29
Philippines 27
Israel 26
Italy 25
Hong Kong, SAR 24
Latvia (LSS) 24
Chile 23
Turkey 22
Malaysia 21
Tunisia 19
Morocco 17
Country average vs.

Higher
Not different O
Lower
Correct Response: D
47
Physics
Information
Sunscreen to protect against radiation Overall Percent Correct
Chinese Taipei 94
Sunscreen is used to protect the skin from exposure to which
Singapore 91
type of solar radiation? Hungary 87
Thailand 86
A. Visible Australia 85
Hong Kong, SAR 84
Slovenia 84
B. X-rays New Zealand 80
Japan 79
C. Infrared Slovak Republic 79
Korea, Rep. of 77
Finland 77
D. Ultraviolet Chile 76
Czech Republic 75
E. Microwaves Netherlands 75
Canada 75
Indonesia 72
Lithuania 70
United States 69
Italy 68 O
England 64 O
Bulgaria 62 O
Philippines 57 O
Latvia (LSS) 54 O
Malaysia 54
Romania 48
Moldova 45
Jordan 43
Israel 39
Tunisia 33
Turkey 32
Cyprus 26
South Africa 18
Item Number: J08 Morocco 18
Country average vs.

Higher
Not different O
Lower
Correct Response: D
48
Physics
Information
Rotating forces on wheel Overall Percent Correct
A uniform wheel is free to rotate on its axle at its center. It is acted on by two Japan 76
Hungary 74
forces in the same plane. Each force has the same size, equal to 5N (Newtons).
Lithuania 72
In which case will the wheel rotate? Latvia (LSS) 72
Czech Republic 69 O
Netherlands 69 O
Finland 69
Slovenia 69 O
Thailand 67 O
Bulgaria 67 O
Italy 66 O
Canada 66 O
Korea, Rep. of 63 O
Romania 63 O
United States 62 O
Moldova 62 O
Hong Kong, SAR 62 O
England 61 O
Chile 60 O
Australia 60 O
Singapore 60 O
Jordan 60 O
New Zealand 59 O
Tunisia 58 O
Malaysia 58 O
Chinese Taipei 58 O
Cyprus 57 O
Turkey 57 O
Israel 57 O
Morocco 55 O
Indonesia 52
Item Number: L01 Philippines 49
South Africa 36
Country average vs.

Higher
Not different O
Lower
Correct Response: D
49
Theorizing, Analyzing and

Physics
Solving Problems
Efficiency of machines Overall Percent Correct
Netherlands 58
Korea, Rep. of 52
Slovak Republic 50
Singapore 49
Australia 49
Japan 46
Chinese Taipei 44
Canada 43
New Zealand 42
England 42
Finland 40 O
Lithuania 38 O
Hungary 38 O
Israel 35 O
Slovenia 33 O
Hong Kong, SAR 32 O
Czech Republic 30 O
United States 30 O
Thailand 28 O
Bulgaria 28 O
Cyprus 27 O
Latvia (LSS) 26 O
Italy 23 O
Romania 22 O
Malaysia 20
Indonesia 20
Moldova 19
Jordan 19
Turkey 17
SCORING Chile 8
Note: A correct response must identify B and include an explanation based on the concept of Morocco 7
energy efficiency (ratio of energy output to energy input) that compares the volume of
Philippines 4
water pumped for an equivalent volume of gasoline used for the two machines.
Responses based ONLY on comparing the amount of gasoline used OR the amount of South Africa 3
water pumped by the machines without considering the ratio of water/gasoline are scored
as incorrect. No credit is lost for missing/incorrect units or for minor computational errors, Country average vs.
provided the correct conclusion and explanation are given. International average:
Higher
Correct Response
Not different O
• B. With correct explanation based on the concept of energy efficiency (B uses less gasoline Lower
than A for an equivalent volume of water pumped).
Incorrect Response
• B. It uses less gasoline (no comparison of efficiency based on volume of water pumped).
• B. Other incorrect/inadequate or no explanation.
• A. It removes more water in 1 hour (no comparison of efficiency based on gas used).
• A. Other incorrect/inadequate or no explanation.
50
Physics
Information
Complete circuits Overall Percent Correct
Hong Kong, SAR 84

The following diagrams show a battery and a bulb connected by wires to
various materials. Chinese Taipei 80
Singapore 79
Israel 79
Korea, Rep. of 78
Netherlands 78
Hungary 74
Australia 73
Malaysia 72
Czech Republic 72 O
Jordan 70 O
Cyprus 69 O
Finland 68 O
Japan 68 O
Thailand 65 O
Slovenia 65 O
England 65 O
Tunisia 65 O
United States 64 O
New Zealand 64 O
Lithuania 63 O
Canada 60 O
Bulgaria 57 O
Romania 57 O
Italy 56
Morocco 56
Latvia (LSS) 56 O
Indonesia 52
Chile 50
Moldova 48
Turkey 46
Item Number: N01 Philippines 42
South Africa 33
Country average vs.

Higher
Not different O
Lower
Correct Response: C
51

Physics
Solving Problems
Balancing 10 and 5 liter buckets Overall Percent Correct
Which picture shows the best way for the man to balance a ten-liter bucket of Japan 88
water and a five-liter bucket of water?
Korea, Rep. of 87
Finland 86
Slovenia 84
Chinese Taipei 84
Netherlands 83
Latvia (LSS) 82
Czech Republic 82
Hungary 81
Australia 80
Slovak Republic 80
Thailand 78
Lithuania 78 O
Canada 78
Singapore 77 O
New Zealand 77 O
Bulgaria 76 O
Malaysia 76 O
United States 73 O
Hong Kong, SAR 72 O
Romania 70 O
England 70 O
Italy 69 O
Turkey 69 O
Indonesia 66
Chile 63
Moldova 62
Philippines 58
Israel 56
Tunisia 52
Cyprus 50
Morocco 34
Item Number: N09 South Africa 33
Country average vs.

Higher
Not different O
Lower
Correct Response: D
52

Physics
Solving Problems
Flashlights with white/black reflectors Overall Percent Correct
Chinese Taipei 59
Singapore 58
Malaysia 55
England 54
Hungary 52
Netherlands 52 O
Japan 50
Czech Republic 48
Canada 47
Lithuania 47 O
Australia 47 O
Slovenia 47 O
Bulgaria 45 O
United States 45 O
Finland 44 O
Korea, Rep. of 43 O
Jordan 43 O
New Zealand 41 O
Latvia (LSS) 41 O
Indonesia 40 O
Thailand 40 O
Hong Kong, SAR 38 O
Tunisia 35 O
Italy 34 O
Turkey 32
Cyprus 26
Romania 25
Israel 24
Item Number: N10
Moldova 22
SCORING
Chile 17
Note: A correct response must identify Roddy’s and include an explanation based on the Morocco 16
relative reflectivity of the white and black cardboard. Credit is given both for responses
Philippines 12
explicitly mentioning the higher reflectance of the white cardboard and/or the higher
absorptance of the black cardboard as well as responses communicating this concept South Africa 11
using less scientific terminology.
Country average vs.
Correct Response International average:
• Roddy's. With correct explanation based on the higher reflectivity of the white cardboard Higher
(or lower reflectivity/higher absorption of the black cardboard). Not different O
[Explicitly refers to absorption and/or reflectivity.] Lower
• Roddy’s. Explanation based on the concept of higher reflectivity but using other terminology.
[Does not explicitly refer to absorption/reflection properties.]
• Other correct.
Incorrect Response
• Roddy’s with an inadequate/incorrect or no explanation.
• Stephanie's. With or without explanation.
53

Physics
Solving Problems
Determination of speed from graph Overall Percent Correct
Hong Kong, SAR 82

Chinese Taipei 78
Singapore 77
Netherlands 75
Malaysia 71
Finland 71
Australia 69
Slovak Republic 69
Canada 68
Czech Republic 66
Thailand 65
Latvia (LSS) 62 O
Lithuania 62 O
Japan 61 O
New Zealand 60 O
Hungary 59 O
Slovenia 57 O
England 56 O
United States 50 O
Israel 49 O
Tunisia 49 O
Moldova 47 O
Italy 47 O
South Africa 47
Bulgaria 47 O
Romania 42
Korea, Rep. of 41
Cyprus 41
Chile 37
Turkey 36
Morocco 34
Jordan 32
Item Number: P01 Indonesia 30
Philippines 25
Country average vs.

Higher
Not different O
Lower
Correct Response: D
54

Physics
Solving Problems
Amount of light on wall and ceiling Overall Percent Correct
Chinese Taipei 52
James turns on a flashlight in his bedroom and shines it on
Hong Kong, SAR 40
his wall one meter away to produce a small circle of light. Korea, Rep. of 36
He then shines the flashlight on his ceiling two meters away Israel 36
to produce a larger circle of light. Australia 35
Canada 35
Singapore 34
a) Does more light reach the ceiling than the wall? Cyprus 34
(Check one) Slovak Republic 32 O
Finland 32 O
Hungary 32
Yes
United States 31
No Latvia (LSS) 30 O
New Zealand 29 O
England 29 O
b) Explain your answer. Belgium (Flemish) 28 O
Netherlands 26 O
Slovenia 25 O
Lithuania 24 O
Czech Republic 23 O
Item Number: P02 Thailand 22 O
SCORING Bulgaria 20 O
Note: A correct response is based on the same amount of light reaching both the ceiling and the Moldova 20 O
wall but being more spread out (less bright) on the ceiling. Correct responses must identi- Russian Federation 20 O
fy NO and include an explanation that states that the light is the same or that Italy 19 O
indicates that the light is just more spread out (less bright) on the ceiling without explicitly Japan 19 O
stating same. If the explanation merely repeats information that is in the stem, it is scored Turkey 18 O
as incorrect even if NO is checked. If a response indicates that there is less light on the Indonesia 14
ceiling, the explanation must include a correct reason based on more air absorption/ scatter-
Romania 13
ing at a greater distance to be correct. Responses that indicate less light at a greater dis-
tance without further explanation should be scored as incorrect. Tunisia 13
Chile 12
Correct Response Jordan 11
Malaysia 8
• No. Explains that the same amount of light reaches the wall and ceiling. (May also refer to
light being more spread out on the ceiling or less concentrated/focused/bright). South Africa 3
Philippines 3
• No. Explains (or shows in a diagram) that light is (only) more spread out (less bright) at a Morocco 2
greater distance. (Does not explicitly state that the light is the same.)
• No. Explains that less light reaches the ceiling because of more air absorption/scattering Country average vs.
at a greater distance. International average:
• No. Other correct explanation. Higher
Not different O
Incorrect Response
Lower
• No. States that less light reaches the ceiling with inadequate explanation related to distance
from source. (Does not include explanation of less light due to air absorption or scattering as
in third correct response).
• No. Other incorrect/inadequate or no explanation. (Includes explanations that merely
paraphrase the stem).
• Yes. Explanation based on light being bigger or more spread out.
• Yes. Other incorrect/inadequate or no explanation.
55
Physics
Information
Appearance of red dress in green light Overall Percent Correct
Singapore 63
As a play begins, white stage lights shine on an actress
Hungary 57
wearing a red dress. Suddenly, the lights go off and a green Japan 55
light is shone on the actress. The dress looks black. Why Malaysia 53
does the dress look black? Korea, Rep. of 51
Australia 49
Netherlands 48 O
A. The dress reflects the green part of light. Slovenia 48
United States 47
B. The dress absorbs the red part of light. Canada 45
England 44 O
Chinese Taipei 44 O
C. The dress absorbs the green part of light. Czech Republic 43 O
New Zealand 40 O
D. The dress reflects the black part of light. Russian Federation 39 O
Indonesia 38 O
Latvia (LSS) 35 O
Lithuania 35 O
Cyprus 35 O
Thailand 35 O
Bulgaria 35 O
Finland 35 O
Italy 35 O
Israel 33 O
Hong Kong, SAR 32 O
Chile 29
Jordan 28
Moldova 28
Tunisia 28
Romania 24
Philippines 23
Turkey 22
Item Number: R02 South Africa 20
Morocco 18
Country average vs.

Higher
Not different O
Lower
Correct Response: C
56

Physics
Solving Problems
Conversion of electrical/light energy Overall Percent Correct
Singapore 21
Electrical energy is used to power a lamp. How does the
England 16
amount of electrical energy used compare to amount of light Russian Federation 16
energy produced? Hungary 14
Slovenia 13
Chinese Taipei 12
a) The amount of electrical energy used is:
Hong Kong, SAR 12
(Check one) Belgium (Flemish) 11
more than the amount of light energy produced. Iran, Islamic Rep. 10 O
Netherlands 10 O
less than the amount of light energy produced. Japan 10 O
Australia 9 O
the same as the amount of light energy produced. Korea, Rep. of 8 O
Canada 8 O
Czech Republic 8 O
b) Give a reason to support your answer. International Average 8
Bulgaria 7 O
New Zealand 7 O
Tunisia 6 O
Turkey 6 O
Finland 6 O
Latvia (LSS) 6 O
Lithuania 5 O
Italy 5 O
Israel 5
Romania 4
Cyprus 4
United States 4
Item Number: X01 Jordan 4
Moldova 4
SCORING Malaysia 3
Note: A correct response must identify more and include a correct explanation based on electrical Thailand 3
energy being converted to heat or a more general description of energy losses or low Morocco 3
efficiency. Responses that include explanations based on heat, energy losses or low
Indonesia 2
efficiency but with an incorrect application to the problem by checking less are scored
as incorrect. South Africa 2
Chile 1
Correct Response Philippines 0
• MORE. With an explanation based on (much) energy being converted to heat.
Country average vs.
• MORE. With other correct explanation of energy (power) loss or low efficiency. International average:
[Must clearly indicate that “some” energy goes elsewhere].
Higher
• MORE. Other correct explanation. Not different O
Lower
Incorrect Response
• MORE. Incorrect/inadequate or no explanation.
• SAME. Explanation is based on the concept of conservation of energy without considering
energy losses.
• LESS. Explanation based on heat, energy losses or low efficiency but with an incorrect appli-
cation.
• LESS. Any other incorrect or no explanation.
57
Physics
Heat expansion of balloons Overall Percent Correct
Korea, Rep. of 50
Finland 49
Netherlands 46
Singapore 46
Lithuania 41
Japan 37
Australia 36
Hungary 34
New Zealand 33
Thailand 33
Chinese Taipei 33
Czech Republic 33 O
Jordan 32 O
England 32 O
United States 31 O
Slovenia 30 O
Canada 28 O
Bulgaria 25 O
Latvia (LSS) 24 O
Italy 24 O
Malaysia 21 O
Hong Kong, SAR 19
Item Number: Z03 Romania 17
Moldova 17
SCORING Tunisia 16
Note: A correct response is based on an increase in gas volume (or internal gas pressure) as Turkey 15
a result of increased temperature. Credit is given for both higher-level responses relating to Israel 15
the increased kinetic energy of helium atoms as a function of temperature as well as more Morocco 14
general responses relating to increased internal gas pressure and/or gas volume. An Iran, Islamic Rep. 14
increase in temperature does not have to be explicitly mentioned in order to receive cred- Chile 6
it. Responses referring ONLY to the balloon expanding or to the effect of temperature on Cyprus 6
the balloon without further explanation of the gas behavior are scored as incorrect.
Indonesia 5
Philippines 1
• Mentions explicitly that (as the gas in the balloon heats up), the helium (gas) atoms
(particles, molecules) move faster (collide more frequently) causing the pressure inside
the balloon to increase and/or the volume to increase (expand). Country average vs.
• Mentions that the pressure of the gas inside the balloon increases and/or the volume
Higher
of the gas increases (expands). (No mention of gas atoms/molecules).
Not different O
• Other correct. Lower
Incorrect Response
• Mentions only that the sun heats the helium (gas) and/or causes the balloon to expand.
[No reference to the pressure/volume changes in the gas.]
• Mentions pressure and/or volume with inadequate explanation.
• Mentions only the effect of heat (from Sun) on the balloon material (rubber, latex).
• Refers to (individual) atoms or molecules expanding (or growing).
58
Chemistry
Information
Best reason for painting iron surfaces Overall Percent Correct
Chinese Taipei 91
Paint applied to an iron surface prevents the iron from rusting.
Finland 83
Which ONE of the following provides the best reason? Russian Federation 81
Hungary 81
A. It prevents nitrogen from coming in contact with the iron. Singapore 81
Netherlands 80
Hong Kong, SAR 79
B. It reacts chemically with the iron. Jordan 78
England 76
C. It prevents carbon dioxide from coming in contact with the Bulgaria 76
iron. Lithuania 74
Slovak Republic 73
D. It makes the surface of the iron smoother. Korea, Rep. of 73
Canada 72 O
Australia 72 O
E. It prevents oxygen and moisture from coming in contact Czech Republic 72 O
with the iron. Romania 71 O
Thailand 70 O
Slovenia 70 O
Japan 70 O
Latvia (LSS) 69 O
New Zealand 66 O
United States 66 O
Israel 66 O
Malaysia 66 O
Italy 65 O
Chile 64 O
Cyprus 62
Turkey 58
Philippines 48
Moldova 47
Indonesia 47
Tunisia 44
Item Number: F06 South Africa 26
Morocco 24
Country average vs.

Higher
Not different O
Lower
Correct Response: E
59
Chemistry
Information
Burning wood absorbs/releases energy Overall Percent Correct
Chinese Taipei 82
If you are burning wood, the reaction will
Hungary 77
Finland 75
A. release energy Macedonia, Rep. of 74
Hong Kong, SAR 70
England 68
B. absorb energy Singapore 68
C. neither absorb nor release energy Canada 66
Korea, Rep. of 65
D. sometimes release and sometimes absorb energy, Malaysia 65
depending on the kind of wood United States 64
Netherlands 64 O
Bulgaria 63
Lithuania 61 O
Japan 59 O
Israel 58 O
Australia 58 O
Turkey 58 O
New Zealand 58 O
Slovenia 57 O
Italy 54 O
Cyprus 54 O
Moldova 53 O
Jordan 51 O
Czech Republic 47
Romania 46
Thailand 43
Latvia (LSS) 40
Indonesia 36
Chile 33
Philippines 30
Tunisia 25
Item Number: H06 South Africa 20
Morocco 17
Country average vs.

Higher
Not different O
Lower
Correct Response: A
60
Chemistry
Information
Compounds, molecules and atoms Overall Percent Correct
Singapore 69
The words organs, tissues, and cells can be used in the
Bulgaria 67
following sentence: Slovak Republic 65
Japan 63
Lungs are organs composed of tissues which are made up of Russian Federation 61
Korea, Rep. of 60
cells.
Czech Republic 60
Chinese Taipei 57
Use the words molecules, atoms, and compounds to complete Macedonia, Rep. of 56
the following sentence: Italy 55
Lithuania 54 O
Slovenia 54 O
Sugars are ______________________ composed of Malaysia 53
______________________ which are made up of Australia 53 O
____________________. Latvia (LSS) 52 O
Canada 51 O
United States 51 O
England 49 O
Moldova 48 O
Hungary 46 O
Finland 44 O
Israel 43 O
Netherlands 42 O
New Zealand 41 O
Philippines 41 O
Chile 39
Hong Kong, SAR 38
Jordan 36
Romania 33
Indonesia 30
Thailand 30
Cyprus 29
Tunisia 27
Turkey 23
Item Number: J03 Morocco 15
South Africa 10
SCORING
Correct Response Country average vs.
• Compounds - Molecules - Atoms
Higher
Incorrect Response Not different O
• Compounds - Atoms - Molecules Lower
• Molecules - Atoms - Compounds

61

Chemistry
Filtration of mixtures Overall Percent Correct
Czech Republic 64
Slovak Republic 62
Lithuania 54
Finland 54
Latvia (LSS) 53
Hungary 52
Korea, Rep. of 51
Canada 50
Singapore 50
Slovenia 48
Netherlands 48 O
Chinese Taipei 46
Romania 42 O
Japan 42 O
Malaysia 42 O
Australia 41 O
New Zealand 39 O
United States 39 O
Cyprus 39 O
Hong Kong, SAR 38 O
Bulgaria 37 O
Moldova 34 O
England 34 O
Tunisia 34 O
Israel 32
Italy 30
Thailand 30
Philippines 29
Turkey 28
South Africa 27
Jordan 24
Chile 21
Item Number: L06 Indonesia 15
Morocco 12
Country average vs.

Higher
Not different O
Lower
Correct Response: B
62
Chemistry
Information
Example of chemical reaction Overall Percent Correct
Chinese Taipei 87
Which is an example of a chemical reaction?
Japan 76
Hong Kong, SAR 72
A. Water boiling England 66
Singapore 64
Netherlands 64
B. Sugar dissolving Russian Federation 60
Korea, Rep. of 59
C. Nails rusting Iran, Islamic Rep. 58
Malaysia 57
Finland 56 O
D. Wax melting Hungary 56 O
Canada 55 O
Bulgaria 54 O
Jordan 54 O
Slovenia 54 O
Australia 53 O
Romania 52 O
United States 52 O
Thailand 49 O
Italy 48 O
Latvia (LSS) 47 O
Czech Republic 47 O
New Zealand 42 O
Cyprus 40
Chile 37
Lithuania 37
Indonesia 35
Moldova 34
Turkey 32
Israel 31
Philippines 30
Morocco 30
South Africa 18
Country average vs.

Higher
Not different O
Lower
Correct Response: C
63
Chemistry
Small pieces of wood burn faster Overall Percent Correct
Slovak Republic 53
A large log of wood will burn more slowly than the same log
Moldova 53
chopped into smaller pieces. Explain why. Chinese Taipei 50
Finland 39
Hungary 32
Latvia (LSS) 32 O
Slovenia 31 O
Netherlands 30 O
New Zealand 30 O
England 30 O
Bulgaria 29 O
Australia 29 O
Czech Republic 29 O
Korea, Rep. of 28 O
Singapore 27 O
Canada 23 O
Indonesia 23 O
Malaysia 21 O
Romania 21 O
Lithuania 20 O
Jordan 18
Item Number: R05 United States 18
Israel 17
SCORING Turkey 15
Hong Kong, SAR 14
Note: A correct response is based on the concept of increased surface area in the smaller
pieces resulting in faster burning (reaction with oxygen). Credit is given both for higher- Italy 13
level responses indicating increased availability of oxygen/air or surface area in the Cyprus 13
chopped wood pieces as well as less sophisticated responses describing only that more Thailand 13
wood is exposed to the flame and can, therefore, burn simultaneously. Philippines 10
Chile 9
Correct Response Tunisia 9
• Mentions that there is more wood (surface area) in contact with oxygen or air in the smaller South Africa 7
pieces. [Explicitly mentions availability to oxygen/air.] Japan 5
Morocco 2
• Mentions effect of increased surface area in the chopped wood pieces. [Explicitly mentions
surface area, surface, or area. No mention of oxygen/air.]
Country average vs.
• Mentions that when chopped, more parts of the wood are exposed to flame (ignite, catch fire)
and all the small pieces can burn simultaneously. [No explicit mention of oxygen/air or sur-
face area.] Higher
Not different O
• Other correct. Lower
Incorrect Response
• Refers only to relative rates of burning (burning through). [Does not refer explicitly to
surface area, oxygen/air, or simultaneous burning.]
• Refers only to the relative rate of ignition (catching on fire, heating up). [Does not refer explic-
itly to surface area, oxygen/air, or simultaneous burning.]
• Mentions only the need for oxygen/air. [Incorrect/inadequate or no connection to increased
availability in chopped wood.]
64
Chemistry
Galvanization of steel Overall Percent Correct
Chinese Taipei 77
A steel manufacturer uses a chemical process called
Singapore 66
'galvanization' to protect the surface of steel beams that are Korea, Rep. of 63
used to construct high-rise buildings. It takes a crew of steel England 57
workers 8 hours to 'galvanize' a large batch of steel. Finland 56
Australia 56
Canada 56
a) Why MUST the surface of the steel be protected? Hong Kong, SAR 56
Hungary 54
Slovak Republic 48
New Zealand 48
b) A new 'galvanization' process is developed that shortens United States 46
the procedure to 4 hours. Describe two consequences of the Malaysia 46
steel manufacturer switching to the shorter Jordan 44 O
Thailand 43 O
'galvanization' process.
Slovenia 40 O
Czech Republic 38 O
1. Japan 38 O
Bulgaria 35 O
Romania 32 O
2. Italy 31 O
Netherlands 31 O
Latvia (LSS) 29
Indonesia 28
Tunisia 24
Israel 23
Turkey 21
Cyprus 20
Chile 16
Lithuania 16
Moldova 11
Item Number: Z01A Philippines 10
South Africa 6
SCORING Morocco 3
A: Scoring for why steel is galvanized
Country average vs.
Note: A correct response must explicitly reference rusting, corrosion, oxidation, or comparable
term.
Higher
Correct Response Not different O
Lower
• Explicitly refers to rusting, corrosion, or oxidation.
Incorrect Response
• Mentions only the general structural properties of steel (hardness, strength, durability, etc.).
[No mention of rusting, corrosion, oxidation, or equivalent].
• Mentions protection from weather, water, air, etc. [No mention of rusting, oxidation, corrosion,
or equivalent.]
• Mentions only protecting the surface (repeats information in stem).
65
Chemistry
Galvanization of steel Overall Percent Correct
Korea, Rep. of 45
A steel manufacturer uses a chemical process called
Netherlands 42
'galvanization' to protect the surface of steel beams that are Singapore 41
used to construct high-rise buildings. It takes a crew of steel Canada 37
workers 8 hours to 'galvanize' a large batch of steel. Japan 36
Thailand 35
Finland 34
a) Why MUST the surface of the steel be protected? Belgium (Flemish) 32
New Zealand 31
Slovak Republic 30
Australia 27
England 26 O
b) A new 'galvanization' process is developed that shortens United States 26
the procedure to 4 hours. Describe two consequences of the Hungary 25 O
steel manufacturers switching to the shorter Hong Kong, SAR 22 O
Chinese Taipei 21 O
'galvanization' process.
Slovenia 21 O
Malaysia 20 O
1. International Average 20
Bulgaria 18 O
Latvia (LSS) 17 O
Czech Republic 16 O
Jordan 15 O
2. Israel 13
Tunisia 13
Italy 12
Cyprus 11
Lithuania 11
Turkey 10
Indonesia 9
Moldova 8
Chile 7
Romania 7
South Africa 3
Item Number: Z01D
Philippines 3
Morocco 1
B: Scoring for new process
Correct Response Country average vs.

• Mentions that there is more profit (or lower cost) for the manufacturing company.
Higher
• Mentions greater efficiency/productivity or that more steel/buildings can be produced (faster). Not different O
Lower
• Mentions unemployment or lower pay for workers.
• Mentions any other worker-related consequence.
• Mentions that the new method might be inferior to the old (shorter process saves time at the
expense of quality; unproven method compared to old reliable one).
• Other correct.
Incorrect Response
• Mentions only that the new process is shorter or takes 4 hours (less time).
[Merely reports information given in stem.]
66
Environmental Understanding Complex

and Resource Issues Information
Area where soil is washed away Overall Percent Correct
Chinese Taipei 92
Rain and running water can wash away soil. From which
Singapore 88
area is soil most likely to be washed away? Slovak Republic 85
Hong Kong, SAR 85
A. A sloping area with bushes Netherlands 83
Korea, Rep. of 83
Malaysia 81
B. A flat area with grasses Russian Federation 80
Japan 79
C. A flat area that is barren England 78
Australia 78
Canada 76
D. A sloping area that is barren Cyprus 76
Latvia (LSS) 75
Slovenia 75
Tunisia 74
Czech Republic 73 O
Indonesia 73
United States 73 O
New Zealand 71 O
Hungary 70 O
Thailand 69 O
Finland 68 O
Lithuania 66 O
Jordan 65 O
Romania 65 O
Israel 63 O
Italy 59
Bulgaria 52
Chile 52
Moldova 50
Turkey 49
Morocco 42
Item Number: F04 Philippines 39
South Africa 26
Country average vs.

Higher
Not different O
Lower
Correct Response: D
67

Effectiveness of insecticides Overall Percent Correct
Chinese Taipei 76
Insecticides are used to control insect populations so that they
Hong Kong, SAR 74
do not destroy crops. Over time, some insecticides become less Hungary 70
effective at killing insects, and new insecticides must be Singapore 69
developed. What is the most likely reason insecticides become Japan 68
less effective over time? Australia 66
United States 62
Netherlands 61
A. Surviving insects have learned to include insecticides as a Canada 60
food source. Russian Federation 60 O
Finland 57 O
Slovenia 57 O
B. Surviving insects pass their resistance to insecticides to Czech Republic 57 O
their Soffspring. England 56 O
New Zealand 56 O
C. Insecticides build up in the soil.
Lithuania 51 O
Israel 51 O
D. Insecticides are concentrated at the bottom of the food Bulgaria 50 O
chain. Italy 50 O
Thailand 49 O
Romania 48 O
Korea, Rep. of 47 O
Turkey 43 O
Moldova 42 O
Chile 38
Latvia (LSS) 38
Philippines 33
Jordan 32
Cyprus 31
Indonesia 27
South Africa 25
Malaysia 24
Morocco 20
Country average vs.

Higher
Not different O
Lower
Correct Response: B
68

Two reasons for famine Overall Percent Correct
Singapore 73
What are two reasons why famine (a great shortage of food)
Slovenia 72
occurs? Slovak Republic 70
Hong Kong, SAR 66
1. Chinese Taipei 66
Moldova 59
Finland 55
Australia 55
Canada 53
Thailand 52
New Zealand 48 O
2. Latvia (LSS) 47 O
Jordan 46 O
Czech Republic 44 O
Cyprus 43 O
Turkey 42 O
Bulgaria 41 O
Italy 41 O
England 41 O
Malaysia 40 O
Netherlands 39 O
Korea, Rep. of 39 O
Japan 39 O
Chile 37 O
United States 36 O
Indonesia 34
Item Number: P05D Israel 33
SCORING Romania 32
Note: Each of the two reasons must be scored separately. The same score can be used twice. Hungary 31
However, if the reasons described are essentially the same, or an extension of the same Tunisia 29
idea, or if only one reason is given, the second reason should be scored as incorrect.
Lithuania 26
Philippines 16
• Mentions agriculturally-related factors (soil depletion, overgrazing, erosion, poor farming tech- Macedonia, Rep. of 14
niques).
South Africa 8
• Mentions natural disasters or weather-related factors (floods, earthquakes, rain distribution,
drought, temperature, sun, etc.).
Country average vs.
• Mentions crop disease, insect infestation or other pests. International average:
• Mentions overpopulation or consumption. Higher

Not different O
• Mentions specific social/economic/political factors. Lower
• Mentions pollution or other contamination.
• Other correct.
Incorrect Response
• Mentions ONLY a lack or need of food (or other responses related to a general definition of
famine).
69
Environmental Understanding Simple

Result of global warming Overall Percent Correct
Japan 67
What is predicted to be a result of global warming?
Hong Kong, SAR 59
Chinese Taipei 58
A. Rising ocean level Lithuania 57
Singapore 56
Australia 52
B. More severe earthquakes Bulgaria 49
Italy 48
C. Larger volcanic eruptions Korea, Rep. of 47
Hungary 44
New Zealand 43
D. Thinning ozone layer Cyprus 42
South Africa 37 O
Latvia (LSS) 35 O
England 33 O
Netherlands 33 O
Czech Republic 32 O
Canada 31 O
Finland 31 O
United States 30 O
Moldova 29 O
Slovenia 28 O
Israel 23
Romania 22
Morocco 22
Jordan 20
Malaysia 18
Chile 16
Philippines 16
Turkey 15
Thailand 13
Tunisia 11
Item Number: R06 Indonesia 10
Country average vs.

Higher
Not different O
Lower
Correct Response: A
70
Scientific Inquiry
Investigating the Natural World
and the Nature of Science
Evaporation of vinegar and oil Overall Percent Correct
England 78
Two open bottles, one filled with vinegar and the other with
Singapore 78
olive oil, were left on a window sill in the Sun. Several days Netherlands 76
later it was observed that the bottles were no longer full. United States 76
What can be concluded from this observation? Australia 70
Israel 67
New Zealand 67
A. Vinegar evaporates faster than olive oil. Hungary 64
Canada 64
B. Olive oil evaporates faster than vinegar. Korea, Rep. of 59
Japan 50 O
Italy 49 O
C. Both vinegar and olive oil evaporate. Jordan 49 O
D. Only liquids containing water evaporate. Hong Kong, SAR 49 O
Czech Republic 49 O
E. Direct sunlight is needed for evaporation. Malaysia 46 O
Bulgaria 45 O
Finland 45 O
Chinese Taipei 44 O
Indonesia 42 O
Turkey 41
Latvia (LSS) 41 O
Lithuania 39 O
Slovenia 39
Morocco 38
Philippines 38
Chile 38
Cyprus 36
Romania 30
South Africa 29
Thailand 28
Moldova 19
Country average vs.

Higher
Not different O
Lower
Correct Response: C
71
Scientific Inquiry Understanding Simple

and the Nature of Science Information
Replication of measurements Overall Percent Correct
Korea, Rep. of 87
The primary reason scientists repeat the measurements they
Chinese Taipei 73
take during experiments is so that they can Japan 61
Thailand 60
A. check that the equipment is working Israel 57
Hong Kong, SAR 56
Lithuania 52
B. list all the results in a table Turkey 51
Slovak Republic 50
C. estimate experimental error Latvia (LSS) 46 O
Singapore 46 O
Czech Republic 46 O
D. change the experimental conditions Finland 45 O
Romania 44 O
Bulgaria 43 O
Slovenia 43 O
United States 39 O
Moldova 39 O
Tunisia 35 O
England 35 O
Jordan 34 O
Canada 34 O
Chile 33
Australia 33
Hungary 31
Netherlands 30
New Zealand 29
Indonesia 29
Philippines 29
Cyprus 28
Malaysia 26
Italy 24
Item Number: P07 South Africa 20
Morocco 11
Country average vs.

Higher
Not different O
Lower
Correct Response: C
72
Scientific Inquiry
Bacteria/mold experiment Overall Percent Correct
Chinese Taipei 80
Alexander Fleming noticed that bacteria growing on a plate of
Japan 70
agar did not grow next to a mold that was growing on the same Italy 67
plate. He wrote in his laboratory report: "The mold may be Israel 63
producing a substance that kills bacteria." This statement is Bulgaria 58
best described as Thailand 55
Canada 52
United States 47
A. an observation Hungary 42 O
Chile 42
Netherlands 42 O
B. a hypothesis
Morocco 41 O
Lithuania 41 O
C. a generalization Australia 39 O
Tunisia 36 O
D. a conclusion Cyprus 36 O
New Zealand 32 O
Slovenia 32 O
Hong Kong, SAR 32 O
South Africa 29
Singapore 28 O
Korea, Rep. of 25
Jordan 22
England 19
Malaysia 18
Philippines 18
Latvia (LSS) 16
Romania 14
Indonesia 11
Finland 11
Item Number: R01
Country average vs.

Higher
Not different O
Lower
Correct Response: B
73
Scientific Inquiry
Heart rate experiment design Overall Percent Correct
Singapore 32
Suppose you want to investigate how long it takes for the
England 31
heart rate to return to normal after exercising. What Australia 30
materials would you use and what procedures would you Korea, Rep. of 30
follow? New Zealand 28
Canada 26
Chinese Taipei 24
United States 21
Hong Kong, SAR 20
Netherlands 20 O
Japan 19
Czech Republic 19
Finland 17
Hungary 11 O
Israel 9
Slovak Republic 8
Slovenia 8
Latvia (LSS) 7
Italy 6
Cyprus 6
Lithuania 6
Jordan 5
Item Number: X03 Indonesia 5
Turkey 4
SCORING Thailand 4
Note: A fully correct procedure may or may not include a separate materials list in order to Moldova 4
receive full credit. If a materials list is not included, then time measurements must be Romania 3
explicitly referenced within the procedure (e.g. ‘time how long it takes’). Partial credit Bulgaria 3
is given for responses where one of the criteria for a correct response is not completely Chile 2
satisfied.
Malaysia 2
Tunisia 2
• Describes a procedure in which: i) Somebody (or self) measures “normal” pulse or heart rate Philippines 2
at rest (using a timer or watch). ii) Subject does an exercise (physical activity). iii) The time
interval is measured from completion of exercise until pulse rate returns to “normal”.
South Africa 1
• Other fully correct.
Partial Response Country average vs.
• As in correct response, but no mention of beginning (‘normal’) pulse measurement.
Higher
• As in correct response, but no mention of measuring the time interval after exercise until Not different O
pulse returns to normal. Lower
• Other partially correct with one criterion not completely satisfied.
Incorrect Response
• No procedure given; only mentions materials.
• Describes a minimal procedure not satisfying two or more of the criteria stated in correct
response.
• Refers only to how to measure the heart (pulse) rate.
74
Content Domain Main Topic Cognitive Domain
Chemistry Acids and Bases Conceptual Understanding
Litmus test Overall Percent Correct
Chinese Taipei 73 p
A solution of hydrochloric acid (HCl) in water will turn blue litmus paper Hong Kong, SAR 66 p
red. A solution of the base sodium hydroxide (NaOH) in water will turn red Japan 64 p
litmus paper blue. If the acid and base solutions above are mixed in the Singapore 56 p
right proportion, the resulting solution will cause neither red nor blue Malaysia 50 p
litmus paper to change color. Hungary 46 p
Explain why the litmus paper does not change color in the mixed solution. England 39 p
Korea, Republic of 39 p
Sweden 34 p
Egypt 31 p
Scotland 25 O
Estonia 25 O
Norway 25 O
Bulgaria 21 O
International average 21 p
Moldova, Rep. of 21 O
Jordan 20 O
Armenia 20 O
S032057
Palestinian Nat’l Auth. 20 O

Romania 18 O
Item Number: S032057 United States 17 q
Israel 16 q
SCORING Lithuania 15 q
Note: To receive credit, responses must refer to neutralization or a chemical reaction that results Cyprus 15 q
in products that do not react with litmus paper.
Macedonia, Republic of 14 q
Correct Response Slovenia 14 q
New Zealand 13 q
• Explanation refers explicitly to the formation of water (and salt) from the neutralization reaction.
Bahrain 13 q
Examples: Hydrochloric acid and sodium hydroxide will mix together to form water and salt,
which is neutral. Latvia 13 q
The hydrogen ions combine with the hydroxide ions to form water, so the litmus paper Australia 13 q
does not change color. Italy 12 q
• Explanation refers explicitly to neutralization (or equivalent), but the specific reaction is not Iran, Islamic Republic of 12 q
mentioned. Serbia and Montenegro 12 q
Examples: When you mix acid and alkali, the mixture becomes neutral and has a pH of 7. Lebanon 9 q
The HCl neutralizes the NaOH, and the NaOH neutralizes the HCl. Chile 7 q
The mixed solution is neutral, so litmus paper does not react. Netherlands 7 q
Acid + base = neutral solution Belgium (Flemish) 5 q
There is a neutralization reaction. Ghana 4 q
• Explanation refers to a chemical reaction taking place (implicitly or explicitly) to form products Morocco 4 q
that do not react with litmus paper (or similar). [Neutralization is not explicitly mentioned.] Philippines 3 q
Examples: The acid and base react, and the new chemicals do not react with litmus paper. South Africa 3 q
The chemicals that change the litmus paper must have a chemical reaction to each other. Indonesia 3 q
Therefore they will not change the color of the paper anymore. Saudi Arabia 2 q
They form a new solution that has different properties and doesn’t react with litmus. Tunisia 2 q
• Other correct. Botswana 2 q
Incorrect Response
• Mentions only that acid and base are “balanced”, “opposites”, “cancel each other”, or similar. Country average vs.
Examples: The acid and base are opposites and counteract so they cancel each other out. International average:
The acid tries to turn it red and the base just turns it blue again at the same time. Higher p
Because they’re balanced out and equal. Not different O
• Other incorrect (including crossed out/erased, stray marks, illegible, or off task). Lower q
75
Litmus test (continued)

Item Number: S032057
Student Responses
Correct Response:
Incorrect Response:
76
Chemistry Chemical Change Conceptual Understanding
Fanning a wood fire Overall Percent Correct
Japan 94 p
Fanning can make a wood fire burn hotter because the fanning Sweden 93 p
Hungary 91 p
a makes the wood hot enough to burn Hong Kong, SAR 90 p
adds more oxygen needed for burning Chinese Taipei 88 p
b Netherlands 87 p
c increases the amount of wood there is to burn Estonia 86 p
Norway 85 p
d provides the energy needed to keep the fire going
New Zealand 84 p
Australia 84 p
England 83 p
Italy 83 p
Scotland 82 p
S012003
Russian Federation 82 p
Belgium (Flemish) 82 p
Singapore 81 p
United States 80 p
Bulgaria 80 p
Latvia 79 p
Malaysia 78 p
Slovak Republic 78 p
Israel 76 p
Slovenia 76 p
Romania 73 O
Lithuania 72 O
International average 70 O
Iran, Islamic Republic of 66 O
Serbia and Montenegro 64 q
Jordan 64 q
Cyprus 62 q
Chile 60 q
Armenia 58 q
Item Number: S012003 Indonesia 57 q
Bahrain 56 q
Palestinian Nat’l Auth. 55 q
Egypt 53 q
Morocco 50 q
Tunisia 49 q
Lebanon 46 q
Saudi Arabia 43 q
Ghana 38 q
Philippines 35 q
Botswana 34 q
Correct Response: B South Africa 33 q
Country average vs.

Higher p
Not different O
Lower q
77
Reactions releasing energy Overall Percent Correct
Chinese Taipei 77 p
Some chemical reactions absorb energy, while others release energy. Of the Hong Kong, SAR 74 p
chemical reactions in burning coal and exploding fireworks, which will Singapore 68 p
release energy? Scotland 65 p
United States 65 p
a Burning coal only Estonia 64 p
Exploding fireworks only England 62 p
b Tunisia 61 p
c Both burning coal and exploding fireworks Palestinian Nat’l Auth. 59 p
Israel 59 p
d Neither burning coal nor exploding fireworks
Iran, Islamic Republic of 59 p
Malaysia 58 p
S022188
Australia 57 p
Cyprus 57 p
New Zealand 56 O
Chile 56 p
Philippines 55 p
Jordan 54 O
Hungary 53 O
Latvia 53 O
Sweden 51 O
Slovenia 50 O
Egypt 50 O
Norway 49 O
Lithuania 49 O
Romania 47 q
Ghana 47 q
Belgium (Flemish) 47 q
Lebanon 47 O
Italy 47 q
Armenia 46 q
Item Number: S022188 Saudi Arabia 45 q
Bahrain 44 q
Moldova, Rep. of 44 q
Netherlands 42 q
Botswana 42 q
Japan 41 q
Indonesia 40 q
Korea, Republic of 38 q
South Africa 36 q
Bulgaria 36 q
Correct Response: C Morocco 35 q
Country average vs.

Higher p
Not different O
Lower q
78
Chemical change involving elements Overall Percent Correct
Chinese Taipei 73 p
Which is a chemical change? Singapore 60 p
Hong Kong, SAR 52 p
a Element 1 is polished to form a smooth surface. Malaysia 51 p
Element 2 is heated and evaporates. Hungary 48 p
b Jordan 47 p
c Element 3 develops a white, powdery surface after standing in air. Iran, Islamic Republic of 47 p
Element 4 is separated from a mixture by filtration. England 46 p
d Japan 45 p
Netherlands 43 p
Palestinian Nat’l Auth. 41 p
Armenia 40 p
S022198
Bulgaria 39 O
Australia 39 p
Slovenia 36 O
New Zealand 34 O
Italy 34 O
Scotland 33 O
United States 33 O
Estonia 32 O
Cyprus 32 O
Israel 30 q
Tunisia 30 q
Lebanon 30 q
Norway 29 q
South Africa 28 q
Philippines 28 q
Egypt 28 q
Item Number: S022198 Botswana 27 q
Latvia 27 q
Bahrain 25 q
Romania 24 q
Indonesia 24 q
Saudi Arabia 22 q
Sweden 22 q
Slovak Republic 21 q
Ghana 19 q
Lithuania 19 q
Morocco 15 q
Correct Response: C Chile 15 q
Country average vs.

Higher p
Not different O
Lower q
79
Chemistry Chemical Change Reasoning and Analysis
Candles burning in 3 jars Overall Percent Correct
Netherlands 82 p
Estonia 79 p
Sweden 78 p
Singapore 78 p
Lithuania 75 p
Hungary 72 p
Norway 72 p
Japan 69 p
England 66 p
Italy 64 p
Hong Kong, SAR 62 p
X Y Z Slovenia 62 p
Three identical candles are placed in the three jars shown above and lit at Chinese Taipei 60 p
Israel 58 p
the same time. Jars Y and Z are then sealed with lids, and Jar X is left
Latvia 57 p
open.
Australia 57 p
Which candle flame will go out first (X, Y, or Z)? _______________
Scotland 54 p
New Zealand 53 p
Explain your answer. United States 48 O
Serbia and Montenegro 48 O
Malaysia 45 O
Macedonia, Republic of 44 O
Lebanon 44 O
Bulgaria 43 O
Cyprus 43 q
Romania 42 q
Tunisia 41 q
Jordan 38 q
Egypt 34 q
Chile 32 q
S022191
Bahrain 31 q
Armenia 30 q
Morocco 28 q
Item Number: S022191 Palestinian Nat’l Auth. 27 q
Saudi Arabia 23 q
SCORING Iran, Islamic Republic of 20 q
Note: For full credit, responses must identify Z and include an explanation that explicitly mentions the Indonesia 12 q
need for oxygen (for combustion or burning). Responses may also mention that the supply runs out South Africa 9 q
faster in the smaller sealed jar, but it is not required for full credit. Responses referring to the need for Philippines 5 q
air (explicitly or using non-scientific language) are given partial credit. Responses mentioning only
Botswana 3 q
smoke (fumes, carbon dioxide, etc.) build-up or heat should be scored as incorrect.
Ghana 1 q
Correct Response
• Z. Explanation refers to the need for oxygen (for burning).
Country average vs.
Examples: Z. The flame in the smaller jar will go out first since it has the least oxygen in it. International average:
Z. Oxygen is needed for the candle to burn.
Z. It has less oxygen. Higher p
Not different O
• Other fully correct. Lower q
80
Candles burning in 3 jars (continued)

SCORING (continued)
Partially Correct Response
• Z. Explanation refers to lack of air (gas) explicitly or using non-scientific language
(e.g. suffocation, smothering, choking, etc.). (No explicit mention of oxygen.)
Examples: Z. The flame in the smallest jar will be suffocated first.
Z. It does not have enough air to breath.
Since Z is the smallest jar, it will have less air in order to burn.
Z. It gets smothered as the carbon dioxide increases.
• Indicates both Y AND Z (Y, Z; Y or Z; Y/Z etc.). Explanation based on the need for oxygen or air.
Examples: Y and Z. The flame needs oxygen for it to burn, and both of these jars will run out of it.
Y, Z. The closed jars do not get any air.
Y or Z. They do not get any oxygen.
Incorrect Response
• Z with no explanation or an incorrect explanation.
Examples: Z. This jar will have the smallest flame since it is in the smallest jar.
Z. The smoke cannot escape, so the flame dies.
Z. The carbon dioxide level builds up too much.
Z. The candle wants to let off heat, so it bursts.
• X. Explanation based on the candle being blown out (or similar).
Examples: X. A person walking past the candle might cause it to blow out.
X. If the jar is not closed, it goes out from the wind.
• X OR Y with no explanation or any other incorrect explanation.
81

Student Responses
Correct Response:
82

Student Responses (continued)

Partial Response:
83


Incorrect Response:
84
Classification
Chemistry Conceptual Understanding
and Composition of Matter
NOT a mixture Overall Percent Correct
Chinese Taipei 64 p
Which of the following is NOT a mixture? Sweden 58 p
Estonia 57 p
a Smoke Jordan 56 p
Sugar Netherlands 56 p
b Korea, Republic of 56 p
c Milk Singapore 55 p
d Paint
Hungary 51 p
Slovenia 51 p
Australia 50 p
New Zealand 49 p
S022187
Norway 49 p
Japan 48 p
Israel 47 p
United States 46 p
Lithuania 45 p
England 45 p
Italy 43 O
Scotland 40 O
Bahrain 39 O
Bulgaria 37 O
Saudi Arabia 36 q
Latvia 35 q
Lebanon 35 q
Hong Kong, SAR 34 q
Malaysia 34 q
Armenia 33 q
Romania 33 q
Iran, Islamic Republic of 30 q
Tunisia 29 q
Cyprus 28 q
Morocco 27 q
Chile 26 q
Egypt 25 q
Philippines 18 q
Ghana 16 q
Botswana 16 q
Country average vs.

Higher p
Not different O
Lower q
85
Classification
Solution half as concentrated Overall Percent Correct
Latvia 55 p
David makes a solution by dissolving 10 grams of salt in 100 ml of water. He Hungary 50 p
wants a solution that is half as concentrated. What should he add to the Estonia 50 p
original solution to obtain a solution that is about half as concentrated? Lithuania 46 p
Chinese Taipei 46 p
a 50 ml of water Japan 46 p
Hong Kong, SAR 46 p
b 100 ml of water
c 5 grams of salt Sweden 42 p
d 10 grams of salt
Moldova, Rep. of 40 p
Singapore 40 p
S032564
Bulgaria 38 p
Netherlands 38 p
Slovenia 35 p
Australia 33 O
England 32 O
New Zealand 32 O
Romania 31 O
Norway 30 O
Italy 29 O
Scotland 27 O
United States 26 q
South Africa 25 q
Israel 24 q
Egypt 23 q
Cyprus 22 q
Bahrain 21 q
Lebanon 21 q
Item Number: S032564 Malaysia 18 q
Ghana 18 q
Philippines 18 q
Saudi Arabia 17 q
Morocco 16 q
Botswana 15 q
Indonesia 14 q
Chile 13 q
Tunisia 13 q
Armenia 12 q
Correct Response: B Jordan 0 q
Country average vs.

Higher p
Not different O
Lower q
86
Classification
Which substances are elements Overall Percent Correct
Oxygen, hydrogen, and water are substances. Chinese Taipei 75 p
Which of these substances are elements? Estonia 73 p
Hungary 71 p
a oxygen, hydrogen and water Singapore 67 p
b oxygen and hydrogen only
Serbia and Montenegro 66 p
c oxygen only Slovenia 66 p
Israel 64 p
d water only
Japan 64 p
Lithuania 64 p
Latvia 64 p
Macedonia, Republic of 60 p
Armenia 58 p
Sweden 57 p
New Zealand 54 O
United States 54 p
Romania 53 O
S032574
Morocco 50 O
Bulgaria 48 O
Jordan 48 O
England 45 O
Ghana 45 O
Cyprus 45 O
Malaysia 43 q
Australia 42 q
Scotland 40 q
Hong Kong, SAR 38 q
Italy 38 q
Egypt 37 q
Philippines 37 q
Bahrain 36 q
Netherlands 35 q
Chile 32 q
Indonesia 32 q
South Africa 31 q
Norway 31 q
Lebanon 29 q
Saudi Arabia 28 q
Correct Response: B Tunisia 0 q
Country average vs.

Higher p
Not different O
Lower q
87
Classification
Metal crown: density of metal block Overall Percent Correct
Singapore 64 p
The scientists decided to compare the densities of the crown and a block of Hong Kong, SAR 53 p
metal just like the original block. The density of a substance is the mass Japan 47 p
of a sample of the substance divided by its volume (density = mass/volume). Chinese Taipei 43 p
Hungary 40 p
The scientists found the volume of the block and computed its density based Armenia 40 p
on its known mass (2,400 g). The diagram below shows the dimensions of the Lithuania 39 p
block of metal that the scientists measured. Estonia 38 p
5 cm
Italy 30 p
(not to scale)
Latvia 28 p
5 cm Netherlands 28 p
5 cm
England 26 O
Sweden 26 p
United States 25 p
Slovenia 23 O
What is the density of the block of metal? Moldova, Rep. of 23 O
Romania 22 O
Answer: ____________ g/cm
3 International average 21 O
Australia 20 O
Scotland 20 O
Malaysia 18 q
New Zealand 17 O
Jordan 17 q
Israel 16 q
Bulgaria 11 q
Cyprus 10 q
Bahrain 10 q
Norway 10 q
Egypt 9 q
Lebanon 9 q
Item Number: S032709 Chile 6 q
Botswana 6 q
SCORING Indonesia 6 q
Correct Response Philippines 5 q
Tunisia 5 q
• 19.2 g/cm3
Morocco 4 q
• 19 g/cm3 [Rounds to nearest whole unit.] Iran, Islamic Republic of 2 q
S032709
Incorrect Response South Africa 2 q

• Shows the set-up for density (mass/volume) but does notfor
Questions compute densitycontinue.
Metal Crown Saudi Arabia 1 q
or makes a computational error. Ghana 1 q
• 125 [Computes volume but not density.]
• 19.3 [No work shown ; indicates density copied from table.] Country average vs.
• Other incorrect (including crossed out/erased, stray marks, illegible or off task). International average:
Higher p
Not different O
Lower q
88
Metal crown: density of metal block (continued)

Student Responses
Correct Response:
89
Metal crown: density of metal block (continued)


Incorrect Response:
90
Classification
Chemistry Factual Knowledge
Substance type of black/white powder Overall Percent Correct
Lithuania 92 p
A powder made up of both white specks and black specks is likely to be Hungary 90 p
Estonia 90 p
a a solution Slovenia 88 p
b a pure compound
Latvia 84 p
c a mixture Netherlands 84 p
Sweden 84 p
d an element
Japan 83 p
Bulgaria 82 p
United States 82 p
Romania 81 p
Singapore 80 p
S012016
Israel 79 p
Chinese Taipei 79 p
England 77 p
Australia 77 p
Hong Kong, SAR 75 p
Armenia 74 O
Italy 70 O
New Zealand 70 O
Malaysia 69 O
Scotland 68 O
Tunisia 67 q
Jordan 67 q
Norway 65 q
Chile 65 q
Egypt 63 q
Lebanon 63 q
Bahrain 63 q
Morocco 60 q
Saudi Arabia 59 q
Philippines 58 q
Cyprus 57 q
Ghana 52 q
Indonesia 50 q
Correct Response: C South Africa 48 q
Country average vs.

Higher p
Not different O
Lower q
91
Classification
Reaction of chlorine and sodium Overall Percent Correct
Bulgaria 68 p
When chlorine gas reacts with sodium metal, what type of substance is Cyprus 63 p
formed? Bahrain 60 p
Lithuania 59 p
a A mixture Chinese Taipei 59 p
A compound Slovenia 59 p
b Singapore 58 p
c An element Japan 56 p
Hungary 56 p
d An alloy
Estonia 55 p
e A solution Sweden 55 p
Armenia 55 p
Egypt 53 p
S022206
Latvia 51 p
Jordan 50 p
Lebanon 50 p
Israel 49 p
England 47 p
Scotland 47 p
United States 42 O
Italy 36 q
Saudi Arabia 35 q
New Zealand 34 q
Romania 33 q
Chile 33 q
Hong Kong, SAR 32 q
Malaysia 32 q
Item Number: S022206 Australia 32 q
Indonesia 30 q
Tunisia 28 q
Ghana 26 q
Philippines 23 q
South Africa 18 q
Botswana 13 q
Morocco 13 q
Netherlands 13 q
Correct Response: B Norway 11 q
Country average vs.

Higher p
Not different O
Lower q
92
Classification
Chemistry Reasoning and Analysis
Separation of salt/sand/iron filings mixture Overall Percent Correct
Singapore 68 p
Teresa is given a mixture of salt, sand, iron filings, and small pieces of cork. Chinese Taipei 67 p
She separates the mixture using a 4-step procedure as shown in the Japan 58 p
diagram. The letters W, X, Y, and Z are used to stand for the four Hong Kong, SAR 58 p
components but do not indicate which letter stands for which component. Estonia 56 p
Step 1: Uses a magnet W, X, Y, Z Hungary 51 p
Latvia 49 p
X, Y, Z W England 48 p
Scotland 48 p
Netherlands 47 p
Sweden 47 p
Step 2: Adds water and X, Y, Z Lithuania 47 p
removes the New Zealand 46 p
component
that floats Malaysia 46 p
Y, Z +
X Russian Federation 45 p
water
Australia 44 p
Armenia 42 p
Step 3: Filters Y, Z + Slovenia 41 O
water
Italy 39 O
United States 35 O
Z+
Y Jordan 35 O
water
Romania 35 O
Step 4: Evaporates water Z + water Israel 33 O
Norway 26 q
Lebanon 26 q
water Z Chile 26 q
Bahrain 23 q
Identify what each component is by writing salt, sand, iron, or cork in Egypt 22 q
the correct spaces below
. Bulgaria 21 q
Component W is: ______________________________ Serbia and Montenegro 20 q
Cyprus 19 q
Tunisia 15 q
Component X is: ______________________________ Saudi Arabia 14 q
Indonesia 12 q
Component Y is: ______________________________
Philippines 11 q
South Africa 8 q
S032562
Botswana 7 q
Component Z is: ______________________________
Morocco 6 q
Ghana 6 q

Country average vs.
Higher p
Not different O
Lower q
93
Separation of salt/sand/iron filings mixture (continued)

SCORING
Note: To receive full credit, responses must correctly identify all four components. Partial credit is given
for responses that list at least two components correctly. If a component is listed more than once, none
of the entries for that component will be considered as correct. For example, a response that lists Iron,
Salt, Salt, Salt is incorrect.
Correct Response
• Identifies all four components correctly: W = iron; X = cork; Y = sand; Z = salt.
• Identifies iron and cork correctly (W and X); sand and/or salt are missing or incorrect.
Examples: Iron, Cork, Salt, Sand
Iron, Cork, Sand, Blank
• Identifies iron and salt correctly (W and Z); cork and/or sand are missing or incorrect.
Examples: Iron, Sand, Cork, Salt
Iron, Blank, Blank, Salt
• Identifies sand and salt correctly (Y and Z); iron and/or cork are missing or incorrect.
Examples: Cork, Iron, Sand, Salt
Blank, Blank, Sand, Salt
Water, Cork, Sand, Salt
• Other partially correct (that identifies at least two components correctly).
Incorrect Response
• Identifies only iron correctly (W), all other components are missing or incorrect.
• Other incorrect (including crossed out/erased, stray marks, illegible or off task).
94

Student Responses
Correct Response:
95
Title Name Pulled

Separation from Item filings
of salt/sand/iron Here (continued)
mixture (continued)
M022002A

Partially Correct Response:
96


Incorrect Response:
97
Classification
Metal crown: what metal block was made of Overall Percent Correct
Hungary 37 p
The table below lists the density for different metals. Singapore 36 p
Japan 36 p
Chinese Taipei 29 p
Metal Density (g/cm3) United States 28 p
Platinum 21.4 Russian Federation 27 p
Estonia 27 p
Gold 19.3
Lithuania 26 p
Silver 10.5
Copper 8.9 Hong Kong, SAR 23 p
Zinc 7.1 England 23 p
Australia 22 p
Aluminum 2.7
Latvia 22 p
A. Look at the density you computed for the block of metal. What was the New Zealand 21 p
block of metal most likely made of? Netherlands 20 p
Sweden 18 O
Answer: ______________________________ Slovenia 18 O
Scotland 18 O
Explain your answer. Korea, Republic of 18 O
Jordan 16 O
Norway 16 O
Romania 14 O
Egypt 13 q
Armenia 13 q
Italy 12 q
Malaysia 12 q
3
B. The density of the crown was found to be 12.0 g/cm . What would you Israel 11 q
report to the king about what metal or mixture of metals the jeweler Macedonia, Republic of 11 q
used to make the crown? Palestinian Nat’l Auth. 11 q
Morocco 10 q
Bahrain 9 q
Bulgaria 8 q
Chile 8 q
Item Number: S032713A Cyprus 6 q
Lebanon 6 q
Indonesia 5 q
Philippines 4 q
Ghana 3 q
Botswana 2 q
South Africa 2 q
S032713
Tunisia 2 q
End of Metal Crown section. Iran, Islamic Republic of 1 q
Saudi Arabia 1 q
Country average vs.

Higher p
Not different O
Lower q
98
Metal crown: what metal block was made of (continued)

Item Number: S032713A
SCORING
Codes for Identifying Metal in Block
Note: To receive credit, responses must identify gold AND give an explanation based on density.
Responses that identify gold with no or incorrect explanation are incorrect. It is possible that a different
metal or metal(s) may be identified based on an incorrect density computation in the previous question.
These types of responses may scored as correct, provided the explanation is reasonable based on the
computed density.
Correct Response
• GOLD with an explanation based on correct density computed in previous question (19.2 g/cm3).
Examples: Gold. Because it had the closest density.
Gold. The density is the same.
• Other correct.
Incorrect Response
• GOLD with no explanation or incorrect explanation that is NOT based on density.
Examples: Gold. Because that is what crowns are always made of.
• SILVER (alone or mixed). [Confuses density of crown with density of the metal block.]
Examples: It is mostly silver because the density is 12 and that’s the closest one.
99
Metal crown: what metal block was made of (continued)

Student Responses
Correct Response:
Incorrect Response:
100
Classification
Metal crown: what crown was made of Overall Percent Correct
Chinese Taipei 25 p
The table below lists the density for different metals. Hong Kong, SAR 20 p
Singapore 20 p
Hungary 20 p
Metal Density (g/cm3) Korea, Republic of 19 p
Platinum 21.4 Slovenia 18 p
Estonia 15 p
Gold 19.3
Norway 13 p
Silver 10.5 Latvia 12 p
Copper 8.9 Sweden 12 p
Zinc 7.1 Slovak Republic 12 p
Jordan 11 p
Aluminum 2.7
United States 11 p
Netherlands 10 O
A. Look at the density you computed for the block of metal. What was the Russian Federation 10 O
Lithuania 10 O
block of metal most likely made of?
Armenia 10 O
Answer: ______________________________ New Zealand 9 O
Scotland 9 O
Explain your answer. Australia 9 O
Egypt 8 O
Romania 8 O
Malaysia 8 O
Cyprus 5 q
England 5 q
Israel 4 q
3
B. The density of the crown was found to be 12.0 g/cm . What would you Iran, Islamic Republic of 4 q
report to the king about what metal or mixture of metals the jeweler Lebanon 4 q
used to make the crown? Indonesia 4 q
Morocco 4 q
Bulgaria 4 q
Chile 3 q
Item Number: S032713B Bahrain 2 q
South Africa 2 q
Philippines 2 q
Japan 1 q
Saudi Arabia 1 q
Tunisia 1 q
Ghana 1 q
S032713
Botswana 1 q
End of Metal Crown section. Serbia and Montenegro 1 q
Italy 1 q
Country average vs.

Higher p
Not different O
Lower q
101
Metal crown: what crown was made of (continued)

Item Number: S032713B
SCORING
Codes for Reporting Composition of Crown
Note: To receive credit, responses must indicate that the crown is composed of a mixture of metals
(alloy) AND identify the metals that might be included based on the density (crown density between the
densities of the pure metals). Responses that indicate that the crown is made of a mixture (alloy) or is
not pure gold with no further information about what other metals are included are scored as incorrect.
If responses indicate that the crown is made of Palladium (not in the table but with a density of 12
g/cm3), they should be scored as correct.
Correct Response
• Reports that the crown is made of a mixture (alloy) AND names specific metal(s) that might be
included (reasonable composition based on density).
Examples: The jeweler used some silver as well as gold.
It might have had some copper mixed in because that would lower the density and the
cost.
The jeweler most likely used all silver except for a thin coat of gold to make it look pure
gold even though it wasn’t.
• Other correct.
Incorrect Response
• Reports only that the crown is made of a mixture or is NOT pure gold (or similar); NO specific
metals are named.
Examples: The jeweler didn’t use the block of metal that the king gave him.
The jeweler used four more metals to make the crown.
• Reports SILVER (density closest to 12 g/cm3).
Examples: The metal used is silver.
• Reports an incorrect mixture of metals based on additive densities.
Examples: It’s silver and aluminum (10.5 + 2.7)
Mixture of silver and aluminum as their density adds up to 12.0 approximately.
Copper and aluminum.
102
Metal crown: what crown was made of (continued)

Student Responses
Correct Response:
Incorrect Response:
103
Particulate Structure
of Matter
Atoms removed from chair Overall Percent Correct
Lithuania 78 p
If you took all of the atoms out of a chair, what would be left? Sweden 73 p
Singapore 69 p
a The chair would still be there, but it would weigh less. Estonia 68 p
The chair would be exactly the same as it was before. United States 68 p
b Hungary 67 p
c There would be nothing left of the chair. Korea, Republic of 66 p
Japan 65 p
d Only a pool of liquid would be left on the floor.
England 64 p
Armenia 64 p
Latvia 62 p
Slovenia 62 p
S012040
Israel 60 p
Australia 59 p
New Zealand 55 O
Scotland 55 O
Norway 54 O
Italy 53 O
Chinese Taipei 52 O
Bahrain 51 O
Romania 51 O
Netherlands 50 O
Bulgaria 48 O
Jordan 47 O
Hong Kong, SAR 47 O
Egypt 46 q
Chile 46 q
Cyprus 45 q
Item Number: S012040 Lebanon 44 q
Saudi Arabia 43 q
Botswana 42 q
South Africa 35 q
Ghana 33 q
Tunisia 30 q
Malaysia 30 q
Morocco 29 q
Philippines 24 q
Correct Response: C Indonesia 13 q
Country average vs.

Higher p
Not different O
Lower q
104
of Matter
Particles in nucleus of atom Overall Percent Correct
The nucleus of MOST atoms consists of Slovak Republic 71 p
Estonia 69 p
a neutrons only Serbia and Montenegro 68 p
Slovenia 67 p
b protons and neutrons
Armenia 66 p
c protons and electrons Singapore 65 p
Chinese Taipei 63 p
d neutrons and electrons
Romania 61 p
Egypt 57 p
United States 57 p
Lithuania 56 p
S012025
Lebanon 55 p
Bulgaria 51 O
New Zealand 48 O
Hungary 47 O
Italy 46 O
Jordan 46 O
Israel 45 O
Bahrain 45 O
Indonesia 44 O
England 43 O
Philippines 42 q
Chile 42 q
Australia 41 q
Tunisia 40 q
Ghana 40 q
Cyprus 39 q
Japan 37 q
Item Number: S012025 Latvia 36 q
Netherlands 35 q
Saudi Arabia 34 q
Sweden 32 q
Norway 32 q
Scotland 32 q
Morocco 31 q
Hong Kong, SAR 31 q
Botswana 30 q
Malaysia 28 q
Country average vs.

Higher p
Not different O
Lower q
105
of Matter
Neutral atom gains electron Overall Percent Correct
Singapore 79 p
What is formed when a neutral atom gains an electron? Bahrain 73 p
Estonia 72 p
a A mixture Slovak Republic 71 p
Armenia 71 p
b An ion
Lithuania 71 p
c A molecule Hungary 71 p
Slovenia 69 p
d A metal
Lebanon 69 p
Israel 64 p
Egypt 61 p
S022202

Sweden 60 p
Romania 60 p
Chile 58 p
Jordan 58 p
Bulgaria 56 p
Chinese Taipei 54 p
Hong Kong, SAR 51 O
Ghana 50 O
Latvia 49 O
Italy 49 O
Japan 48 O
United States 46 O
Saudi Arabia 40 q
England 32 q
Australia 30 q
Netherlands 29 q
Philippines 28 q
Item Number: S022202 Malaysia 27 q
Scotland 26 q
New Zealand 24 q
Morocco 22 q
Cyprus 22 q
Norway 22 q
Botswana 19 q
Tunisia 19 q
South Africa 18 q
Correct Response: B Indonesia 18 q
Country average vs.

Higher p
Not different O
Lower q
106
Earth in the Solar System

Earth Science Conceptual Understanding
and Universe
Appearance of Jupiter and Moon Overall Percent Correct
England 92 p
The planet Jupiter is bigger than Earth’s moon but it appears to be smaller Netherlands 88 p
when viewed from Earth. Why is this? Estonia 86 p
Australia 86 p
New Zealand 86 p
United States 85 p
Norway 83 p
Scotland 83 p
Sweden 81 p
Singapore 81 p
Hungary 77 p
Italy 76 p
Hong Kong, SAR 76 p
Japan 75 p
Latvia 75 p
Slovenia 74 p
S022283
Armenia 72 p
Lithuania 72 p
Malaysia 70 p
Chinese Taipei 67 O
Jordan 66 O
Item Number: S022283 Indonesia 66 O
Israel 66 O
SCORING Palestinian Nat’l Auth. 64 O
Note: A correct response is based on the relative distances of Jupiter and the Moon from Earth. An Bulgaria 64 O
implicit comparison is correct as long as it is clear from the student response that a greater distance
from Jupiter is implied. Actual distances may be used to convey the relative difference. The distances
do not have to be completely accurate as long as the relative distances are correct. Responses that Bahrain 62 O
mention ONLY the great distance of Jupiter OR the close distance of the Moon without comparative Cyprus 61 O
language are also scored as correct. Serbia and Montenegro 56 q
Correct Response Chile 55 q
Tunisia 52 q
• Refers to the greater distance of Jupiter and/or the shorter distance of the Moon (from Earth),
implicitly or explicitly. Macedonia, Republic of 47 q
Examples: Jupiter is farther away from Earth than the Moon. Romania 45 q
The Moon is much closer than Jupiter. Egypt 42 q
Jupiter is farther. Saudi Arabia 41 q
It (Jupiter) is a long distance from Earth. Morocco 40 q
Because Jupiter is so far away. Philippines 39 q
The Moon is so close to the Earth that it looks bigger. Lebanon 35 q
• Other correct. Botswana 18 q
South Africa 13 q
Incorrect Response Ghana 8 q
• Refers to distance but explanation does not clearly communicate the effect of Jupiter’s or the
Moon’s distance on the appearance of size.
Examples: Because of distance. Country average vs.
Jupiter’s moons are closer. International average:
• Refers to the Moon being further, or Jupiter being closer to Earth. Higher p
Not different O
107
Appearance of Jupiter and Moon (continued)

Student Responses
Correct Response:
Incorrect Response:
108

and Universe
Why the moon changes shape Overall Percent Correct
Hong Kong, SAR 72 p

The shape of the moon appears to change regularly during each month. Malaysia 63 p
Which of the following best explains why the shape of the moon appears to Japan 58 p
change? Singapore 58 p
New Zealand 58 p
a The Earth turns on its axis. Korea, Republic of 58 p
Chinese Taipei 57 p
b The Moon turns on its axis.
Norway 56 p
c The Moon orbits around the Earth. Hungary 55 p
Estonia 54 p
d Clouds cover the Moon.
Australia 54 O
Bahrain 53 O
S032437
Sweden 53 O
Chile 53 O
Bulgaria 53 O
Scotland 53 O
Philippines 53 O
England 52 O
Egypt 52 O
United States 51 O
Armenia 51 O
Lithuania 51 O
Lebanon 50 O
Italy 49 O
Jordan 49 O
Netherlands 48 O
Israel 47 O
Slovenia 47 O
Saudi Arabia 47 O
Russian Federation 45 q
Ghana 44 q
Cyprus 43 q
Romania 43 q
South Africa 41 q
Morocco 40 q
Botswana 39 q
Tunisia 37 q
Correct Response: C Indonesia 31 q
Country average vs.

Higher p
Not different O
Lower q
109

and Universe
Position of the moon during solar eclipse Overall Percent Correct
Armenia 93 p
Draw the position of the Moon on the diagram below to show what is meant Malaysia 79 p
by an eclipse of the Sun. Hong Kong, SAR 76 p
Singapore 70 p
New Zealand 69 p
Australia 68 p
Estonia 66 p
Sun United States 66 p
Earth
England 64 p
Netherlands 63 p
Sweden 63 p
Chinese Taipei 62 p
Japan 61 p
S032532

Italy 61 p
Latvia 60 p
Hungary 59 O
Jordan 58 O
Bulgaria 58 O
Scotland 56 O
Indonesia 56 O
Israel 55 O
Norway 54 O
Slovenia 52 O
Bahrain 52 O
Romania 49 O
Saudi Arabia 46 q
Philippines 44 q
Cyprus 43 q
Egypt 42 q
Lithuania 40 q
SCORING Moldova, Rep. of 35 q
Note: To receive credit, the Moon should be located between the Earth and the Sun within the shaded Lebanon 33 q
region shown in the diagram below. Responses may also show the shadow cast by the Moon Macedonia, Republic of 33 q
on Earth. Credit should be given for responses based on the correct position of the Moon even if Tunisia 32 q
incorrect shadows are shown. Because it is not explicitly required in the item, errors in the relative Morocco 22 q
size or distance of the moon will not be considered.
Ghana 19 q
Correct Response Botswana 17 q
• Moon is located between the Sun and Earth within the shaded region. South Africa 17 q
Incorrect Response
• Moon is drawn on the other side of Earth (lunar eclipse). Country average vs.
• Moon is drawn overlapping the Sun (concentric or partially “eclipsed” circles).
Higher p
Not different O
Lower q
110
Position of the moon during solar eclipse (continued)

Student Responses
Correct Response:
Incorrect Response:
111

and Universe
Direction dropped ball will fall Overall Percent Correct
Japan 92 p
Estonia 91 p
Hungary 88 p
Sweden 87 p
Netherlands 87 p
Malaysia 86 p
Chinese Taipei 86 p
Norway 84 p
Slovenia 83 p
Lithuania 81 p
New Zealand 81 p
Hong Kong, SAR 81 p
Latvia 80 p
Singapore 80 p
The diagram above shows a person holding a ball standing at three
different places on Earth. If the person drops the ball, gravity will make
Australia 79 p
it fall.
Which of the following diagrams best shows the direction the dropped ball England 78 p
will fall at the three different positions? Belgium (Flemish) 77 p
United States 75 p
Scotland 73 O
Armenia 72 O
Lebanon 72 O
Italy 71 O
Romania 70 O
a b Bahrain 67 O
Jordan 66 O
Israel 65 O
Philippines 65 q
Indonesia 62 q
Bulgaria 61 q
Botswana 61 q
Saudi Arabia 61 q
Chile 58 q
c d Cyprus 58 q
Egypt 51 q
S032714
Tunisia 47 q
Ghana 43 q
Item Number: S032714 South Africa 40 q
Morocco 6 q
Country average vs.

Higher p
Correct Response: D Not different
Lower
O
q
112

Earth Science Factual Knowledge
and Universe
Sun is an example of a star Overall Percent Correct
Italy 90 p
The Sun is an example of which of the following? New Zealand 87 p
a comet Sweden 86 p
United States 84 p
b planet
Australia 83 p
c galaxy Chile 83 p
Bulgaria 83 p
d star
England 82 p
Norway 80 p
Scotland 79 p
Lithuania 79 p
S032150
Latvia 78 p
Estonia 75 p
Slovenia 74 p
Netherlands 65 p
Hong Kong, SAR 65 p
Jordan 61 O
Romania 60 O
Bahrain 60 O
Philippines 59 O
Hungary 58 O
Singapore 56 q
Malaysia 54 q
Chinese Taipei 54 q
Egypt 51 q
Armenia 48 q
Cyprus 43 q
Botswana 41 q
South Africa 41 q
Indonesia 40 q
Japan 37 q
Saudi Arabia 33 q
Ghana 33 q
Morocco 29 q
Israel 26 q
Correct Response: D Tunisia 9 q
Country average vs.

Higher p
Not different O
Lower q
113

Earth Science Reasoning and Analysis
and Universe
The surface temperatures of Venus and Mercury Overall Percent Correct
The table shows some information about the planets Venus and Mercury. Hong Kong, SAR 69 p
Chinese Taipei 69 p
Singapore 60 p
Time to
Average Mean Distance Revolve Around
United States 49 p
Surface Atmospheric from the Sun the Sun Australia 48 p
Temperature (°C) Composition (millions of km) (Number of Days) Japan 47 p
Egypt 46 p
Venus 470 Mostly 108 225
Sweden 46 p
Carbon Dioxide
New Zealand 45 p
Mercury 300 Trace amounts 58 88
of gases England 44 p
Lithuania 44 p
Estonia 43 p
Which of the following best explains why the surface temperature of Venus Israel 41 p
is higher than that of Mercury? Hungary 41 p
Scotland 40 O
There is less absorption of sunlight on Mercury because of the lack of Slovenia 39 O
a Latvia 38 O
atmospheric gases.
Italy 38 O
b The high percentage of carbon dioxide in the atmosphere of Venus Netherlands 38 O
causes a greenhouse effect. Slovak Republic 38 O
c The longer time for Venus to revolve around the Sun allows it to
absorb more heat from the Sun.
d The Sun's rays are less direct on Mercury because it is closer to Serbia and Montenegro 34 O
the Sun. Norway 34 O
Bulgaria 33 O
S032301
Malaysia 31 q
Chile 30 q
Cyprus 30 q
Bahrain 28 q
Romania 28 q
Philippines 28 q
Item Number: S032301 Jordan 28 q
Botswana 24 q
Lebanon 24 q
South Africa 23 q
Ghana 22 q
Tunisia 19 q
Saudi Arabia 18 q
Indonesia 16 q
Morocco 16 q
Correct Response: B Armenia 15 q
Country average vs.

Higher p
Not different O
Lower q
114
Earth Processes, Cycles

and History
True statement of mountain age Overall Percent Correct

The pictures show two different mountains. The mountains in Picture A are Italy 58 p
rough and jagged. The mountains in Picture B are smooth and rounded. Macedonia, Republic of 55 p
Hungary 50 p
Lithuania 47 p
Estonia 44 p
Latvia 44 p
Romania 44 p
Armenia 43 p
Picture A Picture B Korea, Republic of 42 p
Slovenia 42 p
Sweden 41 p
Which statement about these mountains is probably true? Belgium (Flemish) 38 p
United States 36 p
a The mountains in Picture A are older. Bulgaria 35 p
Morocco 34 O
b The mountains in Picture B are older.
c The mountains are about the same age but were formed in different ways. Norway 32 O
d The mountains are about the same age but are in different hemispheres.
England 29 O
Netherlands 28 O
Australia 27 O
Scotland 25 q
Tunisia 24 q
Japan 22 q
Egypt 22 q
S012013
Chinese Taipei 21 q
Malaysia 21 q
Hong Kong, SAR 20 q
Jordan 19 q
Lebanon 19 q
Israel 19 q
Item Number: S012013 New Zealand 18 q
Philippines 14 q
South Africa 14 q
Cyprus 13 q
Bahrain 13 q
Singapore 12 q
Ghana 12 q
Chile 11 q
Indonesia 7 q
Saudi Arabia 5 q
Correct Response: B Botswana 0 q
Country average vs.

Higher p
Not different O
Lower q
115

and History
Pacific Ring of Fire Overall Percent Correct
Sweden 82 p
Hong Kong, SAR 77 p
England 77 p
Scotland 75 p
Lithuania 75 p
Japan 74 p
Latvia 71 p
United States 71 p
Chinese Taipei 70 p
Italy 70 p
Estonia 69 p
New Zealand 64 p
Australia 64 p
Netherlands 63 p
Singapore 63 p
Slovenia 62 p
Romania 62 p
The diagram above shows the Pacific Ring of Fire. Earthquakes and Norway 60 p
volcanic activity occur along the Ring of Fire. Which of the following best Bulgaria 56 p
explains why? Cyprus 54 p
Hungary 54 p
a It is located at the boundaries of tectonic plates. Moldova, Rep. of 53 p
It is located at the boundary of deep and shallow water. Iran, Islamic Republic of 52 p
b International average 48 O
c It is located where the major ocean currents meet. Chile 44 q
Israel 42 q
d It is located where ocean temperature is the highest.
Armenia 42 q
Philippines 34 q
Indonesia 33 q
S032656
Item Number: S032656 Jordan 20 q

Morocco 20 q
Malaysia 18 q
Bahrain 17 q
Saudi Arabia 16 q
Tunisia 15 q
Egypt 14 q
Lebanon 13 q
Ghana 11 q
Botswana 10 q
Correct Response: A South Africa 10 q
Country average vs.

Higher p
Not different O
Lower q
116

and History
Substance NOT a fossil fuel Overall Percent Correct
Lithuania 87 p
Which is NOT a fossil fuel? Chinese Taipei 87 p
Malaysia 86 p
a Coal Bahrain 83 p
Bulgaria 83 p
b Oil
Singapore 82 p
c Wood Jordan 77 p
Netherlands 76 p
d Natural gas
Estonia 74 p
Armenia 71 p
United States 70 p
S012018
Japan 67 p
Hong Kong, SAR 67 p
Indonesia 67 p
England 64 O
Scotland 64 O
Italy 62 O
Slovenia 61 O
Botswana 61 O
Egypt 60 O
Romania 59 O
Tunisia 58 O
Australia 57 O
Philippines 57 q
Latvia 56 q
Lebanon 55 q
Chile 55 q
Item Number: S012018 Sweden 54 q
New Zealand 53 q
Saudi Arabia 52 q
Israel 52 q
Morocco 46 q
Norway 36 q
Ghana 36 q
Cyprus 35 q
South Africa 33 q
Correct Response: C Hungary 25 q
Country average vs.

Higher p
Not different O
Lower q
117

and History
Rock at bottom of lake/ocean Overall Percent Correct
Lithuania 89 p
The graph shows the progress made by a beetle moving along a straight Hungary 88 p
line. Korea, Republic of 85 p
Hong Kong, SAR 85 p
Estonia 85 p
Chinese Taipei 80 p
Tunisia 74 p
14 Japan 74 p
England 71 p
12 Latvia 70 p
Armenia 70 p
Morocco 68 p
10
Israel 65 p
Distance (cm)
Singapore 65 p
8 Russian Federation 65 p
Jordan 65 p
6 Bahrain 64 p
United States 60 p
4
Italy 56 O
2 Philippines 52 O
Australia 52 O
0
5 10 15 20 25 30 Saudi Arabia 51 O
Time (seconds) Egypt 50 O
Slovenia 47 q
If the beetle keeps moving at the same speed, how long will it take to Serbia and Montenegro 44 q
travel 10 cm? Scotland 44 q
Netherlands 43 q
a 4 seconds Romania 43 q
Cyprus 41 q
b 6 seconds
Malaysia 41 q
c 20 seconds Lebanon 40 q
Bulgaria 39 q
d 25 seconds
S022041
New Zealand 37 q
Botswana 36 q
Sweden 34 q
Item Number: S012041 Ghana 34 q
Norway 28 q
Indonesia 27 q
South Africa 22 q
Correct Response: C Chile 18 q
Country average vs.

Higher p
Not different O
Lower q
118

and History
Fossil fuels Overall Percent Correct
Jordan 82 p
Fossil fuels were formed from Singapore 81 p
Chinese Taipei 79 p
a volcanoes Hong Kong, SAR 77 p
the remains of living things England 71 p
b Indonesia 69 p
c gases in the atmosphere Iran, Islamic Republic of 67 p
d water trapped inside rocks
United States 65 p
Estonia 64 p
Botswana 61 p
Italy 57 p
S022074
Hungary 57 p
Sweden 57 p
Scotland 56 O
Lithuania 56 p
Slovenia 54 O
Bulgaria 53 O
Romania 53 O
Norway 52 O
Armenia 51 O
Japan 51 O
Netherlands 51 O
Egypt 50 O
New Zealand 46 O
Australia 46 q
Israel 45 q
Malaysia 45 q
Latvia 44 q
Item Number: S022074 Russian Federation 43 q
Lebanon 42 q
Philippines 41 q
Bahrain 39 q
Chile 35 q
Saudi Arabia 26 q
Tunisia 22 q
South Africa 22 q
Cyprus 21 q
Ghana 19 q
Correct Response: B Morocco 0 q
Country average vs.

Higher p
Not different O
Lower q
119

and History
Time/temperature table Overall Percent Correct
Japan 96 p
The table gives the temperature at a certain place at different times of the Netherlands 93 p
day for three days. Hungary 93 p
Australia 92 p
Sweden 89 p
6 a.m. 9 a.m. 12 noon 3 p.m. 6 p.m. Singapore 89 p
Monday 15˚C 17˚C 20˚C 21˚C 19˚C
England 88 p
Tuesday 15˚C 15˚C 15˚C 5˚C 4˚C New Zealand 87 p
Wednesday 8˚C 10˚C 14˚C 14˚C 13˚C Korea, Republic of 87 p
Hong Kong, SAR 87 p
Chinese Taipei 87 p
Estonia 87 p
When did the wind become much colder? Malaysia 85 p
Slovenia 84 p
a Monday morning United States 84 p
Israel 83 p
b Monday afternoon
Italy 83 p
c Tuesday morning Scotland 82 p
d Tuesday afternoon
S012027
Latvia 82 p
Wednesday afternoon Bulgaria 79 p
e Slovak Republic 79 p
Cyprus 76 p
Lithuania 76 O
Chile 76 O
Norway 75 O
Romania 71 O
Jordan 69 O
Tunisia 69 q
Morocco 65 q
Item Number: S012027 Bahrain 63 q
Lebanon 57 q
Indonesia 44 q
Egypt 43 q
Armenia 39 q
Saudi Arabia 36 q
Botswana 35 q
Philippines 33 q
South Africa 26 q
Correct Response: D Ghana 0 q
Country average vs.

Higher p
Not different O
Lower q
120

and History
Map of the world with lines of latitude Overall Percent Correct
Estonia 73 p
Netherlands 70 p
D
60 N Hungary 68 p
Malaysia 67 p
X 30 N Chinese Taipei 65 p
B Equator
C Singapore 63 p
Sweden 61 p
A 30 S Slovenia 58 p
Italy 57 p
Australia 55 p
60 S
Latvia 53 p
England 53 O
The diagram above shows a map of the world with the lines of latitude United States 51 p
marked. Which of the following places marked on the map is most likely to Serbia and Montenegro 51 O
have an average yearly temperature similar to location X? Hong Kong, SAR 51 O
Japan 49 O
a location A Belgium (Flemish) 49 O
New Zealand 49 O
b location B
c location C Israel 48 O
Bulgaria 48 O
d location D
Indonesia 48 O
Romania 45 O
Jordan 45 O
Scotland 44 O
Bahrain 43 q
Norway 42 q
Cyprus 42 q
Lithuania 42 q
S032652

Philippines 39 q
Armenia 37 q
Saudi Arabia 35 q
Egypt 35 q
Lebanon 34 q
Morocco 30 q
Ghana 26 q
Botswana 25 q
South Africa 21 q
Correct Response: A Tunisia 20 q
Country average vs.

Higher p
Not different O
Lower q
121
Earth’s Structure
and Physical Features
Stone in underground caves Overall Percent Correct
Slovenia 91 p
Most underground caves are formed by the action of water on Slovak Republic 85 p
Hungary 85 p
a granite Korea, Republic of 78 p
Chinese Taipei 75 p
b limestone
c sandstone Cyprus 63 p
Netherlands 62 p
d shale
Bulgaria 58 p
Romania 58 p
Italy 57 p
Sweden 56 p
S012030
Malaysia 55 p
England 53 p
Lebanon 52 p
Singapore 47 O
Israel 46 O
Norway 45 O
United States 45 O
Estonia 44 O
Australia 41 q
Bahrain 40 q
New Zealand 40 q
Morocco 40 q
Scotland 38 q
Philippines 37 q
Chile 36 q
Ghana 36 q
Botswana 35 q
Jordan 32 q
Item Number: S012030 Iran, Islamic Republic of 31 q
Armenia 30 q
Egypt 30 q
Lithuania 29 q
Indonesia 28 q
Japan 26 q
Hong Kong, SAR 25 q
South Africa 24 q
Latvia 24 q
Saudi Arabia 17 q
Tunisia 6 q
Correct Response: B Palestinian Nat’l Auth. 0 q
Country average vs.

Higher p
Not different O
Lower q
122
Earth’s Structure
Abundance of gases in atmosphere Overall Percent Correct
Chinese Taipei 56 p
Three gases found in Earth’s atmosphere are carbon dioxide, nitrogen, and Hong Kong, SAR 56 p
oxygen. What is their order of abundance from greatest to least? Japan 49 p
Armenia 44 p
a nitrogen, oxygen, carbon dioxide Estonia 44 p
b nitrogen, carbon dioxide, oxygen
c oxygen, nitrogen, carbon dioxide Hungary 40 p
Singapore 39 p
d carbon dioxide, oxygen, nitrogen
Bulgaria 38 p
Malaysia 34 p
Romania 32 O
S022275
Slovenia 30 O
Israel 30 O
Scotland 29 O
Philippines 29 O
Egypt 28 O
England 27 O
Lithuania 27 O
Latvia 26 O
Indonesia 26 O
Italy 23 q
Ghana 23 q
Saudi Arabia 22 q
Jordan 21 q
Lebanon 21 q
United States 21 q
Netherlands 21 q
Norway 20 q
Item Number: S022275 New Zealand 20 q
Bahrain 19 q
Australia 19 q
Sweden 18 q
Botswana 18 q
Cyprus 17 q
Morocco 16 q
South Africa 15 q
Chile 11 q
Correct Response: A Tunisia 6 q
Country average vs.

Higher p
Not different O
Lower q
123
Earth’s Structure
Changes in river shape/speed Overall Percent Correct
Japan 84 p
A small, fast-moving river is in a V-shaped valley on the slope of a Russian Federation 79 p
mountain. If you follow the river to where it passes through a plain, what Estonia 79 p
will the river most likely look like compared with how it looked on the Netherlands 74 p
mountain? Chinese Taipei 73 p
Slovenia 73 p
a Much the same Slovak Republic 71 p
Hungary 71 p
b Deeper and faster
c Slower and wider Sweden 66 p
Latvia 65 p
d Straighter
Norway 65 p
Israel 63 p
S012006
Singapore 62 p
Romania 62 p
Australia 58 p
Italy 58 p
Malaysia 57 p
United States 57 p
England 57 p
Bulgaria 56 O
Scotland 52 O
Indonesia 52 O
New Zealand 50 O
Lithuania 50 O
Armenia 49 O
Hong Kong, SAR 48 q
Chile 44 q
Cyprus 37 q
Item Number: S012006 Morocco 37 q
Jordan 36 q
Tunisia 36 q
Philippines 33 q
Botswana 31 q
South Africa 26 q
Lebanon 26 q
Ghana 25 q
Bahrain 22 q
Egypt 22 q
Correct Response: C Saudi Arabia 15 q
Country average vs.

Higher p
Not different O
Lower q
124
Environmental
Changes in Environment Factual Knowledge
Science
Increased carbon dioxide in atmosphere Overall Percent Correct
Singapore 83 p
The burning of fossil fuels has increased the carbon dioxide content of the Japan 80 p
atmosphere. What is a possible effect that the increased amount of carbon Hong Kong, SAR 72 p
dioxide is likely to have on our planet? Netherlands 71 p
Malaysia 67 p
a A warmer climate Sweden 66 p
b A cooler climate
England 65 p
c Lower relative humidity Australia 64 p
Norway 62 p
d More ozone in the atmosphere
Chinese Taipei 62 p
Scotland 62 p
Estonia 58 p
S012017
United States 56 p
New Zealand 56 p
Hungary 56 p
Indonesia 52 p
Israel 51 p
Italy 48 O
Latvia 47 O
Slovenia 44 O
Bulgaria 43 O
Cyprus 42 O
Chile 40 q
Romania 40 q
Armenia 35 q
Lithuania 34 q
Philippines 32 q
Botswana 27 q
South Africa 23 q
Lebanon 21 q
Jordan 21 q
Ghana 21 q
Bahrain 18 q
Egypt 17 q
Tunisia 17 q
Correct Response: A Saudi Arabia 11 q
Country average vs.

Higher p
Not different O
Lower q
125
Environmental
Science
Main cause of acid rain Overall Percent Correct
Chinese Taipei 67 p
One of the main causes of acid rain is Singapore 61 p
Hong Kong, SAR 56 p
a Waste from nuclear power plants Malaysia 51 p
Spills from chemical manufacturing plants Lithuania 49 p
b Slovenia 47 p
c Gases from burning fossil fuels England 46 p
d Gases from aerosol spray cans
Bulgaria 40 p
Tunisia 39 p
Scotland 39 p
Japan 38 p
Jordan 38 p
S022240
Cyprus 37 p
Egypt 36 O
Botswana 35 O
Australia 35 O
United States 35 O
Armenia 34 O
Estonia 34 O
Latvia 32 O
Indonesia 31 O
Hungary 29 O
South Africa 29 q
Sweden 28 q
New Zealand 27 q
Saudi Arabia 27 q
Philippines 27 q
Ghana 26 q
Romania 25 q
Item Number: S022240 Netherlands 25 q
Bahrain 25 q
Chile 23 q
Lebanon 23 q
Israel 23 q
Italy 20 q
Norway 17 q
Correct Response: C Morocco 12 q
Country average vs.

Higher p
Not different O
Lower q
126
Environmental
Science
Activity to reduce air pollution in a city Overall Percent Correct
Which of these daily activities can most directly help reduce air pollution in Hong Kong, SAR 84 p
a city? Sweden 84 p
Singapore 81 p
a turning down the volume on the television Chinese Taipei 79 p
b using biodegradable materials
Netherlands 78 p
c using public transportation instead of driving New Zealand 76 p
Hungary 75 p
d recycling paper
England 75 p
Scotland 73 p
Australia 72 p
Norway 68 p
S032446

Italy 67 p
United States 63 p
Cyprus 61 p
Japan 58 O
Bahrain 57 O
Slovenia 56 O
Lithuania 56 O
Jordan 56 O
Malaysia 53 O
Estonia 52 O
Latvia 51 O
Lebanon 49 q
Israel 46 q
Saudi Arabia 44 q
Chile 43 q
Armenia 42 q
Item Number: S032446 Philippines 42 q
Morocco 41 q
Romania 38 q
Tunisia 33 q
Indonesia 31 q
Bulgaria 25 q
South Africa 24 q
Ghana 24 q
Botswana 20 q
Correct Response: C Egypt 0 q
Country average vs.

Higher p
Not different O
Lower q
127
Environmental Use and Conservation

Conceptual Understanding
Science of Natural Resources
Nonrenewable natural resource Overall Percent Correct
Singapore 86 p
Oil is an example of a natural resource that is not renewable. Which is Hong Kong, SAR 80 p
another example of a nonrenewable resource? Chinese Taipei 79 p
England 69 p
a Wood Korea, Republic of 69 p
Scotland 68 p
b Seawater
Jordan 65 p
c Sunlight Italy 61 p
d Coal
Lebanon 60 p
Bulgaria 59 p
Estonia 59 p
United States 59 p
S012042
Slovenia 58 p
Lithuania 58 p
Romania 57 p
Indonesia 56 p
Netherlands 56 O
Egypt 55 O
Australia 55 O
Hungary 55 O
Saudi Arabia 55 O
New Zealand 53 O
Botswana 52 O
Malaysia 51 O
Bahrain 50 O
Norway 49 O
Cyprus 45 q
Israel 45 q
Item Number: S012042 Tunisia 43 q
Armenia 41 q
Latvia 41 q
Japan 39 q
Morocco 39 q
Chile 36 q
Philippines 35 q
Sweden 35 q
South Africa 33 q
Ghana 28 q
Correct Response: D Iran, Islamic Republic of 18 q
Country average vs.

Higher p
Not different O
Lower q
128

Renewable energy source Overall Percent Correct
Hong Kong, SAR 64 p

Write down one renewable energy source and describe one way that people Singapore 47 p
make use of it. England 43 p
Italy 41 p
Energy Source: ______________________________________________________ Jordan 40 p
Chinese Taipei 36 p
Use: Estonia 35 p
Slovenia 35 p
Hungary 34 p
New Zealand 32 p
Scotland 29 O
S032242
United States 29 p
Sweden 29 O
Israel 27 O
Lebanon 27 O
Netherlands 27 O
Australia 27 O
Item Number: S032242 Latvia 26 O
Malaysia 26 O
SCORING Lithuania 26 O
Note: For credit, responses must name a renewable energy source or device and a use that International average 25 O
indicates how the energy from the source/device is applied. Credit is NOT given for responses Russian Federation 25 O
that name a renewable source/device with no or inadequate description of its use. Romania 24 O
Correct Response Macedonia, Republic of 23 O
• Sun or sunlight (solar energy) with a correct description of its use.
Norway 22 O
Examples: Sun. It is used to heat water by solar panels.
Bahrain 22 q
Sunlight. It keeps us warm.
Cyprus 21 q
• Wind (windmills) with a correct description of its use.
Examples: Windmills. Are for grinding corns or for pumping water.
Wind turbines to generate electricity.
Bulgaria 19 q
• Water (waves, tides, water wheels, etc.) with a correct description of its use. Philippines 19 q
Examples: Tidal barrage. To generate electricity. Egypt 18 q
Water. To generate electricity.
Indonesia 17 q
• Other correct. Chile 17 q
Examples: Food. To give the body energy. Botswana 15 q
Wood. It is used in wood stoves for cooking. Tunisia 14 q
Incorrect Response Armenia 13 q
• Names any fossil fuel (e.g., coal, oil, gasoline). Saudi Arabia 12 q
Examples: Gas. You can use it for heating. Ghana 9 q
Japan 9 q
• Names a renewable energy source/device with no or inadequate description of use.
South Africa 7 q
Examples: Water. You can heat, freeze and melt it.
Sunlight. Morocco 4 q
Windmill. Moldova, Rep. of 2 q
• Names “light” (without connection to the Sun) with or without a correct description of use.
Examples: Light energy. It help us to see. Country average vs.
Light. International average:
• Other incorrect (including crossed out/erased, stray marks, illegible or off task) Higher p
Examples: Electricity. Used for cooking. Not different O
Batteries. To power a torch. Lower q
129
Renewable energy source (continued)

Student Responses
Correct Response:
Incorrect Response:
130

Group of renewable energy sources Overall Percent Correct
Hong Kong, SAR 84 p

Which group of energy sources are ALL renewable? Korea, Republic of 77 p
Lithuania 76 p
a coal, oil, and natural gas Singapore 76 p
Hungary 74 p
b solar, oil, and geothermal
Chinese Taipei 74 p
c wind, solar, and tidal Estonia 73 p
Italy 70 p
d natural gas, solar, and tidal
England 70 p
Slovenia 68 p
Scotland 68 p
Japan 66 p
S032422
Malaysia 63 p
Sweden 61 p
Latvia 60 p
Netherlands 60 O
Jordan 59 p
United States 56 O
Armenia 55 O
New Zealand 55 O
Cyprus 53 O
Australia 52 O
Bahrain 52 O
Norway 50 O
Romania 50 O
Lebanon 47 q
Egypt 45 q
Bulgaria 45 q
Indonesia 45 q
Item Number: S032422 Israel 44 q
Chile 40 q
Tunisia 30 q
Philippines 28 q
Botswana 27 q
Morocco 26 q
South Africa 21 q
Saudi Arabia 18 q
Correct Response: C Ghana 18 q
Country average vs.

Higher p
Not different O
Lower q
131

Factual Knowledge
Overgrazing by livestock Overall Percent Correct
Chinese Taipei 88 p
Overgrazing of land by livestock contributes to a major problem. Botswana 80 p
That problem is Malaysia 79 p
Australia 74 p
a depletion of ground water Netherlands 72 p
increased pollution Estonia 71 p
b Singapore 70 p
c erosion of soil Hong Kong, SAR 68 p
d acid rain
United States 65 p
Hungary 64 p
Romania 63 p
Japan 63 p
S012005
Indonesia 63 p
Ghana 63 p
Jordan 63 p
Latvia 61 p
England 60 O
Italy 59 O
Morocco 57 O
Slovenia 57 O
Scotland 57 O
Norway 56 O
Bulgaria 54 O
Armenia 54 O
New Zealand 54 O
Tunisia 52 q
Bahrain 48 q
Item Number: S012005 Cyprus 47 q
Sweden 46 q
Chile 46 q
Philippines 45 q
Lithuania 45 q
South Africa 36 q
Egypt 34 q
Saudi Arabia 33 q
Israel 32 q
Lebanon 17 q
Correct Response: C Korea, Republic of 0 q
Country average vs.

Higher p
Not different O
Lower q
132

Reasoning and Analysis
Positive/negative effect of dam Overall Percent Correct
Chinese Taipei 87 p
The diagram shows a farm in a valley where a dam has just been built. Korea, Republic of 83 p
Netherlands 82 p
Hong Kong, SAR 78 p
United States 77 p
Japan 77 p
Australia 75 p
Lake Estonia 74 p
Singapore 72 p
Slovenia 72 p
Dam Latvia 72 p
Malaysia 71 p
New Zealand 71 p
England 70 p
River Italy 67 p
Norway 67 p
Lithuania 65 p
Romania 64 O
Jordan 63 O
Israel 61 O
Farm
Indonesia 61 O
Cyprus 59 O
Hungary 58 O
The presence of the dam can have both positive and negative effects on Serbia and Montenegro 57 O
farming in the valley. Scotland 57 O
Sweden 56 O
A. Describe one positive effect of the dam on farming. Bulgaria 55 O
Tunisia 53 q
Egypt 51 q
Philippines 48 q
Armenia 46 q
B. Describe one negative effect of the dam on farming. Saudi Arabia 45 q
Bahrain 44 q
Botswana 39 q
Morocco 38 q
Chile 36 q
S022088
Lebanon 28 q
Ghana 20 q
South Africa 11 q
Country average vs.

Higher p
Not different O
Lower q
133
Positive/negative effect of dam (continued)

SCORING
Codes for Positive Effects
Note: For credit, responses must clearly indicate a positive effect of the dam related
to farming in the valley.
Correct Response
• Mentions that the dam prevents flooding.
Examples: Without the dam, a big storm could cause a flood.
There is no chance of flooding.
It slows down the river so it does not overflow and ruin the crops.
• Mentions that the dam controls the water supply.
Examples: It stores water for the summer.
The dam releases just the right amount of water.
It brings more water closer to the farm.
It would be easier to irrigate.
• Mentions a soil-related benefit of the dam.
Examples: More top soil.
Controls erosion.
The ground will be more fertile because of the large supply of water.
• Mentions the dam as a source of power.
Examples: The farmer will have a good power supply.
The farm can use the hydroelectric power for energy.
• Other correct.
Incorrect Response
• Mentions a positive effect but does not clearly address the issue of farming
or the effect of the dam.
Examples: It provides better drinking water.
Water is good for the crops.
It makes the river small for swimming and fishing.
• Gives a negative effect.
Examples: It might prevent the farm from getting enough water.
The water could become too high and overflow.
• Other incorrect (including crossed out/erased, stray marks, illegible, or off task)
134

Student Responses
Correct Response:
135


Incorrect Response:
136

Positive/negative effect of dam Overall Percent Correct
Chinese Taipei 68 p
The diagram shows a farm in a valley where a dam has just been built. Slovak Republic 64 p
Netherlands 63 p
Romania 62 p
Estonia 61 p
United States 59 p
Latvia 57 p
Hong Kong, SAR 57 p
Lake Israel 56 p
New Zealand 55 p
Slovenia 55 p
Dam Jordan 55 p
Indonesia 53 p
Norway 52 p
Australia 51 p
River Iran, Islamic Republic of 50 p
Bulgaria 50 p
Lithuania 49 p
Singapore 46 O
England 46 O
Malaysia 45 O
Farm
Bahrain 44 O
Italy 44 O
Korea, Republic of 41 O
The presence of the dam can have both positive and negative effects on Armenia 39 q
farming in the valley. Scotland 38 q
Japan 38 q
A. Describe one positive effect of the dam on farming. Macedonia, Republic of 38 q
Sweden 38 q
Philippines 37 q
Hungary 37 q
Saudi Arabia 35 q
Tunisia 35 q
B. Describe one negative effect of the dam on farming. Chile 30 q
Cyprus 29 q
Egypt 26 q
Lebanon 24 q
Morocco 21 q
S022088
Botswana 19 q
Ghana 13 q
South Africa 11 q
Country average vs.

Higher p
Not different O
Lower q
137

SCORING
Codes for Negative Effects
Note: For credit, responses must clearly indicate a negative effect of the dam related
to farming in the valley.
Correct Response
• Mentions the dam breaking (resulting in flooding).
Examples: If the dam breaks it could flood the valley and the crops.
If there is a leak, the whole dam could flood and destroy everything.
• Mentions the river drying up or decreasing water supply.
Examples: No or less irrigation because the dam does not let the water flow through.
The fields could dry out from too little water.
It slows the river too much and the farm will not have enough water.
• Mentions a soil-related problem of the dam.
Examples: Nutrients not replenished by flooding.
The rich nutrients from the water are not coming over the fields.
• Mentions upsetting the ecological balance.
Examples: The dam could alter the ecology of the farm.
The dam might interfere with the farm’s ecosystem.
• Other correct.
Incorrect Response
• Mentions a negative effect but it does not clearly address the issue of farming
or the effect of the dam.
Examples: It bursts.
It is now going to be a tourist attraction.
Flooding. [Does not mention how the dam causes this.]
A lot of fish will die because their habitat has been changed.
The fish cannot swim upstream.
• Response indicates a misconception of how dams function (controlled release of water).
Examples: The lake could overflow the top of the dam.
138

Student Responses
Correct Response:
139


Incorrect Response:
140

Drinking water from sea water Overall Percent Correct
Singapore 35 p
Sea water contains dissolved salts and is not suitable for drinking. Korea, Republic of 22 p
Describe a procedure that can be used to obtain a cup of drinking water Estonia 21 p
from a bucket of sea water. Hong Kong, SAR 20 p
Egypt 20 p
Japan 19 p
New Zealand 16 p
Netherlands 15 p
Australia 15 p
England 14 p
Jordan 13 p
Lithuania 12 O
Latvia 11 O
Israel 11 O
Scotland 10 O
Hungary 10 O
S032063
Bahrain 10 O
Sweden 10 O
SCORING Armenia 9 O
Note: For full credit, responses must give a procedure that clearly indicates the method used to Slovenia 8 O
separate water from salt and collect the pure water. The most common procedure is the distillation Norway 8 O
method, but other correct procedures such as the freezing method or reverse osmosis method are
Chinese Taipei 7 q
possible. Partial credit should be given for responses that address at least the separation portion of
the procedure. Responses that are based on boiling or filtering without indicating how separation of Italy 7 q
water and salt occurs are scored as incorrect. Macedonia, Republic of 7 q
Saudi Arabia 7 O
Correct Response
United States 6 q
• Describes a correct procedure that includes the following basic steps (may use diagrams): Bulgaria 6 q
i) Boiling/evaporation to separate water from salt
Morocco 6 q
ii) Collecting the distilled water (condensation)
Examples: Heat the salt water, catch the steam on a tray, drip it into a cup and the salt will be left Cyprus 5 q
in the bucket and drinking water in the cup. Romania 5 q
Boil the sea water taking the steam up to a tube and letting steam turn back into water. Malaysia 5 q
• Other fully correct. Belgium (Flemish) 4 q
Lebanon 3 q
South Africa 3 q
Describes boiling/evaporation step to separate water from salt; condensation step is omitted. Chile 3 q
Examples: Maybe if you boiled the salt water the salt would separate from the water. Serbia and Montenegro 3 q
Take the salt water and boil it and the steam will create great drinking water. Tunisia 2 q
• States ‘distillation’ or similar but no description of the process is given. Ghana 2 q
Examples: The best way is to use a distillation apparatus. Indonesia 2 q
Distill it. Philippines 1 q
• Other partially correct. Botswana 1 q
Incorrect Response Moldova, Rep. of 0 q
• Mentions boiling but with no or incorrect indication of separation included.

[May also mention filtering or other processes.] Country average vs.
Examples: You can boil it. International average:
• Mentions filtering to separate salt. [Response not based on boiling.] Higher p
Examples: Make it go through a filter. Not different O
Lower q
141
Drinking water from sea water (continued)

Student Responses
Correct Response:
142
Drinking water from sea water (continued)


Incorrect Response:
143
Life Science Cells and Their Functions Factual Knowledge
Main function of red blood cells Overall Percent Correct
Singapore 90 p
What is the main function of red blood cells? England 84 p
Japan 84 p
a To fight disease in the body Italy 82 p
Chinese Taipei 81 p
b To carry oxygen to all parts of the body
Malaysia 77 p
c To remove carbon monoxide from all parts of the body United States 75 p
Sweden 75 p
d To produce materials which cause the blood to clot
Australia 74 p
Netherlands 73 p
Scotland 70 p
New Zealand 69 p
S012038
Hungary 66 p
Lebanon 66 p
Indonesia 64 p
Jordan 64 O
Israel 61 O
Slovenia 60 O
Hong Kong, SAR 59 O
Norway 58 O
Armenia 57 O
Morocco 56 O
Saudi Arabia 56 O
Tunisia 54 q
Lithuania 54 q
Bahrain 53 q
Philippines 53 q
Estonia 53 q
Bulgaria 52 q
Item Number: S012038 Macedonia, Republic of 52 q
Cyprus 50 q
Romania 48 q
Botswana 46 q
Egypt 45 q
Latvia 39 q
Ghana 36 q
South Africa 34 q
Correct Response: B Chile 33 q
Country average vs.

Higher p
Not different O
Lower q
144
Development and Life Cycle

Life Science Reasoning and Analysis
of Organisms
Plant growth experiment Overall Percent Correct
Sweden 81 p
A girl has an idea that green plants need sand in the soil for healthy Hungary 76 p
growth. In order to test her idea she uses two pots of plants. She sets up one Hong Kong, SAR 76 p
pot of plants as shown below. Singapore 76 p
Japan 74 p
Armenia 73 p
Estonia 72 p
Sunlight
Chinese Taipei 72 p
Norway 72 p
United States 70 p
Romania 67 p
Australia 67 p
Scotland 66 p
Jordan 65 p
Sand, soil, and water
Bulgaria 65 p
England 65 p
Which ONE of the following should she use for the second pot of plants? Russian Federation 65 p
Italy 64 p
Chile 64 p
a b c Israel 63 p
Saudi Arabia 62 O
Sunlight New Zealand 62 O
Dark cupboard Dark cupboard
Netherlands 60 O
Bahrain 60 O
Slovenia 57 O
Sand and water Sand, soil, and water Soil and water Slovak Republic 57 O
Lithuania 57 O
Cyprus 56 O
Egypt 55 O
d e Malaysia 55 O
Morocco 47 q
Sunlight Sunlight Philippines 44 q
Botswana 44 q
Lebanon 42 q
Tunisia 41 q
Indonesia 39 q
Latvia 39 q
South Africa 34 q
S022235
Sand and soil Soil and water Ghana 29 q

Country average vs.
Higher p
Correct Response: E Not different
Lower
O
q
145
Diversity, Adaptation,
Life Science Conceptual Understanding
and Natural Selection
Fossils in sedimentary rock Overall Percent Correct
Japan 79 p
The fossils that are found in the oldest layers of sedimentary rock were Korea, Republic of 63 p
formed from which types of organisms? Slovenia 55 p
Sweden 53 p
a only organisms that lived in the sea Hungary 49 p
only organisms that lived on land Hong Kong, SAR 47 p
b Slovak Republic 45 p
c only organisms that lived in the air Bulgaria 41 p
Italy 37 p
d organisms that lived on the land, in the sea and in the air
Norway 34 p
Malaysia 33 p
Netherlands 32 O
S032083
Chinese Taipei 32 p
Israel 31 O
England 30 O
United States 29 O
Lithuania 27 O
Scotland 27 O
Estonia 27 O
Morocco 26 O
Australia 25 O
Singapore 24 q
Romania 23 q
New Zealand 20 q
Cyprus 19 q
Armenia 19 q
Botswana 17 q
Lebanon 17 q
Latvia 17 q
Item Number: S032083 Egypt 17 q
Philippines 15 q
Bahrain 14 q
Tunisia 12 q
Saudi Arabia 12 q
South Africa 11 q
Chile 11 q
Indonesia 10 q
Ghana 8 q
Correct Response: A Jordan 0 q
Country average vs.

Higher p
Not different O
Lower q
146
Diversity, Adaptation
A. Life Science and Natural Selection
Structure, Function and Life

B. Life Science Processes in Organisms
Galapagos Islands: compare beak depths of Species 1 and 2 Overall Percent Correct
Japan 66 p
The Galapagos Islands contain a number of different species of finches Korea, Republic of 65 p
(birds) that are thought to have developed from one species. Some species of Slovenia 56 p
finches eat certain types of seeds depending on their beak depth. The Belgium (Flemish) 55 p
Hong Kong, SAR 54 p
diagram below shows the head of one species of finch and its beak depth.
Malaysia 46 p
Chinese Taipei 46 p
beak
depth Singapore 46 p
United States 45 p
Latvia 45 p
Some of the islands have only one species living on them, while other Russian Federation 44 p
islands have more than one species. Species 1 lives on Los Hermanos New Zealand 43 p
Island. Species 2 lives on Daphne Island. The two graphs below show the Estonia 42 p
percentage of the population with different beak depths for each of the two Hungary 42 p
species. Armenia 41 p
Australia 41 p
Species 1 on Los Hermanos Species 2 on Daphne
Sweden 39 p
40 40 Scotland 39 p
England 39 p
30 30
Lithuania 36
Percentage of
p
Percentage of
Population
Population
Italy 35 O
20 20
Netherlands 34 O
10 10 Norway 31 O
0 0 Romania 29 O
5 10 15 5 10 15
Chile 26 O
Beak Depth (mm) Beak Depth (mm)
A. How do the beak depths of Species 1 and Species 2 compare? Indonesia 22 q
Bulgaria 21 q
Egypt 21 q
Israel 19 q
Jordan 19 q
B. A wide variety of seeds exist on the islands, and both Species 1 and Cyprus 17 q
Species 2 eat seeds. Based on the beak depths of the two finch species, Morocco 16 q
Bahrain 14 q
what would you conclude about the size of seeds that each species eats?
Tunisia 10 q
South Africa 6 q
Saudi Arabia 6 q
Philippines 4 q
Botswana 4 q
S032706_1
Ghana 3 q
Lebanon 3 q
This Galapagos Islands question continues on the next page.
Country average vs.

Higher p
Not different O
Lower q
2706_2
147
Galapagos Islands: compare beak depths of Species 1 and 2 (continued)

SCORING
Note: Credit will be given for responses that are consistent with the information in the graphs. This
includes responses that are based on similarities, differences, or both. Responses that indicate that
the two species are ‘similar’ must refer to specific information from the graphs, such as the range,
average, most frequent beak size (mode), etc., in order to receive credit. Responses that state only
that the two species are the ‘same’ or ‘similar’ with no supporting information are incorrect.
Correct Response
• Gives a description based on similarities that is supported with information in the graphs.
Examples: Both are similar in average beak size.
They are similar because they both have most finches in the 11mm beak range.
• Gives description based on differences that is supported with information in the graphs.
Examples: Species 1 is a little bit shorter than Species 2.
Species 2 has more that are big.
Species 2 has a wider range of depth than of Species 1.
• Give a description that includes both similarities and differences.
Examples: Both species have the greatest amount of birds with 11mm beak depths,
but Species 1 does not have birds with beak depths bigger than 13mm.
• Other correct.
Incorrect Response
• States only that the two species are the ‘same’ or ‘similar’ without supporting information
from the graphs.
Examples: They are nearly the same.
• States that one species is larger or smaller than the other, but does not identify which.
Examples: One of them is a bit different on beak depth.
148

Student Responses
Correct Response:
149


Incorrect Response:
150
A. Life Science and Natural Selection

B. Life Science Processes in Organisms
Galapagos Islands: size of seeds each species eats Overall Percent Correct
The Galapagos Islands contain a number of different species of finches Japan 51 p
(birds) that are thought to have developed from one species. Some species of Estonia 51 p
finches eat certain types of seeds depending on their beak depth. The Belgium (Flemish) 48 p
Chinese Taipei 47 p
diagram below shows the head of one species of finch and its beak depth.
Latvia 45 p
Hong Kong, SAR 45 p
beak
depth Singapore 45 p
England 42 p
Slovenia 42 p
Some of the islands have only one species living on them, while other Armenia 42 p
islands have more than one species. Species 1 lives on Los Hermanos United States 40 p
Island. Species 2 lives on Daphne Island. The two graphs below show the Lithuania 39 p
percentage of the population with different beak depths for each of the two Malaysia 39 p
species. Hungary 37 p
Netherlands 36 p
Species 1 on Los Hermanos Species 2 on Daphne
Scotland 34 p
40 40 Australia 33 O
30 30
New Zealand 32 O
Percentage of
Percentage of
Population
Population
20 20
Sweden 29 O
10 10 Norway 29 O
Italy 27 O
0 0 International average 27 O
5 10 15 5 10 15
Romania 25 O
Jordan 21 q
A. How do the beak depths of Species 1 and Species 2 compare? Chile 20 q
Bahrain 18 q
Israel 17 q
Cyprus 15 q
Egypt 15 q
Bulgaria 15 q
B. A wide variety of seeds exist on the islands, and both Species 1 and Macedonia, Republic of 14 q
Species 2 eat seeds. Based on the beak depths of the two finch species, Iran, Islamic Republic of 12 q
Indonesia 12 q
what would you conclude about the size of seeds that each species eats?
Tunisia 10 q
Morocco 8 q
Lebanon 7 q
Botswana 6 q
Saudi Arabia 4 q
South Africa 4 q
S032706_1
Philippines 2 q
Ghana 1 q
This Galapagos Islands question continues on the next page.
Country average vs.

Higher p
Not different O
Lower q
2706_2
151
Galapagos Islands: size of seeds each species eats (continued)

SCORING
Note: The response to Part B must be consistent with the comparison of beak sizes given in Part A
in order to receive credit. Correct responses can refer explicitly to comparisons of the two “species”
or more generally to a comparison of “birds” of different sizes within or across species. It is possible
that a correct conclusion may be drawn based on an incorrect response to Part A.
Correct Response
• States that the two species eat the same (similar) types of seeds.
[Response to A indicates that the two species have the same or similar size beaks.]
• States that Species 2 eats larger seeds than Species 1.
[Response to A indicates that Species 2 is larger.]
• States only that birds (finches) with larger beaks eat larger seeds (or similar).
[No explicit comparison of the two species.]
• Other correct.
Incorrect Response
• States that the two species eat the same (similar) types of seeds, but this conclusion
is inconsistent with the response given in Part A.
• States that one species eats larger seeds than the other, but this conclusion is inconsistent
with the response given in Part A.
152
Galapagos Islands: size of seeds each species eats (continued)

Student Responses
Correct Response:
153
Title Name Pulled

Galapagos Islands:from
sizeItem Here each
of seeds (continued)
species eats (continued)
M022002A

Incorrect Response:
154
and Natural Selection
Galapagos Islands: graphs of beak depths for Species 3 and 4 Overall Percent Correct
Singapore 37 p
Two other species (Species 3 and Species 4) live on Santa Maria Island, Chinese Taipei 36 p
which also has a range of seed types. Korea, Republic of 26 p
Hong Kong, SAR 26 p
Which of the following graphs shows a range of beak depths for Scotland 26 p
Species 3 and Species 4 that would best insure the survival of both species Estonia 25 p
on Santa Maria Island? Australia 25 p
(Circle the letter by the correct graph.) Sweden 23 p
United States 23 p
A B New Zealand 22 p
Lithuania 21 p
Percentage of
Percentage of
Population
Population
Species 3
England 21 p
Norway 15 p
Species 4 Slovenia 14 O
Japan 13 O
Latvia 12 O
Italy 11 O
Explain why this range of beak depths would be best. Russian Federation 9 O
Netherlands 9 O
Hungary 8 O
Israel 8 q
Romania 8 O
Malaysia 4 q
SCORING Chile 4 q
Correct Response Serbia and Montenegro 4 q
Note: For credit, responses must identify A with an explanation based on reduced competition for food Palestinian Nat’l Auth. 3 q
as a result of beak size differences. Credit is NOT given for responses that identify A with a minimal Jordan 3 q
explanation that indicates a correct interpretation of the graph but refers only to differences in beak size. Bulgaria 3 q
Correct Response Bahrain 2 q
South Africa 2 q
• A with an explanation that relates the difference in beak size to reduced competition (or similar).
Examples: With the different sized beaks they would not have to share food. Egypt 2 q
One species will eat the small seeds and one will eat the large seeds. Armenia 2 q
There would be no competition between the two species if they ate different seeds. Moldova, Rep. of 2 q
S032707
They each have their own food source. Macedonia, Republic of 2 q

End of Galapagos Islands section. Indonesia 1 q
• Other correct.
Philippines 1 q
Incorrect Response Botswana 1 q
• A with a minimal explanation that refers only to the difference in beak size. [Does not explicitly Iran, Islamic Republic of 1 q
mention competition for seeds or similar.] Morocco 1 q
Examples: Because they are different sizes. Lebanon 1 q
Because Species 3 has a smaller beak size. Cyprus 1 q
• A with no explanation or an incorrect explanation. Saudi Arabia 1 q
Examples: Because their beaks look sharper. Tunisia 1 q
Because both species have a large beak to the percentage of population. Ghana 1 q
It’s like the other graphs.
• B with no explanation or an incorrect explanation.
Country average vs.
Examples: Bigger beak depths so they could eat more seeds. International average:
Both are nearly equal and are a more normal size.
It’s better if they are the same size because they eat the same seeds. Higher p
Not different O
• Other incorrect (including crossed out/erased, stray marks, illegible or off task). Lower q
155
Galapagos Islands: graphs of beak depths for Species 3 and 4 (continued)

Student Responses
Correct Response:
156
Galapagos Islands: graphs of beak depths for Species 3 and 4 (continued)


Incorrect Response:
157
Life Science Ecosystems Conceptual Understanding
Galapagos Islands: plants/animals inhabited island first Overall Percent Correct
Estonia 62 p
Which organisms that live on land most likely inhabited the Armenia 55 p
Galapagos Islands first? Singapore 49 p
New Zealand 49 p
(Check one box.) Japan 48 p
Latvia 48 p
C Land plants Lithuania 48 p
United States 48 p
C Land animals
Sweden 46 p
Norway 44 p
Explain your answer.
Hungary 44 p
Australia 44 p
Netherlands 42 p
Item Number: S032704 England 42 p
SCORING Korea, Republic of 40 p
Note: Credit is given for responses that check PLANTS and give an explanation that refers explicitly to Hong Kong, SAR 40 p
photosynthesis or plants making their own food as well those that refer only to the survival or mode Scotland 38 p
of transportation of plants/animals. Responses that check ANIMALS may also receive credit with a Chinese Taipei 38 p
reasonable explanation based on transportation and the availability of alternative food sources, e.g., Malaysia 35 O
fish. Slovenia 33 O
Correct Response International average 31 O
• PLANTS with an explanation based plants being able to make their own food (photosynthesis). Jordan 30 O
Examples: Plants can photosynthesize. Moldova, Rep. of 29 O
Because plant make their own food using light, water and chlorophyll. Israel 25 q
• PLANTS with an explanation based only on survival OR mode of transportation of plants/animals. Chile 23 q
[Photosynthesis or making food not explicitly mentioned.] Cyprus 22 q
Examples: They could survive there first because plants only need water and air. Romania 22 q
Without plants there would not be animals. Palestinian Nat’l Auth. 21 q
First the plants arrived. Then the animals can come and survive by eating the plants. Italy 21 q
Seeds could just be carried by the wind. Animals would have to swim a long distance. Serbia and Montenegro 20 q
Seeds from South America blew to the islands. Macedonia, Republic of 19 q
• ANIMALS with a reasonable explanation based on transportation AND availability of alternative Bulgaria 18 q
food sources (may be implicit based on the specific type of animal named). Bahrain 16 q
S032704
Examples: Birds could fly over to the island to nest and survive by eating fish from the sea. Lebanon 16 q
Seals can swim there and live on the rocky
Questions shore. [Assumes
for Galapagos seals
Islands eat fish.]
continue. Iran, Islamic Republic of 15 q
• Other correct. Indonesia 14 q
Egypt 12 q
Incorrect Response
Tunisia 10 q
• PLANTS with no explanation or an incorrect explanation. [May include a correct statement that
Morocco 10 q
does not apply to the situation.]
South Africa 9 q
Examples: They just grew from the ground.
Botswana 7 q
Because plants grow faster and live longer.
Philippines 6 q
They are living organisms.
Plants were on Earth before animals. Saudi Arabia 1 q
Ghana 0 q
• ANIMALS with no explanation or an incorrect explanation.
Examples: Birds could just eat the seeds in the ground.
They are everywhere. Country average vs.
There will be a surplus of food. International average:
Animals can move but plants cannot. Higher p
Animals migrate. Not different O
158
Galapagos Islands: plants/animals inhabited island first (continued)

Student Responses
Correct Response:
Incorrect Response:
159
Galapagos Islands: effect of cats Overall Percent Correct
Australia 68 p
When settlers came to live on the Galapagos Islands, they brought with New Zealand 66 p
them a number of new animals such as cats and goats. Write down one Estonia 59 p
effect the introduction of cats and goats could have on the animals and Chinese Taipei 58 p
plants already living on the islands. Armenia 56 p
Singapore 54 p
A. One effect of cats: Slovak Republic 52 p
Lithuania 49 p
Netherlands 47 p
Hungary 46 p
Latvia 45 p
United States 45 p
Hong Kong, SAR 45 p
England 45 p
Romania 43 p
Norway 42 O
Sweden 41 O
Scotland 41 O
Japan 40 O
Jordan 39 O
B. One effect of goats:
Malaysia 35 O
Slovenia 33 O
Chile 30 q
Israel 29 q
Cyprus 28 q
Egypt 27 q
Tunisia 27 q
Bulgaria 26 q
Italy 24 q
Item Number: S032705A Bahrain 23 q
Botswana 21 q
SCORING
Indonesia 20 q
Correct Response Lebanon 16 q
• Refers to cats preying upon other organisms, or similar (resulting in a reduction in population). South Africa 14 q
Examples: They will eat the birds and other animals. Morocco 12 q
The cats help them by eating the rats and mice. Saudi Arabia 9 q
S032705
Their prey could become extinct. Macedonia, Republic of 8 q

• Other correct. Questions for Galapagos Islands continue. Philippines 8 q
Examples: They might pass on diseases to other animals. Ghana 0 q
Incorrect Response
• Refers only to an effect on the cat with no explicit effect on other organisms. Country average vs.
Examples: They cannot survive on the island. International average:
Cats might reproduce and get out of control. Higher p
• Other incorrect (including crossed out/erased, stray marks, illegible, or off task). Not different O
Examples: The cats might eat all the plants. Lower q
160
Galapagos Islands: effect of cats (continued)

Student Responses
Correct Response:
Incorrect Response:
161
Galapagos Islands: effect of goats Overall Percent Correct
Singapore 74 p
When settlers came to live on the Galapagos Islands, they brought with Australia 74 p
them a number of new animals such as cats and goats. Write down one Chinese Taipei 73 p
effect the introduction of cats and goats could have on the animals and Korea, Republic of 70 p
plants already living on the islands. Hong Kong, SAR 69 p
Estonia 69 p
A. One effect of cats: New Zealand 68 p
Malaysia 63 p
England 62 p
United States 60 p
Hungary 58 p
Netherlands 58 p
Scotland 57 p
Armenia 57 p
Japan 54 p
Lithuania 51 p
Sweden 48 O
Latvia 48 O
Jordan 48 O
Romania 45 O
B. One effect of goats:
Norway 44 O
Chile 41 O
Israel 38 q
Egypt 37 q
Slovenia 37 q
Italy 36 q
Indonesia 34 q
Tunisia 33 q
SCORING Bulgaria 32 q
Correct Response Bahrain 32 q
• Refers only to the goats eating plants (resulting in a reduction of the amount of plant life on the Botswana 31 q
island). Cyprus 27 q
Examples: The goats will eat all the grass on the island. Macedonia, Republic of 25 q
It could lead to erosion if the goats clear the land by eating all the plants. Philippines 24 q
Large pieces of grass will disappear as the goats eat it. Moldova, Rep. of 22 q
• Refers to an effect of the goat on other animals (e.g., competition for food/habitat, as a food source Lebanon 22 q
for predators, etc.). [Note: may also refer to the goats eating plants.] Iran, Islamic Republic of 20 q
Examples: The animals that eat goats would have more food. Morocco 15 q
S032705
They might become a source of food. Saudi Arabia 11 q

The goats will eat up the plants and thefor
Questions populations
GalapagosthatIslands
dependcontinue.
on plants will decrease. South Africa 8 q
• Other correct. Ghana 0 q
Incorrect Response
• Refers only to an effect on the goat with no explicit effect on other organisms. Country average vs.
Examples: Goats would have more babies. International average:
They would die because they don’t have any food. Higher p
• Other incorrect (including crossed out/erased, stray marks, illegible, or off task). Not different O
Examples: Goats might eat the cats. Lower q
162
Galapagos Islands: effect of goats (continued)

Student Responses
Correct Response:
Incorrect Response:
163
Life Science Ecosystems Factual Knowledge
Elements that make up animals and plants Overall Percent Correct
Chinese Taipei 70 p
Animals and plants are made up of a number of different chemical Estonia 70 p
elements. What happens to all of these elements when animals and Hungary 69 p
plants die? Singapore 63 p
Sweden 61 p
a They die with the animal or plant. United States 60 p
They evaporate into the atmosphere. Tunisia 55 p
b Australia 54 p
c They are recycled back into the environment. Philippines 53 p
New Zealand 52 p
d They change into different elements.
Japan 51 p
Hong Kong, SAR 46 p
S032682
England 45 p
Romania 44 p
Israel 44 p
Italy 44 p
Norway 42 O
Slovenia 40 O
Morocco 38 O
Netherlands 38 O
Bulgaria 36 O
Scotland 34 O
Malaysia 32 q
Chile 30 q
Botswana 29 q
Egypt 28 q
Armenia 25 q
Saudi Arabia 22 q
Cyprus 22 q
Indonesia 21 q
South Africa 21 q
Jordan 21 q
Lithuania 20 q
Lebanon 20 q
Ghana 17 q
Correct Response: C Bahrain 14 q
Country average vs.

Higher p
Not different O
Lower q
164
Life Science Ecosystems Reasoning and Analysis
Community of mice, snakes and wheat plants Overall Percent Correct
Singapore 78 p
Malaysia 68 p
England 57 p
Chinese Taipei 55 p
Estonia 52 p
Australia 50 p
Sweden 48 p
Hungary 48 p
Netherlands 45 p
United States 44 p
Scotland 42 p
Lithuania 41 p
The diagram above shows a community consisting of mice, snakes and
wheat plants.
Jordan 39 p
What would happen to this community if people killed the snakes? Russian Federation 38 p
Hong Kong, SAR 37 O
Romania 37 O
Item Number: S032202 New Zealand 35 O
Egypt 34 O
Armenia 34 O
SCORING International average 33 O
Note: For full credit, responses must include an explicit statement of the effect on BOTH the mice Slovenia 33 O
population and the wheat plants. Partial credit is given for responses that refer to one but not both
Latvia 32 O
of these.
Correct Response
S032202
• States that mice (population) will increase AND wheat plants will decrease. Japan 31 O
Examples: The population of mice would increase because there are no snakes. The increase Norway 31 O
in mice would then cause the amount of wheat plants to decrease. Indonesia 30 O
Then we would get more mice and less wheat plants. Israel 30 q
• States that the mice would eat more (all) of the wheat plants AND that the mice (population) will Italy 27 q
decrease as the wheat decreases. [May also refer to the initial increase in population of mice.] Moldova, Rep. of 26 q
Examples: Mice would eat all the plants, then the plants would die out, then the mice would not Tunisia 26 q
have anything to eat so then they would die.
Saudi Arabia 24 q
Mice would become overpopulated and eat all the wheat. Then all the mice would
starve because there is no food left. Bulgaria 22 q
Cyprus 18 q
Chile 16 q
Partially Correct Response Bahrain 16 q
• States only that the mice will increase. [No explicit mention of the effect on wheat.] Palestinian Nat’l Auth. 16 q
Examples: The number of mice would increase because there are no snakes to eat them. Morocco 16 q
There would be lots of mice. Philippines 16 q
• States only that the mice will eat more (all) of the wheat plants (or similar). Lebanon 9 q
[No explicit mention of the effect on mice.] Botswana 6 q
Examples: If people killed the snakes the mice would destroy all the wheat plants. South Africa 6 q
• Other partially correct. Ghana 3 q
Incorrect Response
• Refers to an effect on the whole community (ecosystem) but too vague to interpret. Country average vs.
Examples: The whole community will be affected. International average:
The ecosystem would be unbalanced. Higher p
Everything dies. Not different O
Lower q
165
Community of mice, snakes and wheat plants (continued)

Student Responses
Correct Response:
166
Community of mice, snakes and wheat plants (continued)


Incorrect Response:
167
Life Science Human Health Factual Knowledge
Leafy vegetables important for human health Overall Percent Correct
Eating leafy vegetables is important for human health. This is because leafy Japan 65 p
vegetables are a good source of which of the following? Slovenia 63 p
Israel 62 p
a protein Chinese Taipei 59 p
carbohydrates Estonia 58 p
b Hungary 57 p
c minerals England 55 p
Netherlands 53 p
d fat
Singapore 52 p
United States 48 p
S032637
Italy 45 p
New Zealand 44 p
Latvia 42 p
Malaysia 41 p
Hong Kong, SAR 41 O
Bulgaria 41 O
Australia 40 O
Lithuania 40 O
Scotland 37 O
Romania 34 O
Egypt 34 O
Morocco 33 O
Sweden 33 q
Norway 32 q
Bahrain 30 q
Philippines 28 q
Lebanon 28 q
Jordan 25 q
Chile 24 q
Armenia 24 q
Botswana 23 q
Saudi Arabia 20 q
South Africa 20 q
Ghana 19 q
Indonesia 17 q
Correct Response: C Cyprus 9 q
Country average vs.

Higher p
Not different O
Lower q
168
Life Science Human Health Reasoning and Analysis
Transmission of cold in classroom Overall Percent Correct
Chinese Taipei 84 p
Scott went to school with a cold. Several days later, half of his classmates Slovak Republic 78 p
also had colds. What is one likely reason some classmates had colds but Hungary 75 p
others did not? Singapore 73 p
Romania 71 p
Slovenia 70 p
Estonia 69 p
Hong Kong, SAR 68 p
Latvia 68 p
Lithuania 66 p
Armenia 66 p
Netherlands 65 p
Norway 65 p
Sweden 63 p
Jordan 63 p
United States 61 p
Italy 60 p
S022154
Item Number: S022154 Israel 56 O
SCORING Bahrain 54 O
Egypt 54 O
Note: To receive credit, responses must include some reference to transmission of ‘germs’ (viruses,
bacteria, etc.), either explicitly or through a description of a method of transmission (sneezing/ Serbia and Montenegro 54 O
coughing, direct physical contact, etc.), or to defense mechanisms (immunity, resistance, etc.). New Zealand 54 O
A response that includes only a general reference to proximity without any description of a method Bulgaria 53 O
of transmission will be scored as incorrect. Macedonia, Republic of 53 O
Correct Response International average 53 O
• Refers explicitly to transmission of ‘germs’ (viruses, bacteria, etc.) from Salil to some classmates England 50 O
(or not to others). Chile 48 q
Examples: Some students were hanging around Salil with him sneezing his germs onto them. Scotland 47 q
The ones exposed to the virus caught it. Australia 46 q
• Refers to some students having better defense mechanisms (immunity, resistance). Malaysia 43 q
Examples: Some of the students have just got over a cold. Japan 43 q
Some students’ immunity was low because they went outside in the cold. Indonesia 39 q
Cyprus 37 q
• Refers to a specific method of transmission involving physical contact or exposure without
mentioning germs explicitly (e.g. sneezing/coughing, shaking hands, drinking from same glass, Saudi Arabia 37 q
breathing same air). Philippines 34 q
Examples: He sneezed on the ones that got it. Morocco 31 q
They touched something Salil touched. Lebanon 24 q
• Other correct. Tunisia 18 q
South Africa 13 q
Incorrect Response
Botswana 10 q
• Includes ONLY a general or vague response relating to proximity or “catching the cold” from Salil. Ghana 6 q
[No explicit description of a method of transmission is given.]
Examples: Some of his classmates did not like him so probably were not near him a lot.
The ones who were his friends got it. Country average vs.
The kids who sat by him caught the cold. International average:
Some caught it from Salil. Higher p
Salil gave it to some of the class. Not different O
Lower q
169
Transmission of cold in classroom (continued)

Student Responses
Correct Response:
Incorrect Response:
170
Life Science Reproduction and Heredity Conceptual Understanding
Son inherits traits Overall Percent Correct
Netherlands 94 p
A son can inherit traits United States 93 p
Latvia 92 p
a only from his father Belgium (Flemish) 92 p
only from his mother Chinese Taipei 91 p
b England 91 p
c from both his father and his mother Hungary 91 p
Norway 90 p
d from either his father or his mother, but not from both
Sweden 90 p
Lithuania 89 p
Romania 88 p
S012026
Chile 87 p
Italy 87 p
Hong Kong, SAR 86 p
Scotland 86 p
Israel 85 p
Estonia 85 p
Slovenia 85 p
Bulgaria 83 p
Cyprus 82 p
Armenia 82 p
Singapore 79 O
Australia 77 O
New Zealand 73 O
Egypt 68 q
Japan 65 q
Lebanon 65 q
Item Number: S012026 Bahrain 64 q
Morocco 63 q
Philippines 60 q
Jordan 60 q
Tunisia 60 q
Saudi Arabia 52 q
South Africa 51 q
Ghana 48 q
Malaysia 47 q
Indonesia 44 q
Correct Response: C Botswana 43 q
Country average vs.

Higher p
Not different O
Lower q
171
Traits transferred from generations Overall Percent Correct
Chinese Taipei 97 p
Traits are transferred from generation to generation through the Hong Kong, SAR 97 p
a sperm only Hungary 88 p
egg only England 88 p
b Sweden 87 p
c sperm and the egg Netherlands 86 p
testes Singapore 86 p
d United States 86 p
Israel 85 p
Scotland 83 p
Estonia 83 p
S012039
Chile 83 p
Romania 80 p
Italy 79 p
Malaysia 79 p
Norway 78 p
Latvia 77 p
Bulgaria 76 O
Philippines 76 O
Japan 76 O
Slovenia 76 O
Bahrain 75 O
Australia 73 O
Lithuania 72 O
Egypt 71 O
Armenia 71 O
New Zealand 70 O
Morocco 66 q
Tunisia 64 q
Cyprus 63 q
Jordan 57 q
Botswana 57 q
Saudi Arabia 52 q
South Africa 52 q
Ghana 50 q
Correct Response: C Lebanon 37 q
Country average vs.

Higher p
Not different O
Lower q
172
Biological control of insect population Overall Percent Correct
United States 71 p
Why would male insects be treated to prevent sperm production? Australia 69 p
Singapore 68 p
a To increase the number of female insects England 67 p
To reduce the total population of insects New Zealand 66 p
b Scotland 65 p
c To produce new species of insects Belgium (Flemish) 62 p
Sweden 60 p
d To prevent insects from mating
Israel 59 p
Malaysia 57 p
Netherlands 57 p
Japan 54 p
S022117
Hong Kong, SAR 52 p
Bulgaria 52 p
Hungary 50 p
Lithuania 49 p
Estonia 47 O
Norway 47 O
Botswana 46 O
Chile 45 O
Italy 44 O
Chinese Taipei 44 O
Bahrain 42 O
Indonesia 42 O
Jordan 41 q
Latvia 40 q
Romania 39 q
Slovenia 38 q
Cyprus 37 q
Philippines 33 q
Item Number: S022117 Russian Federation 32 q
Armenia 29 q
Ghana 28 q
Egypt 27 q
Tunisia 25 q
Morocco 23 q
South Africa 21 q
Lebanon 19 q
Correct Response: B Saudi Arabia 17 q
Country average vs.

Higher p
Not different O
Lower q
173
Life Science Reproduction and Heredity Factual Knowledge
Fertilization in animals Overall Percent Correct
Hong Kong, SAR 88 p

Which of the following takes place during fertilization in animals? Lithuania 87 p
Chinese Taipei 86 p
a production of sperm and egg Estonia 85 p
joining of sperm and egg Japan 85 p
b Korea, Republic of 83 p
c division of egg Belgium (Flemish) 82 p
development of embryo Hungary 78 p
d England 77 p
Netherlands 75 p
Latvia 75 p
S032008
Israel 73 p
Sweden 72 p
Morocco 69 p
Bulgaria 68 p
United States 67 p
Scotland 67 p
Tunisia 67 p
Slovenia 66 p
Australia 65 p
Singapore 64 p
Malaysia 63 O
Norway 60 O
Cyprus 57 O
New Zealand 56 O
Jordan 56 O
Italy 55 q
Bahrain 54 q
Indonesia 48 q
Chile 47 q
Item Number: S032008 Macedonia, Republic of 47 q
Egypt 47 q
Armenia 46 q
Romania 44 q
Saudi Arabia 40 q
South Africa 39 q
Botswana 37 q
Lebanon 37 q
Philippines 31 q
Correct Response: B Ghana 19 q
Country average vs.

Higher p
Not different O
Lower q
174

Processes in Organisms
Bodily process to prevent overheating Overall Percent Correct
Japan 86 p
What processes take place in the human body that prevent it from Korea, Republic of 85 p
overheating during exercise? Australia 72 p
United States 72 p
New Zealand 69 p
Scotland 69 p
Estonia 67 p
England 66 p
Lithuania 61 p
Latvia 61 p
Netherlands 61 p
Hong Kong, SAR 60 p
Israel 59 p
Italy 55 p
Hungary 55 p
Bulgaria 50 p
Slovenia 48 p
Singapore 48 p
S022152
Sweden 47 O
Armenia 45 O
Malaysia 42 O
Romania 42 O
Item Number: S022152 Norway 41 O
Chinese Taipei 39 q
SCORING Chile 37 q
Note: If perspiration or sweating is mentioned, score as correct, even if other correct responses Bahrain 35 q
such as increased blood flow to the skin are also included. Iran, Islamic Republic of 32 q
Correct Response Saudi Arabia 31 q
• Refers to perspiration (sweating) AND the cooling effect of evaporation.
Jordan 29 q
Examples: When people sweat, it evaporates to cool them down.
Sweating. When the sweat evaporates, it cools the skin.
Egypt 20 q
Perspiration cools you down when it evaporates.
Indonesia 19 q
• Refers to perspiration (sweating), without explicitly mentioning the cooling effect of evaporation.
Tunisia 18 q
Examples: The body sweats.
Philippines 18 q
Perspiration keeps you from overheating.
Botswana 17 q
The perspiration cools you off and you don’t stay hot.
Cyprus 15 q
• Refers to increased blood flow to the skin. South Africa 9 q
Examples: The blood rushes to your face and cools you down.
Lebanon 7 q
• Other correct. Morocco 6 q
Incorrect Response Ghana 6 q
• Refers only to drinking water to cool down.
• Refers to an effect of exercise but does not specifically address overheating and/or cooling. Country average vs.
Examples: The blood pumps faster. International average:
Breathing increases. Higher p
Your body is working hard and using up more food energy. Not different O
175
Bodily process to prevent overheating (continued)

Student Responses
Correct Response:
Incorrect Response:
176

Advantage of having two ears Overall Percent Correct
Sweden 70 p
What is the advantage of having two ears to hear with rather than one ear? Netherlands 70 p
New Zealand 64 p
Australia 64 p
England 62 p
United States 58 p
Scotland 56 p
Hungary 55 p
Slovenia 53 p
Norway 52 p
Lithuania 50 p
Latvia 48 p
Israel 41 p
Estonia 41 p
Singapore 40 p
Jordan 37 O
Egypt 36 O
Malaysia 33 O
S022160
Item Number: S022160 Italy 32 O

Hong Kong, SAR 32 O
Chinese Taipei 30 q
SCORING
Note: Credit is given for both higher-level responses referencing locating the source of sound as well
as less sophisticated responses referencing hearing sounds from both sides and retaining hearing if
one ear does not function. Cyprus 28 q
Botswana 28 q
Correct Response
Japan 27 q
• Mentions being able to locate the position, direction and/or distance of the source of sound. Bahrain 25 q
Examples: By having two ears, you can actually tell where a sound came from. Romania 25 q
With two ears you could hear which direction a noise is coming from. Russian Federation 23 q
With two ears you can judge the distance the sound is away from you. Chile 22 q
With two ears you can tell if the sound is near or far.
Morocco 22 q
• Mentions hearing sounds from both sides (direction) with no mention of locating the source. Saudi Arabia 21 q
Examples: You can hear on both sides of you. Slovak Republic 21 q
You can hear sounds from all around, not just one side. Armenia 20 q
With two ears you can hear from more than one way. Serbia and Montenegro 20 q
• Mentions that if hearing is lost in one ear, the other may still function. Moldova, Rep. of 19 q
Examples: In the result of being deaf in one ear, you have another one that is used. Iran, Islamic Republic of 19 q
If you lost the hearing in one ear, the other one might still work. Bulgaria 16 q
• Other correct. Philippines 15 q
Incorrect Response Lebanon 12 q
South Africa 9 q
• Gives only a general or vague response relating to how well one can hear.
Ghana 8 q
Examples: You hear better.
Tunisia 7 q
You can hear half as much with one ear.
Indonesia 6 q
Two ears lets you hear a lot more.
The volume is greater.
• Mentions only that hearing is uneven/unbalanced with one ear. Country average vs.
Examples: If you had one ear, the sound would be uneven. International average:
Your hearing would be out of balance. Higher p
You hearing gets balanced better with two ears. Not different O
Lower q
177
Advantage of having two ears (continued)

Student Responses
Correct Response:
Incorrect Response:
178

Life Science Factual Knowledge
Organ NOT in abdomen Overall Percent Correct
Chinese Taipei 94 p
Which of the following organs is NOT situated in the abdomen? Hungary 83 p
Netherlands 83 p
a liver Sweden 82 p
kidney Belgium (Flemish) 80 p
b Slovak Republic 78 p
c stomach Bulgaria 77 p
bladder Macedonia, Republic of 77 p
d Lithuania 77 p
e heart Russian Federation 77 p
Armenia 76 p
Hong Kong, SAR 75 p
S012001

Australia 74 p
Latvia 74 p
United States 73 p
Estonia 71 p
Romania 69 p
Singapore 68 p
Israel 67 p
Cyprus 67 p
England 67 p
Chile 66 p
New Zealand 65 p
Scotland 63 O
Saudi Arabia 59 O
Bahrain 58 O
Japan 58 O
Jordan 51 q
Norway 50 q
Slovenia 48 q
Egypt 48 q
Indonesia 47 q
Italy 45 q
Philippines 45 q
Tunisia 45 q
Botswana 30 q
Lebanon 26 q
South Africa 26 q
Malaysia 23 q
Correct Response: E Ghana 12 q
Country average vs.

Higher p
Not different O
Lower q
179

Message from eyes to brain Overall Percent Correct
Chinese Taipei 94 p
When a person sees something, what carries the message from the eyes to Japan 93 p
the brain? Hong Kong, SAR 93 p
a arteries Netherlands 91 p
b glands
c muscles Hungary 86 p
Singapore 85 p
d nerves
Lithuania 83 p
e veins Indonesia 81 p
Sweden 81 p
S012014
Slovenia 81 p
England 81 p
Australia 81 p
United States 80 p
New Zealand 80 p
Estonia 79 p
Bulgaria 79 p
Malaysia 79 p
Italy 78 p
Latvia 75 O
Scotland 74 O
Saudi Arabia 74 O
Jordan 72 O
Bahrain 70 O
Romania 70 O
Israel 69 O
Armenia 67 q
Norway 59 q
Philippines 58 q
Egypt 57 q
Botswana 56 q
Cyprus 49 q
Morocco 46 q
Lebanon 44 q
Chile 36 q
South Africa 29 q
Country average vs.

Higher p
Not different O
Lower q
180

Absorbtion of food into the blood stream Overall Percent Correct
Singapore 71 p
In humans, where does the absorption of food into the blood stream mainly Japan 58 p
take place? Armenia 44 p
Jordan 43 p
a stomach Malaysia 42 p
mouth Slovenia 38 p
b Hong Kong, SAR 37 p
c large intestines Sweden 35 p
d small intestines
Chinese Taipei 33 p
Saudi Arabia 33 p
Egypt 33 p
S032386
Morocco 31 O
Philippines 29 O
New Zealand 29 O
Bahrain 29 O
Netherlands 27 O
Australia 27 O
United States 27 O
Ghana 26 O
Romania 25 O
Lithuania 25 O
Hungary 25 O
Lebanon 25 O
England 25 O
Indonesia 25 O
Botswana 23 q
Italy 23 q
Item Number: S032386 Bulgaria 22 q
Chile 22 q
Tunisia 21 q
Scotland 20 q
Estonia 18 q
Latvia 18 q
Norway 18 q
Israel 18 q
Cyprus 17 q
Correct Response: D South Africa 10 q
Country average vs.

Higher p
Not different O
Lower q
181

Fish organ like human lung Overall Percent Correct
Italy 91 p
Which of the following organs in fish has the same function Korea, Republic of 90 p
as the human lung? Hungary 85 p
a kidney Netherlands 83 p
heart Iran, Islamic Republic of 82 p
b Chinese Taipei 80 p
c gill Belgium (Flemish) 78 p
d skin
Sweden 76 p
Bahrain 76 p
Bulgaria 76 p
Hong Kong, SAR 75 p
S032607
Slovenia 74 p
Estonia 74 p
Romania 72 p
Japan 68 p
Morocco 68 p
Israel 64 O
Jordan 64 O
England 64 O
Saudi Arabia 63 O
Singapore 62 O
Lithuania 62 O
Egypt 62 O
Malaysia 62 O
Australia 61 O
Latvia 61 O
Chile 60 O
United States 60 q
Scotland 59 q
Item Number: S032607 Armenia 58 O
Norway 55 q
Indonesia 54 q
New Zealand 49 q
Lebanon 45 q
Tunisia 40 q
Philippines 37 q
South Africa 35 q
Cyprus 25 q
Botswana 23 q
Correct Response: C Ghana 18 q
Country average vs.

Higher p
Not different O
Lower q
182

How glasses/contact lenses work Overall Percent Correct
New Zealand 68 p
Briefly explain how eyeglasses and contact lenses help some people to see Jordan 64 p
more clearly. Estonia 56 p
England 56 p
Bahrain 55 p
Australia 55 p
Armenia 54 p
Latvia 52 p
Netherlands 50 p
Sweden 49 p
Lithuania 48 p
Hungary 48 p
United States 48 p
Scotland 48 p
Item Number: S022161 Norway 47 p
Hong Kong, SAR 46 p
SCORING Slovak Republic 44 p
Singapore 44 p
Note: Credit is given for higher-level responses that demonstrate knowledge of vision by describing
how lenses modify the way light enters the eye and hits the retina or back of the eye (as well as Chile 42 O
less sophisticated responses based on helping eyes to focus, to see objects at different distances Israel 42 O
or to magnification. Slovenia 41 O
Correct Response Egypt 39 O
• Mentions that glasses/contact lenses bend (refract) or focus light rays onto the retina (or back
of the eye). [May use a diagram to show this.] Romania 37 O
S022161
Examples: The glasses focus the light onto the retina. Bulgaria 37 O
Malaysia 35 O
• Mentions the curvature (shape) of lenses (concave/convex) and/or bending of light by lenses.
[Based primarily on the properties of lenses with no explicit mention of the focusing of light on
the retina or back of eye.] Japan 34 q
Examples: You can focus better because glasses bend the light into your eye. Macedonia, Republic of 33 q
• Mentions that glasses/contact lenses help the eyes focus and/or allow (near-sighted/far-sighted)
people to see images at a distance or close up. Serbia and Montenegro 30 q
Examples: Some people can see close up but need glasses in order to see things far away. Italy 30 q
Far-sighted people can only read with glasses that correct their close-up vision. Chinese Taipei 28 q
Eyeglasses can help your eyes to focus more clearly on things. Indonesia 26 q
• Mentions that glasses/contact lenses magnify or enlarge (images). Saudi Arabia 19 q
Examples: They magnify. Tunisia 18 q
The magnification in the glasses make things more clear and bigger. Cyprus 17 q
The lenses make things look bigger. Morocco 15 q
Philippines 14 q
• Other correct.
Botswana 12 q
• Gives only a vague reference to glasses/contact lenses helping people see more clearly or Lebanon 6 q
containing prescriptions (chemicals, special type/shape/thickness of glass, etc.) without further Ghana 5 q
explanation of vision or how lenses work.
Examples: They make you see more clearly.
If you are near sighted, you need glasses to help you see. Country average vs.
Contacts help vision because of the prescription injected into them. International average:
Lenses are prescribed to fix eye problems. Higher p
The lenses in glasses are made thick so you can see better. Not different O
183
How glasses/contact lenses work (continued)

Student Responses
Correct Response:
Incorrect Response:
184
Types, Characteristics and

Classification of Living Things
Characteristics of animal groups Overall Percent Correct
A person sorted some animals into the two groups listed on the table. Japan 76 p
Which characteristic of animals was used for the sorting? Australia 70 p
New Zealand 68 p
Chinese Taipei 66 p
a Legs Group 1 Group 2 England 66 p
Scotland 64 p
b Eyes
Humans Snakes Malaysia 63 p
c Nervous system Hong Kong, SAR 62 p
Dogs Worms Estonia 62 p
d Skin
Flies Fish
United States 62 p
Norway 60 p
S012028
Singapore 59 p
Netherlands 58 p
Israel 57 p
Latvia 56 p
Sweden 54 p
Hungary 49 p
Italy 47 O
Slovenia 46 O
Armenia 43 O
Cyprus 42 O
Lithuania 40 q
Bahrain 37 q
Bulgaria 36 q
Romania 33 q
Tunisia 31 q
Saudi Arabia 26 q
Morocco 25 q
Egypt 25 q
Jordan 24 q
Indonesia 24 q
Botswana 23 q
Philippines 23 q
South Africa 19 q
Lebanon 19 q
Correct Response: A Ghana 11 q
Country average vs.

Higher p
Not different O
Lower q
185
Types, Characteristics and

Classification of Living Things
Cats most closely related to which animal Overall Percent Correct
Japan 65 p
Cats are most closely related to which of the following animals?
Malaysia 46 p
a crocodiles Singapore 43 p
whales Bulgaria 42 p
b Moldova, Rep. of 41 p
c frogs Chinese Taipei 40 p
penguins Italy 39 p
d Armenia 36 p
Estonia 35 p
Latvia 35 p
Lithuania 33 p
S032595
Hungary 32 p
Slovenia 31 p
Israel 31 p
Hong Kong, SAR 28 O
Romania 27 O
United States 25 O
England 25 O
Australia 22 q
Botswana 22 q
Philippines 20 q
Lebanon 19 q
New Zealand 18 q
Chile 18 q
Scotland 18 q
Jordan 18 q
Egypt 17 q
Item Number: S032595 Netherlands 17 q
Bahrain 16 q
Ghana 15 q
South Africa 15 q
Cyprus 15 q
Saudi Arabia 15 q
Sweden 13 q
Norway 13 q
Indonesia 8 q
Morocco 0 q
Country average vs.

Higher p
Not different O
Lower q
186
Physics Electricity and Magnetism Conceptual Understanding
Poles on cut magnet Overall Percent Correct
Japan 64 p
The diagram shows a bar magnet which is cut into three pieces with a Singapore 62 p
hacksaw. Macedonia, Republic of 62 p
Bahrain 58 p
Sweden 58 p
Lithuania 56 p
South Belgium (Flemish) 55 p
Cyprus 53 p
S Russian Federation 52 p
New Zealand 51 p
Australia 51 p
United States 51 p
Estonia 51 p
Israel 51 p
North Netherlands 49 O
Bulgaria 48 O
N Italy 48 O
Morocco 47 O
Scotland 47 O
Romania 46 O
Write an “N” or an “S” in each box on the diagram to show the polarity of England 46 O
each end of the center piece. Latvia 45 O
Slovenia 45 O
Chinese Taipei 44 O
S022035
Hungary 43 O
Malaysia 43 O
Norway 41 O
Hong Kong, SAR 40 q
Botswana 39 q
Jordan 38 q
Saudi Arabia 37 q
Lebanon 36 q
Philippines 34 q
SCORING Tunisia 33 q
Note: To receive credit, the polarity of BOTH ends of the center piece must be indicated. Answer is Indonesia 32 q
correct if polarity is indicated correctly (N-S), but letters are shown above, below, or outside the boxes, Iran, Islamic Republic of 32 q
as long as the polarity of both ends of the center piece is clear. Egypt 30 q
Correct Response Palestinian Nat’l Auth. 27 q
Armenia 25 q
• N-S
Ghana 19 q
• S-N
• Pole of cut ends of outer pieces are indicated (S - N) instead of poles on center piece.
Country average vs.
• Other incorrect (including crossed out/erased, stray marks, illegible, or off task). International average:
Higher p
Not different O
Lower q
187
Poles on cut magnet (continued)

Student Responses
Correct Response:
Incorrect Response:
188
Physics Electricity and Magnetism Factual Knowledge
Diagram of batteries in a flashlight Overall Percent Correct
Singapore 97 p
The diagrams show a flashlight and three ways to put batteries in it. England 95 p
Japan 93 p
– +– + + –– + – ++ –
Hong Kong, SAR 93 p
K L M Russian Federation 93 p
In order to make the flashlight work, which way must the batteries be Estonia 93 p
placed? Chinese Taipei 92 p
Malaysia 91 p
Only as in K Romania 91 p
a Latvia 91 p
b Only as in L Hungary 91 p
Only as in M Bulgaria 91 p
c Bahrain 90 p
d None of these ways would work. Lithuania 90 p
Sweden 89 p
United States 89 p
Armenia 88 p
S012037
New Zealand 88 O
Slovenia 87 p
Lebanon 86 O
Netherlands 86 O
Australia 85 O
Cyprus 85 O
Scotland 84 O
Indonesia 84 O
Italy 83 O
Chile 82 O
Item Number: S012037 Israel 82 O
Norway 81 q
Botswana 81 q
Morocco 81 O
Jordan 78 q
Saudi Arabia 78 q
Philippines 77 q
Egypt 67 q
Tunisia 59 q
Ghana 55 q
Correct Response: A South Africa 52 q
Country average vs.

Higher p
Not different O
Lower q
189
Physics Electricity and Magnetism Reasoning and Analysis
Compass placed next to a magnet/draw Overall Percent Correct
Japan 88 p
Chinese Taipei 86 p
N
Singapore 76 p
Hungary 67 p
S England 65 p
Hong Kong, SAR 61 p
Malaysia 58 p
Bulgaria 57 p
The diagram above shows a compass needle with its North and South
Bahrain 56 p
poles labeled (N and S). It is placed next to a strong magnet as shown in the Armenia 54 p
diagram below. Sweden 52 p
Australia 50 p
Romania 45 p
United States 45 p
N S Netherlands 44 O
Scotland 41 O
Jordan 38 O
A. Draw the compass needle in the circle on the diagram above. Moldova, Rep. of 37 O
Label the North (N) and South (S) poles of the needle. Italy 33 q
B. Explain your answer using your knowledge of magnets.
Lebanon 31 q
New Zealand 31 q
Norway 30 q
Item Number: S032625A Estonia 29 q
Morocco 28 q
SCORING Israel 27 q
Correct Response Indonesia 26 q
Egypt 26 q
• Draws a “horizontal” needle with N to the left and S to the right. [See diagram below.]
Slovenia 25 q
S032625
Note: Credit should be given even if one label is missing (N to the left OR S to the right shown).
Incorrect Response Tunisia 24 q
• Draws a “horizontal” needle with poles reversed (N to the right and/or S to the left). Latvia 23 q
[See diagram below.] Lithuania 21 q
• Draws a “horizontal” needle with no poles indicated. [See diagram below.] Cyprus 20 q
• Draws a “vertical” needle with or without poles indicated. [See diagram below.] Philippines 17 q
Saudi Arabia 16 q
Chile 15 q
Botswana 14 q
South Africa 5 q
Ghana 2 q
Country average vs.

Higher p
Not different O
Lower q
190
Compass placed next to a magnet/draw (continued)

Student Responses
Correct Response:
Incorrect Response:
191
Physics Electricity and Magnetism Reasoning and Analysis
Compass placed next to a magnet/explain Overall Percent Correct
Japan 77 p
Chinese Taipei 70 p
N
Singapore 67 p
Hungary 59 p
England 59 p
S Slovak Republic 56 p
Hong Kong, SAR 47 p
Armenia 45 p
Bahrain 43 p
Malaysia 43 p
poles labeled (N and S). It is placed next to a strong magnet as shown in the Bulgaria 42 p
diagram below. Australia 41 p
Sweden 39 p
United States 37 p
Romania 33 O
N S Netherlands 31 O
Jordan 30 O
A. Draw the compass needle in the circle on the diagram above. Moldova, Rep. of 28 O
Label the North (N) and South (S) poles of the needle. Scotland 28 O
Italy 20 q
Indonesia 20 q
Egypt 17 q
New Zealand 17 q
Item Number: S032625B Israel 16 q
Lebanon 16 q
Morocco 14 q
Scoring for Explanation Estonia 13 q
Correct Response Norway 13 q
• Explains that opposite poles attract (N toward S, etc.) or like poles repel (or similar). Botswana 11 q
S032625
Examples: The south point of the compass is attracted to the north pole of the magnet. Belgium (Flemish) 11 q
North and south attract together. Slovenia 10 q
The magnets which have different poles attract one another. Saudi Arabia 9 q
The N pole on the magnet will attract the S pole on the compass. Tunisia 9 q
Opposites attract and likes repel. Philippines 8 q
The magnet pushes the N pole of the compass away. Latvia 8 q
• Other correct. Chile 5 q
Incorrect Response Lithuania 5 q
South Africa 4 q
• Refers to magnetic attraction/repulsion but with an incorrect application.
Cyprus 4 q
Examples: Because the same pole will be attracted.
Ghana 2 q
The magnet is closer to the compass and will have a stronger attraction to the N end.
The needle of the compass is metal, so it is attracted to the magnet and turns.
It attracts the needle to North and South poles. Country average vs.
• Explains that the compass needle always points North, or similar. International average:
Examples: The needle of North always goes to the magnetic North. Higher p
North always goes toward North. Not different O
Lower q
192
Compass placed next to a magnet/explain (continued)

Student Responses
Correct Response:
poles labeled (N and S). It is placed next to a strong magnet as shown in the
diagram below.
N S
A. Draw the compass needle in the circle on the diagram above.

Label the North (N) and South (S) poles of the needle.

S032625
193
Compass placed next to a magnet/explain (continued)


Incorrect Response:
poles labeled (N and S). It is placed next to a strong magnet as shown in the
diagram below.
N S
A. Draw the compass needle in the circle on the diagram above.

Label the North (N) and South (S) poles of the needle.

S032625
194
Energy Types, Sources

Physics Conceptual Understanding
and Conversions
Stored energy in two springs Overall Percent Correct
Singapore 84 p
Spring 1 and Spring 2 were the same. Then, Spring 1 was pushed together a England 84 p
little and clamped in place. Spring 2 was pushed together a lot and Korea, Republic of 84 p
clamped. United States 83 p
New Zealand 83 p
Japan 81 p
Netherlands 79 p
Australia 78 p
Scotland 78 p
Estonia 77 p
1 2 Hungary 75 p
Italy 75 p
Norway 74 p
Which spring has more stored energy?
Lithuania 74 p
a Spring 1
b Spring 2 Sweden 71 p
Israel 70 p
c Both springs have the same energy.
Hong Kong, SAR 69 p
d You cannot tell unless you know what the springs are made of. Slovenia 68 p
S012002
Malaysia 67 p
Latvia 64 O
Chinese Taipei 64 O
Lebanon 63 O
Jordan 63 O
Bulgaria 61 O
Armenia 60 O
Chile 59 O
Cyprus 58 O
Indonesia 57 q
Botswana 52 q
Item Number: S012002 Palestinian Nat’l Auth. 50 q
Philippines 48 q
Morocco 46 q
Romania 39 q
South Africa 39 q
Egypt 39 q
Saudi Arabia 37 q
Ghana 36 q
Bahrain 35 q
Country average vs.

Higher p
Not different O
Lower q
195
Energy Types, Sources

Physics Conceptual Understanding
and Conversions
Nail pulled out of a wooden board Overall Percent Correct
Chinese Taipei 84 p
When a nail is pulled out of a wooden board, the nail becomes warm. Hungary 84 p
Explain why. Slovak Republic 78 p
England 75 p
Hong Kong, SAR 74 p
Japan 74 p
United States 73 p
Lithuania 72 p
Netherlands 71 p
Australia 71 p
Latvia 68 p
S032131
Singapore 67 p
Estonia 66 p
Scotland 66 p
Armenia 66 p
Romania 64 p
Malaysia 63 p
Bulgaria 61 p
New Zealand 57 O
Slovenia 54 O
Sweden 51 O
Israel 48 O
Norway 47 q
Jordan 44 q
Cyprus 44 q
SCORING Palestinian Nat’l Auth. 40 q
Correct Response Italy 40 q
• Explanation refers to friction (implicitly or explicitly). Chile 40 q
Examples: Because it is rubbed against the wood. Indonesia 39 q
Nail resists when you pull it out. Bahrain 33 q
Because of the force on the nail to pull it out. Morocco 27 q
Because of friction. Tunisia 27 q
There is friction between the nail and the wooden board. Saudi Arabia 26 q
• Explanation refers to energy change. Philippines 24 q
Examples: There is more energy in the nail after the transition. Lebanon 22 q
Because energy is used to get it out. Egypt 20 q
Kinetic energy changes to heat energy when you pull it out. Botswana 11 q
• Other correct. South Africa 11 q
Ghana 5 q
Incorrect Response
• Explanation refers only to the nail or the action taken with inadequate connection to friction or
energy. Country average vs.
Examples: It is hard to get it out. International average:
You must pull hard. Higher p
Because it was in the wood for too long. Not different O
Lower q
196
Nail pulled out of a wooden board (continued)

Student Responses
Correct Response:
Incorrect Response:
197
Physics Forces and Motion Conceptual Understanding
Path of ball released from orbit Overall Percent Correct
The diagram on the left shows a ball on the end of a string being whirled in Netherlands 82 p
a circle. The diagram on the right shows the whirling ball as viewed from Estonia 80 p
above. Singapore 79 p
Australia 77 p
Japan 77 p
Hungary 77 p
Scotland 77 p
New Zealand 77 p
United States 76 p
Lithuania 75 p
(View from above)
Malaysia 75 p
Sweden 74 p
After several whirls, the string is released when the ball is at Q. Which of
England 74 p
these diagrams shows the direction in which the ball will fly the instant the
string is released?
Norway 72 p
Latvia 71 p
Slovenia 70 p
a b Hong Kong, SAR 69 p
Q Q
Chinese Taipei 68 p
Italy 61 O
Bulgaria 60 O
Cyprus 59 O
Israel 58 O
Romania 58 O
Chile 58 O
Armenia 58 O
c Q d Q
Jordan 47 q
Indonesia 47 q
Bahrain 44 q
Philippines 42 q
Saudi Arabia 38 q
Tunisia 31 q
Egypt 30 q
Lebanon 30 q
S022040
Botswana 30 q
South Africa 22 q
Correct Response: A Ghana 22 q
Country average vs.

Higher p
Not different O
Lower q
198
Why helium balloon moves upward Overall Percent Correct
A balloon filled with helium gas is set free and starts to move upward. Hungary 88 p
Which of the following best explains why the helium balloon moves upward? Slovak Republic 86 p
Chinese Taipei 86 p
a The density of helium is less than the density of air. Estonia 83 p
Singapore 81 p
b The air resistance lifts the balloon up.
Slovenia 79 p
c There is no gravity acting on helium balloons. Sweden 77 p
d The wind blows the balloon upward.
Japan 74 p
United States 72 p
Hong Kong, SAR 71 p
Malaysia 69 p
S032281
Lithuania 69 p
Norway 69 p
Scotland 69 p
Latvia 69 p
New Zealand 67 p
England 66 p
Australia 66 p
Romania 65 p
Italy 61 O
Bulgaria 60 O
Netherlands 58 O
Jordan 56 O
Armenia 56 O
Israel 54 q
Chile 52 q
Philippines 49 q
Egypt 45 q
Bahrain 43 q
Cyprus 35 q
Saudi Arabia 33 q
Indonesia 32 q
Ghana 28 q
Botswana 25 q
South Africa 21 q
Tunisia 21 q
Correct Response: A Morocco 19 q
Country average vs.

Higher p
Not different O
Lower q
199
Metal crown: why scientists repeated measurement Overall Percent Correct
Chinese Taipei 76 p
The scientists measured the volume of the crown five times. They computed Korea, Republic of 67 p
the density for each volume measurement. Their results are shown in the Estonia 60 p
table below. Singapore 58 p
Hong Kong, SAR 56 p
Japan 53 p
Trial Volume of Crown (cm3) Density of Crown (g/cm3) Malaysia 53 p
1 202 11.88 Lithuania 53 p
2 200 12.00 United States 47 p
3 201 11.94 Australia 44 p
Jordan 44 p
4 198 12.12
Slovenia 42 p
5 199 12.06 Sweden 42 p
Scotland 41 p
New Zealand 40 p
A. Why did the scientists measure the volume five times?
England 34 O
Netherlands 33 O
Israel 33 O
Latvia 29 O
Egypt 29 O
Norway 22 q
Hungary 22 q
Cyprus 21 q
B. The scientists reported to the king that the density of the crown was
3 Morocco 21 q
12.0 g/cm . Show how the scientists used their results to obtain this
Tunisia 19 q
value for the density.
Bahrain 17 q
Indonesia 15 q
Italy 15 q
Item Number: S032712A Romania 14 q
Bulgaria 13 q
Armenia 11 q
Botswana 10 q
Philippines 8 q
Chile 6 q
Lebanon 6 q
S032712
South Africa 6 q
Questions for Metal Crown continue. Ghana 5 q
Saudi Arabia 1 q
Country average vs.

Higher p
Not different O
Lower q
200
Metal crown: why scientists repeated measurement (continued)

SCORING
Why Scientists Repeat Measurements
Correct Response
• Refers to accuracy, precision, reliability, experimental uncertainty, estimation of measurement
error (or similar).
Examples: Because there is experimental error. So measuring it 5 times you can calculate
the average to know how much error there is.
Each time they measure the volume it is close but not exactly the same. So, it’s better
to measure it a few times to be sure.
They want a more exact answer.
To get an accurate measure of the volume.
It’s more reliable.
• Refers only to computing an average or mean value (or median or range).
Examples: To find the average volume.
To work out the mean.
• Other correct.
Incorrect Response
• Refers only to ‘mistakes’ or changes in the measurements (or similar); no explicit mention
of accuracy, precision, experimental uncertainty, etc.
Examples: In case mistakes happen.
To make sure it wasn’t changing.
To make sure the answer was right and he did not make a mistake.
To make sure they did it right.
To check if it was correct.
• Refers only to a ‘fair test’ or similar; no explicit mention of computation of average, accuracy,
precision, experimental uncertainty, etc.
Examples: To make sure it was a fair test.
To ensure a fair test.
201
Metal crown: why scientists repeated measurement (continued)

Student Responses
Correct Response:
Incorrect Response:
202
Metal crown: determination of average/median value Overall Percent Correct
Singapore 47 p
The scientists measured the volume of the crown five times. They computed Japan 44 p
the density for each volume measurement. Their results are shown in the Estonia 36 p
table below. Lithuania 31 p
United States 29 p
Netherlands 29 p
Trial Volume of Crown (cm3) Density of Crown (g/cm3) Chinese Taipei 28 p
1 202 11.88 Scotland 26 p
Sweden 24 p
2 200 12.00
Hong Kong, SAR 24 p
3 201 11.94 Australia 23 p
4 198 12.12 England 22 p
Latvia 22 p
5 199 12.06 New Zealand 21 p
Malaysia 20 p
A. Why did the scientists measure the volume five times? Korea, Republic of 15 O
Norway 14 O
Slovenia 14 O
Israel 13 O
Hungary 12 q
Cyprus 9 q
Bulgaria 9 q
Romania 7 q
B. The scientists reported to the king that the density of the crown was Jordan 7 q
3 Macedonia, Republic of 7 q
12.0 g/cm . Show how the scientists used their results to obtain this
Armenia 6 q
value for the density.
Italy 6 q
Lebanon 6 q
Item Number: S032712B Indonesia 4 q
Tunisia 4 q
SCORING Philippines 4 q
Correct Response Egypt 4 q
• Shows (or describes) a correct method for computing the average (mean) value. Bahrain 3 q
Examples: (11.88+12.00+11.94+12.12+12.06) = 60. 60/5=12.0 Palestinian Nat’l Auth. 3 q
(202+200+201+198+199)/5 = 200. 2400/200=12.0 Chile 3 q
They added together all of the densities and then divided by 5 to get the average. Morocco 3 q
• Shows (or describes) a correct method for determining the median value. Botswana 2 q
Examples: 202, 201, 200, 198, 199. 200 is the median volume, so 2400/200 is the median density Iran, Islamic Republic of 2 q
S032712
(12). South Africa 1 q

12 is the middle value when placedQuestions for Metal
in order (12.12, Crown
12.06, continue.
12.00, 11.94, 11.88). Ghana 1 q
• Other correct Saudi Arabia 0 q
Incorrect Response
• States that it is the average, mean or median value with no or incorrect work shown. Country average vs.
• Shows a computation of density (mass/volume). [No determination of average or median included.]
Examples: They did mass divided by volume. Higher p
2400g/200cc = 12 g/cc Not different O
Lower q
203
Metal crown: determination of average/median value (continued)

Student Responses
Correct Response:
204
Metal crown: determination of average/median value (continued)

Student Responses
Incorrect Response:
205
Physics Forces and Motion Reasoning and Analysis
Extrapolation of distance/time graph Overall Percent Correct
Netherlands 91 p
The graph shows the progress made by a beetle moving along a straight Singapore 90 p
line. Korea, Republic of 90 p
Japan 89 p
Malaysia 89 p
Scotland 88 p
Australia 87 p
14 United States 87 p
Hungary 86 p
12
England 85 p
Sweden 84 p
Hong Kong, SAR 84 p
10
Lithuania 83 p
Distance (cm)
New Zealand 82 p
8 Estonia 82 p
Chinese Taipei 80 p
Slovenia 80 p
6
Latvia 79 p
Israel 79 p
4 Russian Federation 79 p
Norway 75 p
2 Italy 74 O
Chile 73 O
0
5 10 15 20 25 30 Bulgaria 71 O
Time (seconds) International average 71 O
Lebanon 70 O
If the beetle keeps moving at the same speed, how long will it take to Cyprus 68 O
travel 10 cm? Slovak Republic 68 O
Romania 67 O
a 4 seconds Botswana 64 q
b 6 seconds
Morocco 61 q
c 20 seconds Indonesia 61 q
Bahrain 58 q
d 25 seconds
S022041

Armenia 56 q
Item Number: S022041 Serbia and Montenegro 55 q
Tunisia 55 q
Jordan 54 q
Philippines 52 q
Egypt 51 q
Saudi Arabia 40 q
South Africa 35 q
Country average vs.

Higher p
Not different O
Lower q
206
Controlled experiment with cart Overall Percent Correct
Singapore 79 p
The diagrams show nine different trials Michael carried out using carts with Japan 78 p
wheels of two different sizes and different numbers of blocks of equal mass. Korea, Republic of 75 p
He used the same ramp for all trials, starting the carts from different heights. Hong Kong, SAR 66 p
England 65 p
Chinese Taipei 63 p
G H I
Netherlands 59 p
Malaysia 58 p
Australia 58 p
Scotland 58 p
United States 57 p
Hungary 56 p
Lithuania 54 p
U V W New Zealand 54 p
Estonia 51 p
Sweden 48 p
Slovenia 45 O
Armenia 45 O
X Y Z Italy 44 O
Latvia 42 O
Norway 41 O
Israel 41 O
Bahrain 37 q
Romania 36 q
He wants to test this idea: The higher the ramp is placed, the faster the cart Bulgaria 36 q
will travel at the bottom of the ramp. Which three trials should he compare? Jordan 35 q
Cyprus 34 q
Chile 33 q
a G, H and I
Saudi Arabia 32 q
b I, W and Z Macedonia, Republic of 31 q
Lebanon 31 q
c I, V and X
d U, W and X Moldova, Rep. of 30 q
Philippines 30 q
e H, V and Y
Indonesia 25 q
Item Number: S022222 Egypt 23 q
Botswana 23 q
Tunisia 23 q
S022222
Morocco 22 q
South Africa 18 q
Correct Response: E Ghana 18 q
Country average vs.

Higher p
Not different O
Lower q
207
Data trend of masses on spring Overall Percent Correct
Singapore 75 p
The table below shows the results of an experiment to investigate how the Hungary 73 p
length of a spring changes as different masses are hung from it. Slovak Republic 71 p
Mass (grams) Length of Spring (cm) Chinese Taipei 67 p
Estonia 66 p
0 5 New Zealand 65 p
10 7 Armenia 65 p
Chile 62 p
20 9 Italy 60 p
30 11 Japan 56 p
Norway 56 p
40 12 Australia 55 p
50 13 Hong Kong, SAR 55 p
60 13 Lithuania 52 p
Sweden 50 p
Slovenia 49 p
Describe how the length of the spring changed as different masses were
Latvia 47 O
hung from it.
United States 45 O
Netherlands 45 O
Bulgaria 42 O
Israel 41 O
S022286
Jordan 37 q
Romania 36 q
Scotland 34 q
Malaysia 33 q
Egypt 33 q
England 30 q
Philippines 29 q
Item Number: S022286 Saudi Arabia 27 q
Cyprus 26 q
Lebanon 20 q
Indonesia 17 q
Morocco 17 q
Bahrain 13 q
Tunisia 12 q
Botswana 7 q
South Africa 6 q
Ghana 2 q
Country average vs.

Higher p
Not different O
Lower q
208
Data trend of masses on spring (continued)

SCORING
Note: To receive credit, responses must address two basic regions in the table to describe the trend
in spring length as a function of the mass added:
(i) initially, the spring increases in length (at a constant rate) as more mass is added.
(ii) after a point (40 grams), the spring length starts to level off and then remains constant as more
mass is added.
Responses may be quantitative or qualitative in nature. [No credit is lost for using wrong or no units
in describing length or mass.]
Correct Response
• Response includes both regions (i) and (ii).
Examples: At low mass, it grew 2 for every 10 grams. Then it changed by 1 at 40g. Then at 50g,
it did not grow any more.
It increases by 2’s until 30, increases by 1’s until 50, and increases by 0 at 60.
The length increased steadily up to 40g, and then it increased just a little bit more
until it was 13cm at 50 and 60 grams.
At first it got longer every time you added a mass, but then after a while, it did not
get any longer.
• Other correct.
Incorrect Response
• Includes only region (i). Response references only an increase in length as more mass is added
but discussion of leveling off is inadequate or missing.
Examples: The length increased as more mass was added.
The spring length got 2cm longer with each mass.
It increased by 2cm each time until 40 grams.
• Refers only to leveling off of spring length or decreasing increments at higher masses.
[Description of change in region (i) is inadequate or missing.]
Examples: It stretches but only up to 13 cm.
After 50 grams it did not change.
It stretches less at higher masses.
209

Student Responses
Correct Response:
210


Incorrect Response:
211
Metal crown: procedure to find volume of crown Overall Percent Correct
Singapore 38 p
The scientists then needed to find the volume of the crown in order to Japan 36 p
determine its density. The following equipment and materials were Hong Kong, SAR 33 p
available for them to use. Korea, Republic of 33 p
Chinese Taipei 32 p
Jordan 27 p
Estonia 21 p
plastic tray glass container
Lithuania 20 p
Sweden 19 p
Slovenia 19 p
United States 17 p
water supply graduated cylinder New Zealand 16 O
Hungary 15 O
Israel 15 O
Australia 14 O
Describe a procedure that the scientists could use to find the volume of the International average 13 O
crown using some or all of the equipment and materials shown above. You Romania 13 O
may use diagrams to help explain your procedure. Latvia 13 O
Netherlands 13 O
Italy 12 O
Malaysia 11 O
Cyprus 11 O
Bulgaria 11 O
Norway 9 q
Saudi Arabia 9 q
Scotland 8 q
England 8 q
Bahrain 8 q
Egypt 5 q
Armenia 5 q
Indonesia 5 q
Botswana 4 q
Philippines 3 q
South Africa 2 q
Chile 2 q
Ghana 2 q
S032711
Tunisia 1 q
Questions for Metal Crown continue. Morocco 0 q
Country average vs.

Higher p
Not different O
Lower q
212
Metal crown: procedure to find volume of crown (continued)

SCORING
Note: For full credit, responses must describe or diagram a procedure based on displacement and
clearly identify how the volume of the crown is determined. Partial credit is given for procedures or
diagrams that demonstrate knowledge of displacement without a complete description of the steps/
measurements to be made. Responses may also implicitly refer to other materials not indicated in the
diagram (e.g., ruler, marker, etc.). Because it is not totally clear from the diagram what the relative size
of the crown, beaker, and tray are, credit is given for procedures that use any of these materials for
displacement even if the actual procedure might not be completely successful.
Correct Response
• Describes or diagrams a procedure based on displacement of water using measured water level
differences:
i) Adding water to the beaker (sink or tray) and marking the water level.
ii) Placing the crown in the beaker (sink or tray) and marking the new water level.
iii) Measuring the volume difference before/after adding the crown using the graduated cylinder
• Describes or diagrams a procedure based on displacement of water using measured overflow:
i) Filling the beaker (or tray) with water.
ii) Placing the crown in the beaker (or tray) and collecting the overflow.
iii) Measuring the volume of the overflow using the graduated cylinder
• Describes or diagrams a partial procedure that includes displacement of water but with inadequate
or no description of the steps/measurements to determine the volume.
Examples: Put some water in the beaker and add the crown. Measure how much the level of water
went up.
Add the crown to the beaker filled with water. See how much overflowed.
Incorrect Response
• Mentions putting the crown in the beaker (sink or tray) of water with no explicit mention that the
water level will rise/overflow and no or incorrect procedure given for measuring the volume.
Examples: Fill the beaker to the top with water and add the crown. You can get the volume that way.
213

Student Responses
Correct Response:
214


215


Incorrect Response:
216
Physics Heat and Temperature Reasoning and Analysis
Thermometer scale for boiling water Overall Percent Correct
Hong Kong, SAR 38 p

At different altitudes, the boiling point of water ranges from about 80° C to Korea, Republic of 33 p
100° C. Which of the Celsius thermometers shown below would give the Netherlands 33 p
most accurate measurement of the boiling point of water at different Slovak Republic 33 p
altitudes? Estonia 31 p
Chinese Taipei 30 p
80 95 100 125 150 Japan 29 p
Israel 27 p
Lithuania 26 p
United States 26 p
Singapore 25 p
Hungary 24 p
Sweden 22 O
0 75 0 75 50 Slovenia 22 O
New Zealand 22 O
Australia 22 O
A B C D E Latvia 22 O
Thermometers Palestinian Nat’l Auth. 21 O
Egypt 21 O
a Thermometer A Jordan 20 O
England 20 O
b Thermometer B International average 20 O
Thermometer C Bulgaria 20 O
c Scotland 19 O
d Thermometer D Cyprus 17 O
Thermometer E Romania 16 q
e
S022225
Italy 16 q
Bahrain 16 q
Norway 16 q
South Africa 14 q
Tunisia 13 q
Item Number: S022225 Moldova, Rep. of 13 q
Philippines 13 q
Lebanon 12 q
Indonesia 11 q
Armenia 9 q
Chile 9 q
Ghana 8 q
Botswana 8 q
Malaysia 6 q
Morocco 0 q
Correct Response: D Saudi Arabia 0 q
Country average vs.

Higher p
Not different O
Lower q
217
Physics Light Conceptual Understanding
Seeing person in a dark room Overall Percent Correct
Singapore 87 p
A person in a dark room looking through a window can clearly see a person England 83 p
outside in the daylight. But a person outside cannot see the person inside. Scotland 81 p
Why does this happen? New Zealand 81 p
Sweden 80 p
a There is not enough light being reflected off the person in the room. United States 79 p
Lithuania 79 p
b Light rays cannot pass through a window twice.
Chinese Taipei 79 p
c Outside light does not pass through windows. Netherlands 79 p
d Sunlight is not as intense as other sources of light.
Australia 76 p
Estonia 76 p
Norway 75 p
S012004
Israel 75 p
Hong Kong, SAR 73 p
Latvia 72 p
Slovenia 70 p
Romania 69 O
Hungary 69 O
Indonesia 68 O
Italy 68 O
Bahrain 66 O
Philippines 66 O
Jordan 65 O
Cyprus 62 q
Chile 61 q
Japan 61 q
Saudi Arabia 60 q
Tunisia 60 q
Item Number: S012004 Slovak Republic 59 q
Botswana 58 q
Morocco 57 q
Bulgaria 50 q
Egypt 50 q
Malaysia 47 q
Ghana 44 q
Armenia 42 q
South Africa 42 q
Correct Response: A Lebanon 35 q
Country average vs.

Higher p
Not different O
Lower q
218
Angle of reflected light ray Overall Percent Correct
Estonia 83 p
A ray of light strikes a mirror as shown. England 83 p
Netherlands 81 p
Japan 80 p
Singapore 79 p
Armenia 76 p
mirror New Zealand 76 p
Chinese Taipei 75 p
Latvia 74 p
Malaysia 72 p
Cyprus 72 p
Sweden 71 p
Which picture best shows the direction of the reflected light? Lithuania 71 p
Hong Kong, SAR 68 p
Scotland 67 O
Australia 66 O
a b Bulgaria 66 O
Hungary 66 O
mirror mirror Slovenia 63 O
Israel 61 O
Indonesia 61 O
c d Palestinian Nat’l Auth. 60 O
Romania 59 O
United States 59 q
mirror mirror Jordan 59 q
Lebanon 57 q
Norway 57 q
Italy 57 q
Egypt 54 q
Bahrain 54 q
Morocco 51 q
Philippines 51 q
Saudi Arabia 49 q
Chile 45 q
Tunisia 44 q
S022058
Ghana 41 q
Botswana 38 q
Country average vs.

Higher p
Not different O
Lower q
219
Sunlight through a glass prism Overall Percent Correct
The diagram shows a ray of sunlight entering a glass prism. Singapore 65 p
Malaysia 53 p
Hong Kong, SAR 49 p
United States 49 p
England 47 p
sunlight screen Netherlands 45 p
New Zealand 43 p
prism
Chinese Taipei 38 p
Jordan 36 p
Bahrain 34 p
Armenia 33 p
Describe what will be seen on the screen.
Lithuania 32 p
(You may draw on the diagram to help explain your answer.)
Scotland 28 O
Sweden 25 O
Egypt 24 O
Hungary 24 O
Italy 24 O
Item Number: S032375 Australia 22 O
Estonia 20 O
Romania 18 q
SCORING Israel 17 q
Note: For full credit, responses must explicitly indicate that different colors are seen on the screen, Latvia 17 q
either by textual description or by drawing on the diagram. A completely correct or complete sequence
of colors is not required for full credit. Partial credit will be given for responses that show or describe
refraction even if the appearance of the light beams on the screen is not fully described. Norway 15 q
S032375
Slovenia 15 q
Correct Response Saudi Arabia 14 q
• Describes or draws the visible color spectrum. Chile 11 q
Examples: A spectrum of seven colors which is red, orange, yellow, green, blue, indigo, violet. Russian Federation 11 q
• Refers to a spectrum, rainbow, colors, etc. (no color spectrum shown) Philippines 10 q
Examples: I will see many colors on it like the rainbow. Japan 10 q
All the colors of the color spectrum. Indonesia 9 q
There will be seven colors. Lebanon 7 q
• Other fully correct. Bulgaria 7 q
Partially Correct Response Macedonia, Republic of 7 q
Slovak Republic 6 q
• Describes or draws multiple refracted rays but with no explicit connection to color.
Botswana 5 q
Examples: There will be a lot of rays coming out the other side of the prism.
Cyprus 4 q
The light will spread out across that side of the prism and be seen on most of the screen.
South Africa 3 q
• Describes or draws only the refraction (bending) of light beam (no mention of color dispersion).
Examples: The light inside the prism will bend.
The sunlight would go through at an angle.
Ghana 1 q
• Other partially correct. Morocco 1 q
Incorrect Response Tunisia 0 q
• Describes or draws a shadow or image of the prism (or similar).
Examples: The prism will make a shadow on the screen. Country average vs.
• Refers only to seeing sunlight or light on the screen. [No mention of color dispersion or refraction.] International average:
Examples: Sunlight hitting the screen. Higher p
The screen will be bright because there is light falling on it. Not different O
220
Sunlight through a glass prism (continued)

Student Responses
Correct Response:
221
Sunlight through a glass prism (continued)


Incorrect Response:
222
Lightning seen before thunder heard Overall Percent Correct
Singapore 88 p
Mary was looking out her window on a stormy night. She saw lightning and England 74 p
then heard thunder a few seconds later. Chinese Taipei 70 p
Explain why she saw lightning before she heard thunder. Japan 65 p
Hong Kong, SAR 62 p
Lithuania 61 p
Sweden 59 p
Botswana 54 p
Hungary 54 p
Norway 54 p
Estonia 53 p
Latvia 52 p
Netherlands 52 p
S032626
Australia 51 p
Malaysia 47 p
Israel 46 O
United States 46 p
Bahrain 45 O
Saudi Arabia 45 O
Romania 44 O
Slovenia 44 O
Bulgaria 43 O
New Zealand 43 O
Scotland 43 O
Italy 41 O
Egypt 40 O
Jordan 39 O
Item Number: S032626 Serbia and Montenegro 37 q
Cyprus 35 q
SCORING Moldova, Rep. of 35 q
Correct Response Lebanon 32 q
• Refers to light traveling faster than sound (or similar). Palestinian Nat’l Auth. 31 q
Examples: Speed of light is faster than speed of sound. Armenia 26 q
Light travels quicker than sound. Chile 19 q
It takes more time for sound to reach her than light. Indonesia 19 q
• Other correct. Iran, Islamic Republic of 15 q
Philippines 13 q
Incorrect Response
Morocco 12 q
• Refers only to lightning being closer or thunder being further away (explicitly or implicitly).
Tunisia 8 q
Examples: Thunder has a longer way to go.
South Africa 4 q
Thunder is striking from kilometers away.
Ghana 1 q
• Refers to lightning occurring first, causing thunder, or similar.
[No explicit mention of the relative speed of light/sound to travel.]
Examples: Lightning is so quick, thunder only happens afterward. Country average vs.
The noise occurs later. International average:
Thunder occurs from lightning. Higher p
Thunder is the echo of lightning. Not different O
223
Lightning seen before thunder heard (continued)

Student Responses
Correct Response:
Incorrect Response:
224
Physics Light Reasoning and Analysis
Candle position reflected on grid Overall Percent Correct
A candle is placed on a ruled grid in front of a mirror, as shown. At what Singapore 88 p
point will the reflection of the candle appear to be? Netherlands 87 p
New Zealand 86 p
England 86 p
Scotland 83 p
Hungary 80 p
Hong Kong, SAR 80 p
A B
Estonia 80 p
Australia 80 p
Chinese Taipei 77 p
Mirror C D
Japan 75 p
Bahrain 74 p
Malaysia 73 p
United States 73 p
Slovenia 72 p
Norway 70 p
Latvia 69 p
Lithuania 68 p
Cyprus 65 O
Armenia 65 O
Italy 64 O
Israel 63 O
Chile 63 O
Indonesia 60 q
Sweden 60 q
a Point A
b Point B Palestinian Nat’l Auth. 55 q
Bulgaria 54 q
c Point C
Romania 53 q
d Point D Macedonia, Republic of 53 q
S012015
Egypt 53 q
Lebanon 51 q
Saudi Arabia 48 q
Morocco 46 q
Jordan 45 q
Tunisia 43 q
Botswana 42 q
Philippines 41 q
Ghana 28 q
Country average vs.

Higher p
Not different O
Lower q
225
Shadow size from distance diagram Overall Percent Correct
A tiny light bulb is held 20 centimeters to the left of a square card, which is Sweden 69 p
in turn held 20 centimeters to the left of a poster board, as shown. The Belgium (Flemish) 69 p
shadow of the card on the poster board has a side of 10 centimeters. Estonia 68 p
Chinese Taipei 68 p
Japan 67 p
Shadow
Singapore 66 p
Card
Netherlands 64 p
Light Lithuania 63 O
Bulb Lebanon 63 O
Malaysia 63 p
Scotland 63 O
Romania 62 O
Hungary 61 O
United States 61 O
Latvia 61 O
Poster Hong Kong, SAR 61 O
Board
Slovenia 61 O
Botswana 60 O
20 cm 20 cm
Armenia 60 O
Israel 60 O
England 60 O
If the poster board is moved 40 cm further to the right so that it is 80 cm from
the light, what will be the new side of the card’s shadow on the poster board?
Italy 59 O
a 5 cm
b 10 cm Australia 58 O
c 15 cm
Bahrain 58 O
d 20 cm New Zealand 57 O
Philippines 57 O
Norway 57 O
Bulgaria 56 O
Item Number: S012029 Morocco 56 O
S012029
Jordan 56 O
Cyprus 55 q
Tunisia 53 q
South Africa 51 q
Indonesia 50 q
Saudi Arabia 49 q
Egypt 48 q
Chile 47 q
Country average vs.

Higher p
Not different O
Lower q
226
Brush reflected in mirror at angle Overall Percent Correct
New Zealand 75 p
The picture shows a paint brush that is lying on a shelf in front of a mirror. Netherlands 72 p
Draw a picture of the paint brush as you would see it in the mirror. Use the Belgium (Flemish) 71 p
patterns of lines on the shelf to help you. England 71 p
Scotland 70 p
Estonia 67 p
Japan 66 p
mirror Australia 61 p
Hungary 61 p
Hong Kong, SAR 60 p
Singapore 59 p
Latvia 59 p
Lithuania 58 p
Armenia 54 p
Norway 53 p
Slovenia 53 p
Chinese Taipei 52 p
Sweden 51 p
Malaysia 51 p
United States 51 p
Bahrain 44 O
Italy 42 O
S022279
Romania 41 O
Bulgaria 37 q
Israel 36 q
Chile 35 q
Indonesia 35 q
Cyprus 31 q
Tunisia 26 q
Item Number: S022279 Philippines 24 q
Morocco 23 q
Egypt 22 q
Saudi Arabia 21 q
Lebanon 21 q
Jordan 20 q
Botswana 17 q
South Africa 8 q
Ghana 4 q
Country average vs.

Higher p
Not different O
Lower q
227
Brush reflected in mirror at angle (continued)

SCORING
Note: A brush on the borderline of the correct squares should be accepted as correct. Credit is given
for a brush in the correct squares even if the hairs are not clearly shown. Only if the hairs are clearly
shown in the wrong direction is the answer incorrect.
Correct Response
• Correct placement: angle, grid position, and direction (hairs to the right). (See Figure 1.)
Incorrect Response
• Correct angle and placement, but image flipped with hairs clearly turned to the left. (See Figure
2.)
• Image parallel to original (hairs to the right or left). (See Figure 3; other rows/columns are
possible).
• Correct angle but image translated (hairs to the right or left). (See Figure 4; other rows/columns
are possible).
&IGURE &IGURE
&IGURE &IGURE
OR OR
228
Brush reflected in mirror at angle (continued)

Student Responses
Correct Response:
Incorrect Response:
229
Physical States
Physics Factual Knowledge
and Changes in Matter
Wet towel dries in the sun Overall Percent Correct
Chinese Taipei 98 p
A wet towel will dry when it is left in the Sun. Which process occurs to make Singapore 95 p
this happen? Hungary 95 p
Estonia 94 p
a melting Slovak Republic 94 p
Hong Kong, SAR 94 p
b boiling
Japan 94 p
c condensation Russian Federation 94 p
d evaporation
Tunisia 91 p
Lithuania 91 p
Slovenia 90 p
England 89 p
S032055
New Zealand 88 p
Australia 88 p
Latvia 88 p
Netherlands 88 p
Malaysia 87 p
Bulgaria 87 p
Scotland 87 O
Jordan 86 O
Romania 86 O
Armenia 86 O
United States 85 O
Israel 85 O
Bahrain 84 O
Norway 84 O
Morocco 83 O
Sweden 82 O
Saudi Arabia 82 O
Item Number: S032055 Italy 81 O
Cyprus 77 q
Indonesia 77 q
Chile 76 q
Lebanon 76 q
Philippines 69 q
Botswana 67 q
Egypt 59 q
South Africa 51 q
Country average vs.

Higher p
Not different O
Lower q
230
Item Index 1999
Content Domain Page Content Domain Page
Earth Science Physics
B01 Layers of Earth 3 B02 Energy released from car engine 38
B05 Elevation diagram of wind/temperature 4 B03 Greatest density from mass/volume table 39
D03 Contour map showing river 5 B06 Color reflecting most light 40
F05 Oxygen equipment on mountain tops 6 D01 Light rays through magnifying glass 41
H03 Why moon shines 7 D02 Magnetic substances 42
H04 Diagram of soil layers 8 D04 Sequence of energy changes 43
J01 Earth’s plates over millions of years 9 F02 Why light-colored clothes are cooler 44
J06 Factor explaining seasons on Earth 10 H05 Energy stored in food 45
J09 Life on other planets 11 J04 Evaporation rate by surface area 46
R04 Atmospheric conditions in jets 12 J05 Gravity acting on rocket 47
Z02 Diagram of rain from sea 13 J08 Sunscreen to protect against radiation 48
L01 Rotating forces on wheel 49
Life Science L04 Efficiency of machines 50
B04 Pulse/breathing rate after exercise 14 N01 Complete circuits 51
D05 Sensory messages to the brain 15 N09 Balancing 10 and 5 liter buckets 52
D06 Seed development from plant part 16 N10 Flashlights with white/black reflectors 53
F01 Characteristic of mammal 17 P01 Determination of speed from graph 54
F03 Interpretation of senses 18 P02 Amount of light on wall and ceiling 55
H01 NOT a function of blood 19 R02 Appearance of red dress in green light 56
H02 Role of vitamins 20 X01 Conversion of electrical/light energy 57
J02 Feature shared by all insects 21 Z03 Heat expansion of balloons 58
J07 Reason for protein in diet 22
L02 Large leaves on seedlings 23 Chemistry
L03 Physical characteristic of prey 24 F06 Best reason for painting iron surfaces 59
L05 Wolves marking territory 25 H06 Burning wood absorbs/releases energy 60
L08 Complete food web 26 J03 Compounds, molecules and atoms 61
N02 Food web: effect of crop failure 27 L06 Filtration of mixtures 62
N03 Bacteria to convert milk to yogurt 28 N07 Example of chemical reaction 63
N05 Bone meal for plant growth 29 R05 Small pieces of wood burn faster 64
N06 Definition of tissue 30 Z01A Galvanization of steel 65
N08 Mammals/lizards living in cold regions 31 Z01D Galvanization of steel 66
P03 Tree growth 32
P04 Hibernating animals 33 Environmental and Resource Issues
P06 Digestion in stomach 34 F04 Area where soil is washed away 67
R03D Two outcomes of introducing new species 35 L07 Effectiveness of insecticides 68
X02A Importance of trees/sun in rain forest 36 P05D Two reasons for famine 69
X02B Importance of trees/sun in rain forest 37 R06 Result of global warming 70
Scientific Inquiry and the Nature of Science

N04 Evaporation of vinegar and oil 71
P07 Replication of measurements 72
R01 Bacteria/mold experiment 73
X03 Heart rate experiment design 74
Item Index 2003
Content Domain Page Content Domain Page
Chemistry Environmental Science
S032057 Litmus test 75 S012017 Increased carbon dioxide
S012003 Fanning a wood fire 77 in atmosphere 125
S022188 Reactions releasing energy 78 S022240 Main cause of acid rain 126
S022198 Chemical change involving elements 79 S032446 Activity to reduce air pollution
in a city 127
S022191 Candles burning in 3 jars 80
S012042 Nonrenewable natural resource 128
S022187 NOT a mixture 85
S032242 Renewable energy source 129
S032564 Solution half as concentrated 86
S032422 Group of renewable energy sources 131
S032574 Which substances are elements 87
S012005 Overgrazing by livestock 132
S032709 Metal crown: density of metal block 88
S022088A Positive/negative effect of dam 133
S012016 Substance type of black/white
powder 91 S022088B Positive/negative effect of dam 137
S022206 Reaction of chlorine and sodium 92 S032063 Drinking water from sea water 141
S032562 Separation of salt/sand/iron

filings mixture 93 Life Science
S032713A Metal crown: what metal block 98 S012038 Main function of red blood cells 144
was made of S022235 Plant growth experiment 145
S032713B Metal crown: what crown was S032083 Fossils in sedimentary rock 146
made of 101
S032706A Galapagos Islands: compare beak
S012040 Atoms removed from chair 104 depths of Species 1 and 2 147
S012025 Particles in nucleus of atom 105 S032706B Galapagos Islands: size of seeds
S022202 Neutral atom gains electron 106 each species eats 151
S032707 Galapagos Islands: graphs of beak
Earth Science depths for Species 3 and 4 155
S022283 Appearance of Jupiter and Moon 107 S032704 Galapagos Islands: plants/animals
inhabited island first 158
S032437 Why the moon changes shape 109
S032705A Galapagos Islands: effect of cats 160
S032532 Position of the moon during solar
eclipse 110 S032705B Galapagos Islands: effect of goats 162
S032714 Direction dropped ball will fall 112 S032682 Elements that make up animals
and plants 164
S032150 Sun is an example of a star 113
S032202 Community of mice, snakes and
S032301 The surface temperatures of Venus wheat plants 165
and Mercury 114
S032637 Leafy vegetables important
S012013 True statement of mountain age 115 for human health 168
S032656 Pacific Ring of Fire 116 S022154 Transmission of cold in classroom 169
S012018 Substance NOT a fossil fuel 117 S012026 Son inherits traits 171
S012041 Rock at bottom of lake/ocean 118 S012039 Traits transferred from generations 172
S022074 Fossil fuels 119 S022117 Biological control of insect
S012027 Time/temperature table 120 population 173
S032652 Map of the world with lines S032008 Fertilization in animals 174
of latitude 121 S022152 Bodily process to prevent overheating 175
S012030 Stone in underground caves 122 S022160 Advantage of having two ears 177
S022275 Abundance of gases in atmosphere 123 S012001 Organ NOT in abdomen 179
S012006 Changes in river shape/speed 124 S012014 Message from eyes to brain 180
Item Index 2003
Content Domain Page
Life Science (continued)
S032386 Absorption of food into the blood
stream 181
S032607 Fish organ like human lung 182
S022161 How glasses/contact lenses work 183
S012028 Characteristics of animal groups 185
S032595 Cats most closely related to which
animal 186
Physics
S022035 Poles on cut magnet 187
S012037 Diagram of batteries in a flashlight 189
S032625A Compass placed next to a
magnet/draw 190
S032625B Compass placed next to a
magnet/explain 192
S012002 Stored energy in two springs 195
S032131 Nail pulled out of a wooden board 196
S022040 Path of ball released from orbit 198
S032281 Why helium balloon moves upward 199
S032712A Metal crown: why scientists
repeated measurement 200
S032712B Metal crown: determination
of average/median value 203
S022041 Extrapolation of distance/time graph 206
S022222 Controlled experiment with cart 207
S022286 Data trend of masses on spring 208
S032711 Metal crown: procedure to find
volume of crown 212
S022225 Thermometer scale for boiling water 217
S012004 Seeing person in a dark room 218
S022058 Angle of reflected light ray 219
S032375 Sunlight through a glass prism 220
S032626 Lightning seen before thunder heard 223
S012015 Candle position reflected on grid 225
S012029 Shadow size from distance diagram 226
S022279 Brush reflected in mirror at angle 227
S032055 Wet towel dries in the sun 230

TIMSS8 Science ConceptsItems PDF

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

TIMSS8 Science ConceptsItems PDF

Uploaded by

Copyright:

Available Formats

8

Guide to Using the Science Concepts and Science Items Materials

Teacher-designed formative assessments. A teacher might, for example, decide to

Understanding misunderstandings. Again, a teacher might decide to examine the incorrect

1999 Content Domains:

Content Domain Cognitive Domain

Layers of Earth Overall Percent Correct

Country average vs.

Content Domain Cognitive Domain

Using Tools, Routine Procedures

Elevation diagram of wind/temperature Overall Percent Correct

Country average vs.

Content Domain Cognitive Domain

Using Tools, Routine Procedures

Contour map showing river Overall Percent Correct

Country average vs.

Content Domain Cognitive Domain

Oxygen equipment on mountain tops Overall Percent Correct

Country average vs.

Content Domain Cognitive Domain

Why moon shines Overall Percent Correct

Hong Kong, SAR 96

Country average vs.

Content Domain Cognitive Domain

Diagram of soil layers Overall Percent Correct

Country average vs.

Content Domain Cognitive Domain

Earth's plates over millions of years Overall Percent Correct

Country average vs.

Content Domain Cognitive Domain

Factor explaining seasons on Earth Overall Percent Correct

Country average vs.

Content Domain Cognitive Domain

Life on other planets Overall Percent Correct

Content Domain Cognitive Domain

Atmospheric conditions in jets Overall Percent Correct

Content Domain Cognitive Domain

Diagram of rain from sea Overall Percent Correct

Content Domain Cognitive Domain

Pulse/breathing rate after exercise Overall Percent Correct

Country average vs.

Content Domain Cognitive Domain

Sensory messages to the brain Overall Percent Correct

Country average vs.

Content Domain Cognitive Domain

Seed development from plant part Overall Percent Correct

Country average vs.

Content Domain Cognitive Domain

Characteristic of mammal Overall Percent Correct

Country average vs.

Content Domain Cognitive Domain

Interpretation of senses Overall Percent Correct

Country average vs.

Content Domain Cognitive Domain

NOT a function of blood Overall Percent Correct

Country average vs.

Content Domain Cognitive Domain

Role of vitamins Overall Percent Correct

Country average vs.

Content Domain Cognitive Domain

Feature shared by all insects Overall Percent Correct

Country average vs.