Download as pdf or txt
Download as pdf or txt
You are on page 1of 13

Journal of Education and Learning (EduLearn)

Vol. 18, No. 2, May 2024, pp. 499~511


ISSN: 2089-9823 DOI: 10.11591/edulearn.v18i2.21117  499

Factors affecting students’ concept retention in learning science


online using instructional videos

Catherine B. Aguanta1, Margery Anne T. Augusto1, Jonajean V. Bajenting1, Katrina Claire


Buayaban1, El Jane P. Cruz1, Niña Faith Fantonial1, Jane Aubrey M. Kwan1, Jimmoy Legaspino1,
Dharel P. Acut2,3, Marchee T. Picardal1,4
1
Department of Science Education, College of Teacher Education, Cebu Normal University, Cebu City, Philippines
2
Graduate School, College of Teacher Education, Cebu Normal University, Cebu City, Philippines
3
Social Sciences Division, National Research Council of the Philippines, Taguig, Philippines
4
Governmental, Educational and International Policies Division, National Research Council of the Philippines, Taguig, Philippines

Article Info ABSTRACT


Article history: Effective science instruction in a blended learning approach is synonymous
with the strategic use of instructional videos (IVs) to fill the gap in teacher
Received Jul 17, 2023 support. This study aims to determine the IVs’ effectiveness in improving
Revised Oct 9, 2023 students' concept retention and overall learning experiences. The
Accepted Oct 23, 2023 experimental group was exposed to instruction integrating IVs via embedded
mixed-method design, whereas the control group was exposed to traditional
lecture methods. The results showed that students' post-test scores and
Keywords: concept retention improved significantly in the experimental group, where
students reported better learning experiences than in the control group. This
Concept retention beneficial effect of a technology-integrated approach can be attributed to
E-learning various elements of IVs, such as engaging content, motion graphics, video
Instructional videos length, the language used, and the speaker's perspective. This study
Science education recommends that IVs be used to enhance learning opportunities and results
Video features in the teaching and learning process.
This is an open access article under the CC BY-SA license.

Corresponding Author:
Dharel P. Acut
Graduate School, College of Teacher Education, Cebu Normal University
Main Campus, Osmeña Blvd., Cebu City, Cebu 6000 Philippines
Email: [email protected]

1. INTRODUCTION
Advancements in technology have led to a wide range of new instructional media that can be used in
education. For example, the widespread availability of the Internet and mobile devices has led to the
development of online and mobile learning resources, such as videos, podcasts, and interactive simulations
[1]–[3]. Instructional videos (IVs) have been part of the educational process, supporting varied, flexible
teaching and learning modalities around the globe [4]. Purported to impact students’ holistic development
and retention, IVs help learning be more efficient, interactive, and meaningful to students [5]. At a certain
point in educational advancements, the influence of instructional media assisted in evaluating students' ability
to learn effectively and collaboratively [6], [7]. Students are exposed to a learning experience comprised of
good sensory experience-coordination, stimulation, and engagement. These educational materials increase of
knowledge retention, information processing skills, and increase learning motivation [8], [9].

Journal homepage: http://edulearn.intelektual.org


500  ISSN: 2089-9823

Likewise, the IVs material has been known to assist teachers in their pedagogical strategies.
Research has shown that IVs can increase teacher effectiveness by allowing them to present information in a
visual and auditory format, engage students more effectively, and provide new ways to assess student
learning and progress [10]. IVs can also help teachers differentiate instruction and provide personalized
learning experiences for students [11], [12]. IVs can also help teachers save time, providing students with
independent learning opportunities allowing teachers to focus on other areas of instruction or to work with
small groups of students [13], [14].
Despite the benefits of using IVs to cater to students’ needs, their retentions are put into tests every
quarter, leaving queries of how effective IVs are to the learners’ end in understanding science concepts.
According to Mayer and Moreno [9], the complexity of the content should be considered as its implications
may be more or less likely to contribute to students’ academic achievement. With the physical absence of
instructors in students’ learning process, they experienced barriers in learning as facilitation nedds to be
attended to, leading to confusion and misconception of science concepts. Video length also influences the
students’ decision-making, whether to watch the video or not, supporting a study by Ali [15], wherein
students quickly get bored watching IVs. In a local context, Rosales [16] implied the effectiveness of
subtitled video materials due to their benefits. However, it still needs to be recognized by the teachers,
leaving students confused about the terms used in the videos and unable to research the jargon. To address
the research gaps mentioned, scrutinizing IVs should be considered. Therefore, to uphold effective learning,
factors of the IVs are identified to recognize the gaps teachers struggle with in delivering their lessons that
affect the students’ retention of science concepts. Specifically, this study aims to answer the following
questions, to wit:
− What is the level of students’ retention in learning science in the control group (without IVs) and
experimental group (with IVs)?
− Is there a significant difference in the level of concept retention between the experimental and control
groups?
− What factors of IVs affect the students’ concept retention?
− To what extent do these factors of IVs affect the students’ concept retention?
− What are the student’s learning experiences in integrating IVs into their science online class?

2. RESEARCH METHOD
2.1. Research design
This study utilized an embedded mixed methods design, combining quasi-experimental and semi-
structured interviews. This research design combines qualitative and quantitative techniques, approaches,
concepts, methods, and language for a comprehensive understanding and validation [17]. The researchers
measured concept retention in students who watched IVs versus those who did not use a quasi-experimental
design with a pretest and posttest. A Likert scale survey was used to identify the elements of IVs and their
effects on retention. After watching the videos, participants' learning experiences were evaluated using a one-
on-one interview method, which helped to pinpoint their main points of view and experiences.

2.2. Locale and respondents


This study was conducted in a private school in Consolacion, Cebu, Philippines, where data was
collected using Google Forms from Grade 8 Science subjects. Due to COVID-19 restrictions, the study was
conducted online with the cooperating teacher. The participants were divided into two groups of at least 26
students each. One group was exposed to science IVs, while the other was the control group. The researchers
used purposive sampling to select potential participants based on specific criteria [18], including i) selecting
two classes with the same number of students, ii) two classes under the supervision of one science teacher,
and iii) students taking up a science subject. Prior to data collection, ethical considerations regarding human
participants were addressed to ensure a proper research process. Consent letters were distributed online, and
participants were assured of their safety and protection. The collected data was analyzed to maintain
objectivity and eliminate biases. The study followed strict research ethics protocols approved by the CNU-
Research Ethics Committee (1229/2022-03 Buayaban).

2.3. Instruments
2.3.1. Detailed lesson plan
Lesson plans for 8th-grade Biology were developed by researchers, with four lessons covering
reproductive system parts and functions, hormone roles, feedback mechanisms, and nervous system
coordination. These plans were modified in collaboration with the cooperating in-service teacher. The lesson

J Edu & Learn, Vol. 18, No. 2, May 2024: 499-511


J Edu & Learn ISSN: 2089-9823  501

plans were used for both control and experimental groups, with the experimental group receiving additional
intervention variables.

2.3.2. Pretest and posttest questionnaire


The study used researcher-made questionnaires to measure pre- and post-knowledge of the nervous
and reproductive systems. The pretest questionnaire had 20 multiple-choice questions, while the posttest had
20 questions to measure how well students remembered the topic. The questionnaires were distributed using
Google Forms through Google Classroom. A pilot test was conducted before the actual study with 20
students [19]. The Kuder-Richardson 20 was used in this test to assess the reliability of the pre-posttest
questionnaire. The findings revealed a moderate correlation with a value of 0.6, implying that the
questionnaire is valid.

2.3.3. Survey questionnaire


The questionnaire includes a Likert scale and open-ended questions to evaluate the impact of IVs on
students' concept retention. The Likert scale contains statements about video content, motion graphics,
language, subtitles, speaker perspective, and video length. The open-ended questions aim to gather students'
positive and negative experiences, particularly those in the experimental group taught using IVs. Cronbach's
alpha reliability test was used to measure the Likert scale and open-ended questions. The result obtained was
0.7, indicating that the instruments are acceptable and reliable for the study.

2.4. Instructional design


The 7Es (elicit, engage, explore, explain, elaborate and evaluate and extend) lesson plan model was
used for the intervention's instructional design [20]. Prior knowledge was extracted from students using
guessing game activities and process questions (elicit phase). Critical thinking skills were promoted through
open-ended questions, debates, sequencing order, and mnemonics activities (engage phase). Then, the
students were encouraged to interpret observations from simulations and matching activities to deepen their
understanding (explore phase). Furthermore, the study compared the effects of science IVs on students'
concept retention between experimental and control groups. The experimental group was shown IVs
facilitated by the cooperating teacher, while the control group received conventional instruction through
PowerPoint presentations and virtual discussions (explain phase). Sequentially, students in both groups were
given specific questions to answer, followed by process questions for idea extension (elaborate phase). The
concluding activity involved formal and informal assessments, including oral recitations, multiple choice and
true or false questions, and work submission through Google Classroom and other online platforms (evaluate
phase). Lastly, students were required to complete the homework, aiding in concept retention and application
to new situations (extend phase).

2.5. Data analysis


The data obtained from the implementation was saved in a spreadsheet. Normality tests were
conducted to determine the statistical test to be used due to a small sample size. As shown in Table 1, data
are normally distributed in terms of kurtosis and skewness. For Shapiro-Wilk values, the data are
approximately normally distributed since most of the p-values are above 0.05, keeping the null hypothesis.

Table 1. Normality tests of participants’ pretest, posttest, and delayed test scores
Kolmogorov-Smirnov Shapiro-Wilk
Groups n x̄ SD Test P- Test P- Skewness Kurtosis
statistic value* statistic value*
Control Group RS pretest 24 4.96 1.654 0.198 0.266 0.929 0.095 0.386 -0.296
Experimental Group RS pretest 24 5.13 1.963 0.151 0.593 0.965 0.549 0.073 -0.093
Control Group RS posttest 24 6.04 2.074 0.182 0.363 0.935 0.129 -0.666 0.332
Experimental Group RS 24 6.63 1.583 0.188 0.325 0.919 0.057 -0.035 -1.208
posttest
Control Group NS pretest 24 4.13 1.513 0.159 0.530 0.921 0.060 0.757 0.668
Experimental Group NS pretest 24 4.00 1.251 0.293 0.026 0.769 0.000 1.163 0.714
Control Group NS posttest 24 5.46 1.978 0.178 0.394 0.955 0.344 -0.190 -0.374
Experimental Group NS 24 6.04 1.488 0.197 0.272 0.912 0.039 -0.595 -0.291
posttest
Control Group delayed test 24 13.38 3.965 0.126 0.799 0.943 0.186 -0.431 -0.662
Experimental Group delayed 24 13.33 2.565 0.239 0.109 0.855 0.003 -1.687 3.938
test
Note. RS – Reproductive System; NS – Nervous System

Factors affecting students’ concept retention in learning science online using … (Catherine B. Aguanta)
502  ISSN: 2089-9823

The pretest, post-test, and delayed test (content retention test) scores were analyzed using mean and
standard deviation for descriptive statistics. The t-test for dependent samples was used to compare the means
of two sets of scores directly related to each other in comparing pretest-posttest scores and posttest-delayed
test scores. Meanwhile, descriptive analysis summarizes the findings to answer how much the IVs factors
influence respondents' concept retention. Statistical analysis and treatment were done using the software
statistical packages for social sciences (SPSS) 26. In the qualitative phase, the results of the open-ended
question questionnaire are analyzed and scrutinized by Braun and Clarke [21] using reflexive thematic
analysis to assess each participant's learning experiences.

3. RESULTS AND DISCUSSION


3.1. Test scores of the participants
This section shows the students' test scores in the pretest, post-test, and delayed test, as shown in
Table 2. The control group had below-average pretest scores in reproductive and nervous system concepts.
Meanwhile, the experimental group had an average pretest score in the reproductive system concept but had
below-average pretest scores in the nervous system concept. Overall, both groups had below-average pretest
scores for the two concepts. Individual differences can contribute to variations in pretest scores, with some
students naturally performing below average due to diverse backgrounds, abilities, and prior knowledge [22].

Table 2. Respondents’ pretest, posttest, and delayed test scores


Pretest Post-test Delayed test
Group Topic
Mean SD Description Mean SD Description Mean SD Description
Control Reproductive system 4.96 1.65 Below average 6.04 2.07 Average 6.71 2.01 Average
Nervous system 4.13 1.51 Below average 5.46 1.98 Average 6.67 2.01 Average
Overall 9.09 3.16 Below average 11.50 4.05 Average 13.38 4.02 Average
Experimental Reproductive system 5.13 1.96 Average 6.63 1.58 Average 6.92 1.02 Average
Nervous system 4.00 1.25 Below average 6.04 1.49 Average 6.83 1.01 Average
Overall 9.13 3.21 Below average 12.67 3.07 Average 13.75 2.03 Average

Both groups had average post-test scores for the two concepts. However, the experimental group
gained higher per-concept and overall post-test scores than the control group. A delayed test was also
administered to evaluate students' retention, revealing that the experimental group had higher per-concept
and overall delayed test scores.
Table 3 shows the difference in pretest and post-test scores between both groups. It can be noted that
both groups gained higher post-test scores from the pretest scores. The experimental group consistently had a
higher difference score for reproductive system and nervous system concepts as compared to the control
group.

Table 3. Comparison between the respondents’ pretest and the posttest scores
Mean
Group Topic SD t-value p-value
Pretest Post-test Difference
Control Reproductive system 4.96 6.04 1.08 1.95 2.716 0.012
Nervous system 4.13 5.46 1.33 1.49 4.372 0.000
Overall 9.09 11.5 2.41 1.72 4.852 0.000
Experimental Reproductive system 5.13 6.63 1.50 2.54 2.897 0.008
Nervous system 4.00 6.04 2.04 2.33 4.291 0.000
Overall 9.13 12.67 3.54 2.42 5.058 0.000

Moreover, test statistics revealed that both groups had significant medium differences for the
reproductive system, while a significant difference was observed for the nervous system concept. Since a
significant difference was observed in both groups' pretest and post-test scores, as shown in Table 4, the null
hypothesis is rejected, indicating that the instruction for the control group and the intervention for the
experimental group were all effective.
The content retention of both groups is very high for the two concepts. However, a higher retention
percentage is observed in the control group, as shown in Table 5. Furthermore, test statistics revealed a
significant medium difference in students' concept retention for both groups. However, there is no significant
difference in their retention of the reproductive system concept, as shown in Tables 6 and 7.

J Edu & Learn, Vol. 18, No. 2, May 2024: 499-511


J Edu & Learn ISSN: 2089-9823  503

Table 4. Difference between the pretest and posttest scores of the two groups
Group Topic Test Statistic p-value* Description Remarks
Experimental Reproductive system 2.897 0.008 Significant medium difference Reject null hypothesis
Group Nervous system 4.291 0.000 Significant large difference Reject null hypothesis
Control Reproductive system 2.716 0.012 Significant medium difference Reject null hypothesis
Group Nervous system 4.372 0.000 Significant large difference Reject null hypothesis
Note. H01: There is no significant difference between the pretest and post-test scores of the respondents; *significance value=0.05

Table 5. Percent content retention of the respondents


Mean
Group Topic % Retention Description
Posttest Delayed test Difference
Control Reproductive system 6.04 6.71 0.67 >100 Very high
Nervous system 5.46 6.67 1.21 >100 Very high
Overall 11.50 13.38 1.88 >100 Very high
Experimental Reproductive system 6.63 6.92 0.29 >100 Very high
Nervous system 6.04 6.83 0.79 >100 Very high
Overall 12.67 13.75 1.08 >100 Very high

Table 6. Difference between the post-test and delayed test scores of the two groups
Group Topic Test Statistic p-value* Description Remarks
Experimental Reproductive system 0.892 0.381 No significant difference Accept null hypothesis
Group Nervous system 2.632 0.015 Significant medium difference Reject null hypothesis
Control Reproductive system 1.515 0.143 No significant difference Accept null hypothesis
Group Nervous system 3.136 0.005 Significant medium difference Reject null hypothesis
Note. H02: there is no significant difference between the posttest and delayed test scores of the respondents; *significance value=0.05

Table 7. Comparison of mean gain of students’ concept retention


Topic Group Mean gain SD t-value p-value* Remarks
Reproductive system Control group 0.67 1.95 -0.649 .520 Not significant
Experimental group 0.29 1.02
Nervous system Control group 1.21 2.01 -0.363 .719 Not significant
Experimental group 0.79 1.00
Note. H03: there is no significant difference between the posttest and delayed test scores of the respondents; *significance value=0.05

The IVs support students' learning progress across various subjects, particularly in science. They
effectively address learners' challenges by assisting them in overcoming barriers to understanding topics
across all subject areas [23], mainly when educational institutions increasingly rely on online learning.
Ensuring student retention is crucial for success in higher education. Shieh and Yu [24] defined learning
retention as retaining memories after learning. The study found no significant difference between the mean
gain scores of experimental and control groups. However, this does not imply that independent variables do
not positively affect concept retention and overall learning experiences. The study considered factors such as
COVID-19's effects on the online learning environment, unstable internet connections, and distractions at
home, which may have contributed to the lack of change in test scores determining concept retention. As
claimed by Geri [25], investigating the impact of videos on students' retention in distance learning reveals
how educational videos positively impact increasing students' retention. Similarly, the study conducted by
Duverger and Steffes [26] reported that videos increase students' retention significantly as long as the video
is congruent with the instructional materials of the lesson.

3.2. Perceptions towards the use of instructional videos


IVs contribute to the students' learning progress in different subjects, especially in science. YouTube
videos effectively deal with the learners' difficulties, helping them overcome barriers to understanding topics
of every subject [23], especially during this pandemic wherein educational institutions lean on online
learning. The factors of the videos include the content, motion graphics, language and presence of subtitles,
perspective or the speaker's persona, and length. These factors affect the concept retention of the students.
Learning content is a broad definition of facts, themes, behaviors, beliefs, concepts, and topics often
classified within each subject or learning area under knowledge, values, attitudes, and skills anticipated to be
learned, forming the basis of teaching and learning. The content of IVs should appear adequate to the
understanding of the learners. Content takes part in the students' retention, as the cognitive load needs to be
considered to ensure the effectiveness of IVs [9].
Table 8 summarizes the content of IVs that positively affects students' concept retention. It gathered
that 6.9% firmly agree, with a mean of 4.76 and a standard deviation of 0.42, which means that the video is
Factors affecting students’ concept retention in learning science online using … (Catherine B. Aguanta)
504  ISSN: 2089-9823

highly related to their topic. On the other hand, with a mean of 4.69 and 0.54 standard deviation, 73.1% of
the students agreed strongly on how the content of IVs effectively helps emphasize essential concepts of the
Science lesson. Furthermore, with a mean of 4.46 and a standard deviation of 0.70, 57.7% of students
strongly agree that videos further explained the processes and function of the body system per learning
competency. Furthermore, 65.4%, with a mean of 1.5 and 0.90 standard deviations, strongly disagree that the
IVs did not contribute to their understanding of the lesson. In the study of Mayer and Moreno [9], content
takes part in the students' retention, as the cognitive load needs to be considered to ensure the effectiveness of
IVs. As well as its complexity, one should be aware of the concept of combining visual and auditory channels
as its implications may be more or less likely to contribute to students' academic achievement, which implies
that teachers should scout effective, readily available IVs online for integration in the teaching and learning
process.

Table 8. Participants’ perception of the content of the videos used in the intervention
Level of agreement (%)
Statements Mean SD Interpretation
1 2 3 4 5
The videos presented are highly related to 0 0 0 23.10 76.90 4.76 0.42 Strongly agree
the topic.
The videos effectively help in emphasizing 0 0 3.80 23.10 73.10 4.69 0.54 Strongly agree
the important concepts of the lesson.
The videos further explained the processes 0 0 11.5 30.80 57.70 4.46 0.70 Strongly agree
and functions of the body systems
discussed.
The videos did not help me understand the 65.40 26.90 3.80 0 3.80 1.5 0.90 Strongly disagree
lesson.
The content of the videos is too broad for 38.50 34.60 23.10 0 3.80 1.96 0.71 Disagree
the topic.
Note. level of agreement: strongly disagree (1.00-1.80); disagree (1.81-2.60); neither agree nor disagree (2.61-3.40); agree (3.41-4.20);
and strongly agree (4.21-5.00)

Motion graphics is a type of animation that uses text as a significant component. According to a
study by Hanif [27], the use of motion graphic video media substantially impacts students' concept retention.
Motion graphics of the video affect students' concept retention. As shown in Table 9, 46.2% of students
strongly agree that the presentation style of the footage sustains their focus throughout, where it is supported
by a mean of 4.23, and the graphics of the video created a more engaging sensory experience strongly agreed
by 57.7% of the participants. Moreover, 58.5% of students shared the same perspectives, strongly agreeing
that the graphics presented the lesson content in a structured and sequenced manner, with a mean of 4.58.
Additionally, the colors and effects used caught the student's attention. The graphical elements, such as
images and graphs, animations, and the entire part of motion graphics, contributed to the students' interest
and motivation to learn the lesson.
The results imply that the interactive feature of the motion graphic meets the students' need for an
active learning situation. Integrating IVs and the student-centered method in their classroom makes creating a
dynamic learning setting easier. Thus, the use of motion graphics in the video significantly affected students'
cognitive achievement [27]. Moreover, having a more active learning setup, special features in the video are
recommended to be present in the presentation to create a more dynamic learning experience for students.

Table 9. Participants’ perception of the motion graphics of the videos used in the intervention
Level of agreement (%)
Statements Mean SD Interpretation
1 2 3 4 5
The presentation style of the video makes me focus 0 0 15.4% 46.2 38.5 4.23 0.71 Strongly agree
all throughout.
The graphics of the video create a more engaging 0 0 11.5% 30.8 57.7 4.46 0.70 Strongly agree
sensory experience in understanding our lesson.
The graphics present the lesson content in a 0 0 11.5% 38.5 50.0 4.38 0.69 Strongly agree
structured and sequenced order.
The colors and effects used in the videos draw my 3.8 7.7 23.1% 15.4 50.0 4.00 1.20 Agree
attention.
The graphic elements such as the images and 7.7 0 19.2% 19.2 53.8 4.11 1.21 Agree
graphs make the lesson more interesting to learn.
Note. level of agreement: strongly disagree (1.00-1.80); disagree (1.81-2.60); neither agree nor disagree (2.61-3.40); agree (3.41-4.20);
and strongly agree (4.21-5.00)

J Edu & Learn, Vol. 18, No. 2, May 2024: 499-511


J Edu & Learn ISSN: 2089-9823  505

Furthermore, Table 10 shows that about 80.8% of the students, with a mean of 4.76, strongly agree
that using the English language in the video helps them understand what the speaker is saying. On the other
hand, participants disagree with how they cannot understand nor hear the speakers' words in some parts of
the video, ranging to 38.5%, underpinned by a mean of 2.46 and a standard deviation of 1.24. More than half
of the students said that the slang/jargon words and the absence of subtitles did not affect how they
understood the speaker's comments in the video. Unexpectedly, 34.8% neither agree nor disagree if they
would understand better if subtitles were integrated into the video.

Table 10. Participants’ perception of language and the presence of subtitles on the videos
Level of agreement (%)
Statements Mean SD Interpretation
1 2 3 4 5
The use of English as language in the 0 0 3.8 15.4 80.8 4.76 0.51 Strongly agree
video helps me understand what the
speaker is saying.
Sometimes I could not hear or 23.1 38.5 15.4 15.4 7.7 2.46 1.24 Disagree
understand what the speaker was
saying.
The speaker was so slang that I could 38.5 38.5 19.2 3.8 0 1.88 0.86 Disagree
not understand him/her sometimes.
I did not catch up with the video 19.2 46.2 15.4 19.2 0 2.34 1.01 Disagree
discussion because there were no
subtitles.
I could have understood the topic of 3.8 30.8 34.8 23.1 7.7 3.00 1.01 Neither agree
the video better if there were subtitles. Nor disagree
Note. level of agreement: strongly disagree (1.00-1.80); disagree (1.81-2.60); neither agree nor disagree (2.61-3.40); agree (3.41-4.20);
and strongly agree (4.21-5.00)

Overall, the findings imply that the use of the English language positively impacts the students'
comprehension of the topic. In the study of Woottipong [28], students agreed that videos were beneficial in
learning the course and that English subtitles in video movies were an excellent aid to learning English.
However, the presence and absence of subtitles do not impact the students' understanding of the topic, so
students understand the video well, depending on the speakers' language and pacing. The speaker's
perspective or persona, including their gaze, body orientation, slow-paced or mid-speed speaking, are
significant indicators of an instructor's intentional focus in a classroom environment. However, these factors
still need to be well known of how they could influence the learners' performance in watching IVs [29].
Table 11 shows that 46.2% of the participants agree that the video is more engaging due to the
interest in the speakers' way of talking, supported by a 3.96 mean and 0.99 standard deviation. For statement
number 2, students understood the discussions better with how the speaker communicates and relates to
them, with a percentage of 42.9% and a mean of 4.11. Therefore, the critical points that the speaker
highlighted and how the speaker delivered the content confidently allowed the students to be more engaged
with the video discussion. Moreover, with a mean of 4.65, 69.2% strongly agreed that the speaker appeared
to be knowledgeable of the content and passionate about teaching.

Table 11. Students’ perception of the speaker’s perspective and persona in the videos
Level of agreement (%)
Statements Mean SD Interpretation
1 2 3 4 5
The video is more engaging because I feel like the 3.8 3.8% 15.4 46.2 30.8 3.96 0.99 Agree
speaker is talking to me directly.
I can understand the discussion better because of 3.8 0% 19.2 34.6 42.3 4.11 0.99 Agree
how the speaker communicates and tries to relate
with me.
The speaker emphasizes key points that help retain 0 0% 7.7 46.2 46.2 4.38 0.63 Strongly agree
my attention.
The speaker shows confidence and delivers the 0 0% 19.2 30.8 50.0 4.30 0.78 Strongly agree
content concisely which makes me more engaged.
The speaker appears knowledgeable about his/her 0 0% 3.8 26.9 69.2 4.65 0.56 Strongly agree
topic and exhibits passion for teaching.
Note. level of agreement: strongly disagree (1.00-1.80); disagree (1.81-2.60); neither agree nor disagree (2.61-3.40); agree (3.41-4.20);
and strongly agree (4.21-5.00)

Supported by the study of Guo et al. [30] and Afify [31], the person narrating the video satisfies
students' learning of simple and complex topics and thus makes the video more engaging. In addition, there is
Factors affecting students’ concept retention in learning science online using … (Catherine B. Aguanta)
506  ISSN: 2089-9823

a more intimate and personal interaction between the viewer and the speaker as information is communicated
directly. Overall, the perspective and persona of the speaker matter greatly towards the deepening of
understanding of the students, which positively affects their concept retention. Lastly, the length of the video
matters most, especially to students with their attention span and interest at hand. It influences the students'
decision to watch the video or not [15] and also the engagement or participation of the viewers [30].
The results from Table 12 suggest that 38.5% of the students agree and 26.9% strongly agree that
the length maximizes their retention of the topic discussed. The second statement was also agreed by 34.6%,
where length keeps them engaged throughout the IVs, underpinned by a mean of 3.80 and an SD of 1.09.
However, both participants disagreed and disagreed that longer videos make them lose interest in learning
and sticking through the discussion. However, 30.8% disagree with the statement, which slightly opposes the
conclusion of Ali [15], that says students prefer short-length videos for longer videos to get them bored
quickly.

Table 12. Participants’ perception of the length of the videos used in the intervention
Level of Agreement
Statements Mean SD Interpretation
1 2 3 4 5
The video length maximizes my 0% 11.5% 23.1% 38.5% 26.9% 3.89 0.98 Agree
retention towards the topic.
The video length keeps me 3.8% 3.8% 34.6% 23.1% 34.6% 3.80 1.09 Agree
engaged throughout.
The longer video makes me bored 11.5% 30.8% 23.1% 23.1% 11.5% 2.92 1.23 Neither Agree nor
and loses my attention. Disagree
The longer videos are full of 42.3% 30.8% 23.1% 0% 3.8% 1.92 1.01 Disagree
unimportant details.
Note. level of agreement: strongly disagree (1.00-1.80); disagree (1.81-2.60); neither agree nor disagree (2.61-3.40); agree (3.41-4.20);
and strongly agree (4.21-5.00)

The video length should be taken with good observance other than the content, as students' attention
span depends on their interest, which is affected by the video duration. The duration of the integrated videos
was approximately 3-15 minutes. Thus, the students' attention span and interest are utilized; this is based on
the statement of Guo et al. [30] that, at most, a 6-minute duration is the students' absolute engagement time.
However, there was no video integration with more than a 20-minute duration of video discussion, so it
might be one thing to consider for the subsequent study.

3.3. Learning experiences in using instructional videos


3.3.1. Positive experiences
IVs are widely used learning materials in education because of the factors that enable students to
learn more than just the traditional ways of learning. The participants' learning experiences about using video
materials positively responded to their learning process because it helped them engage with the topic more
dynamically. Eight participants said that they enjoyed their learning process, and the video presentation made
them learn easier and faster because the concepts or contents presented in the video helped them understand
the topics better as shown in Table 13. The participants also said that the video's factors, such as their
content, speaker, graphics and images, organization, and overall components, affect how they understand and
learn the topic better. Another participant said that by having videos to re-watch any time of their
convenience, they can learn at their own pace and review their understanding of the topics quickly.

“In my opinion the positive are the images and how it points out important words for each. I like
images because I cannot see how they look and how the process works.” (Participant 3)
“The graphics and colors used caught my attention and the information said in the video
was easy to remember.” (Participant 7)
“The IVs presented during science class were really entertaining because the speaker really
explained well. The videos were also entertaining because it was not a dull looking video for me.”
(Participant 2)
“I was able to learn at my own pace by watching the IVs.” (Participant 16)

Students who watched the videos took less time to acquire specific skills than those who did not.
Using IVs is proven more convenient when learning [32]. IVs contribute to the students' learning progress in
different subjects, especially in science. Studies from other researchers prove that videos are combined visual
and verbal compositions that give students a complete package of learning experiences reflecting their

J Edu & Learn, Vol. 18, No. 2, May 2024: 499-511


J Edu & Learn ISSN: 2089-9823  507

understanding of the concepts and retention of what they have learned throughout the experience [33], [34].
Therefore, all of the participants agreed that using IVs materials positively affects their learning experiences
in the science subject.

Table 13. Themes and formulated meanings of students’ learning experiences


Theme Subthemes Formulated meanings f Sources
Positive Emotional Entertaining 2 P2, P11
experiences responses Fun 2 P11, P14
Interesting 2 P14, P22
Impact to learning Makes learning easier and faster 3 P1, P10, P15
Easy to catch up with the lesson 3 P5, P12, P15
Learned more things and easy to 1 P8
remember
Learn effective and understand 2 P11, P18
more
Learning through own’s pacing 1 P16
Makes more focused in learning 1 P19
Experience on IVs Not dull 1 P2
Contains main and important details 2 P2, P13
Well prepared and organized 1 P4
Understandable 2 P4, P9
Graphics and colors capture 1 P7
attention
Information is easy to remember 2 P7, P8
Others No bad experiences overall 11 P1, P2, P5, P10, P13, P19, P20, P22,
P23, P24, P26
Negative Impact to learning Not able to jot down notes 3 P4, P6, P12
experiences Hard to understand sometimes 1 P22
Boring 2 P7, P25
Complicated terms 1 P11
Speaker sometimes speaks too fast 2 P4, P14
Technical Lengthy 3 P4, P7, P18
difficulties Low volume 1 P8
Plays too fast 2 P9, P12
Lagging/choppy connection 2 P15, P16
Note. P – Participant

3.3.2. Negative experiences


The learning experience is only complete with the opposing side or the other end if there is any.
According to the 11 participants, they merely had negative or bad experiences from integrating videos during
the discussion because it worked well. However, there were a few downsides that some participants
mentioned as well, such as the type of video presented was lengthy, and they needed to be able to jot down
important information because the speaker was talking so fast that they could not catch up; this shows that
students prefer to watch short videos because their attention span depends on how long the video is and if it is
entertaining them along the way.

“It is a bit lengthy which makes me lose interest. The speaker sometimes speaks too fast and I get
confused. I take notes and it gets cut off because of it and also my brain cannot process the
information right away.” (Participant 4)
“...not being able to take down notes because of the speed of how the graphics are shown since for
me that really makes me understand a lot more about the topic.” (Participant 6)
“Sometimes there are things in the video that I am still confused about or there are complicated
terms.” (Participant 11)
“The negative experience I had was that I could not catch up with the video because I was busy
taking notes. Sometimes, it goes by too fast and I cannot remember.” (Participant 9)

Science IVs improve the appearance of contents, enhance text coherence, and provide tangible
information. According to Kosterelioglu [35], using IVs allows for a more effective learning environment,
for it highly interests the students, helping them focus on the topic and refocusing them when their attention
shifts. Therefore, the participants' negative experiences show that various factors affect their learning. For
instance, the participants engage more in watching the video presentation when it is well-planned and
organized. Information is put into simpler terms so they can remember and relate the key ideas they jot down
on their notes. In lessons, IVs significantly impacted the student's learning experiences, improving concept
retention, critical thinking, attention span, and note-taking. The suitability of the videos' features to the
Factors affecting students’ concept retention in learning science online using … (Catherine B. Aguanta)
508  ISSN: 2089-9823

students' capabilities should be considered, as negative feedback is inevitable in online learning. However,
positive feedback outweighed the setbacks, led to open discussions, and improved concept retention.

4. CONCLUSION
This study sought to determine the factors of IVs that affect the student's concept retention in
science. After conducting a thorough analysis and interpretation of the data gathered, the researchers
conclude that there is a significant change between both the pre and post-tests of the experimental group
(with IVs) and control group (without IVs). The conceptual understanding of the students in the topics
reproductive system and nervous system as part of the learning competencies is noticeably positive. The test
scores reveal that the students comprehend the lesson's key concept; therefore, the integrated IVs contributes
to their retention of concepts. Between the median difference of experimental and control groups' retest and
post-test results, it is concluded that there was no significant change observed. The researchers identified
factors that affected students' level of concept retention, including the video content, speaker persona, motion
graphics, video length, and language used in the videos and subtitles. Although students can increase their
knowledge and skills with or without IVs, integrating IVs can facilitate a better understanding of lessons. The
researchers noted that students may face challenges in the online learning environment, including unstable
internet connection and distractions at home. The student's learning experiences are crucial in the learning
process, and positive feedback was received on using IVs in the class. However, the researchers recommend
integrating short and long videos in one class session and conducting the study in a face-to-face learning
environment for a different approach. Lastly, due to limited time, the researchers predetermined factors that
can affect students' retention, so it is suggested that participants identify different factors in a video for more
exclusivity and undetermined choices.

REFERENCES
[1] O. Ozer, and F. Kılıç, "The Effect of Mobile-Assisted Language Learning Environment on EFL Students’ Academic
Achievement, Cognitive Load and Acceptance of Mobile Learning Tools," Eurasia Journal of Mathematics, Science and
Technology Education, vol. 14, no. 7, pp. 2915-2928, May 2021, doi: 10.29333/ejmste/90992.
[2] R. Junco, “The relationship between frequency of Facebook use, participation in Facebook activities, and student engagement,”
Computers and Education, vol. 58, no. 1, pp. 162–171, Jan. 2012, doi: 10.1016/j.compedu.2011.08.004.
[3] D. P. Acut and R. A. C. Latonio, “Utilization of stellarium-based activity: its effectiveness to the academic performance of Grade
11 STEM strand students,” Journal of Physics: Conference Series, vol. 1835, no. 1, pp. 1–7, Mar. 2021, doi: 10.1088/1742-
6596/1835/1/012082.
[4] L. D. Lapitan, C. E. Tiangco, D. A. G. Sumalinog, N. S. Sabarillo, and J. M. Diaz, “An effective blended online teaching and
learning strategy during the COVID-19 pandemic,” Education for Chemical Engineers, vol. 35, pp. 116–131, Apr. 2021, doi:
10.1016/j.ece.2021.01.012.
[5] M. Hibbert, “What makes an online instructional video compelling?,” Educause Review Online, vol. 86, pp. 1–9, 2014, doi:
10.7916/D8ST7NHP.
[6] N. Madaiton et al., “Conceptual change framework of instruction (CCFI): an instructional model in teaching eclipses,” Journal of
Turkish Science Education, vol. 19, no. 2, pp. 622–640, 2022, doi: 10.36681/tused.2022.141.
[7] M. T. Picardal and J. M. P. Sanchez, “Pre-service teachers reflection on their undergraduate educational research experience
through online instructional delivery,” International Journal of Learning, Teaching and Educational Research, vol. 21, no. 10,
pp. 161–177, Oct. 2022, doi: 10.26803/ijlter.21.10.8.
[8] S. Aloraini, “The impact of using multimedia on students’ academic achievement in the College of Education at King Saud
University,” Journal of King Saud University - Languages and Translation, vol. 24, no. 2, pp. 75–82, Jul. 2012, doi:
10.1016/j.jksult.2012.05.002.
[9] R. E. Mayer and R. Moreno, “Nine ways to reduce cognitive load in multimedia learning,” Educational Psychologist, vol. 38, no.
1, pp. 43–52, Jan. 2003, doi: 10.1207/S15326985EP3801_6.
[10] C. H. Chen and Y. C. Yang, “Revisiting the effects of project-based learning on students’ academic achievement: a meta-analysis
investigating moderators,” Educational Research Review, vol. 26, pp. 71–81, Feb. 2019, doi: 10.1016/j.edurev.2018.11.001.
[11]. J. Zhang, Y. Huang, and M. Gao, "Video Features, Engagement, and Patterns of Collective Attention Allocation: An Open Flow
Network Perspective", Journal of Learning Analytics, vol. 9, no. 1, pp. 32-52, Mar. 2021, doi:10.18608/jla.2022.7421.
[12] X. Zhai et al., “A review of artificial intelligence (AI) in Education from 2010 to 2020,” Complexity, pp. 1–18, Apr. 2021, doi:
10.1155/2021/8812542.
[13] T. Atapattu and K. Falkner, "Impact of Lecturer’s Discourse for Students’ Video Engagement: Video Learning Analytics Case
Study of MOOCs", Journal of Learning Analytics, vol. 5, no. 3, pp. 182–197, Dec. 2018, doi: 10.18608/jla.2018.53.12.
[14] J. Guggemos and S. Seufert, “Teaching with and teaching about technology – Evidence for professional development of in-service
teachers,” Computers in Human Behavior, vol. 115, no. 106613, Feb. 2021, doi: 10.1016/j.chb.2020.106613.
[15] S. Ali, “Impacts of watching videos on academic performance at university level,” European Journal of Education Studies, vol. 6,
no. 3, pp. 114–125, 2019, doi: 10.5281/zenodo.3244393.
[16] A. S. Rosales, “Vocabulary acquisition (incidental) through watching subtitled video material,” ELT Forum: Journal of English
Language Teaching, vol. 8, no. 2, pp. 190–197, Nov. 2019, doi: 10.15294/elt.v8i2.33356.
[17] X. Yu and D. Khazanchi, “Using embedded mixed methods in studying is phenomena: risks and practical remedies with an
illustration,” Communications of the Association for Information Systems, vol. 41, pp. 18–42, 2017, doi: 10.17705/1cais.04102.
[18] I. Etikan, S. A. Musa, and R. S. Alkassim, “Comparison of convenience sampling and purposive sampling,” American Journal of
Theoretical and Applied Statistics, vol. 5, no. 1, pp. 1–5, 2016, doi: 10.11648/j.ajtas.20160501.11.

J Edu & Learn, Vol. 18, No. 2, May 2024: 499-511


J Edu & Learn ISSN: 2089-9823  509

[19] A. C. Leon, L. L. Davis, and H. C. Kraemer, “The role and interpretation of pilot studies in clinical research,” Journal of
Psychiatric Research, vol. 45, no. 5, pp. 626–629, May 2011, doi: 10.1016/j.jpsychires.2010.10.008.
[20] A. Eisenkraft, “Expanding the 5E model: a proposed 7E model emphasizes ‘transfer of learning’ and the importance of eliciting
prior understanding,” The Science Teacher, vol. 70, no. 6, pp. 57–59, 2003.
[21] V. Braun and V. Clarke, “Using thematic analysis in psychology,” Qualitative Research in Psychology, vol. 3, no. 2, pp. 77–101,
Jan. 2006, doi: 10.1191/1478088706qp063oa.
[22] K. Tanner, “Experimental research,” in Research Methods: Information, Systems, and Contexts: Second Edition, Elsevier, 2018,
pp. 337–356. doi: 10.1016/B978-0-08-102220-7.00014-5.
[23] A. W. Abdulrahaman, “The effective use of YouTube videos for teaching English language in classrooms as supplementary
material at Taibah University in Alula,” International Journal of English Language and Linguistics Research, vol. 4, no. 3, pp.
32–47, 2016.
[24] C. J. Shieh and L. Yu, “A study on information technology integrated guided discovery instruction towards students’ learning
achievement and learning retention,” Eurasia Journal of Mathematics, Science and Technology Education, vol. 12, no. 4, pp.
833–842, Feb. 2016, doi: 10.12973/eurasia.2015.1554a.
[25] N. Geri, “The resonance factor: probing the impact of video on student retention in distance learning,” Interdisciplinary Journal
of e-Skills and Lifelong Learning, vol. 8, pp. 1–13, 2012, doi: 10.28945/1629.
[26] P. Duverger and E. Steffes, “Using YouTube Videos as a Primer to Affect Academic Content Retention.,” Instutute of Education
Science (ERIC), vol. 23, no. 2, pp. 51–66, 2012.
[27] M. Hanif, “The development and effectiveness of motion graphic animation videos to improve primary school students’ sciences
learning outcomes,” International Journal of Instruction, vol. 13, no. 4, pp. 247–266, Oct. 2020, doi: 10.29333/iji.2020.13416a.
[28] K. Woottipong, “Effect of using video materials in the teaching of listening skills for university students,” International Journal
of Linguistics, vol. 6, no. 4, p. 200, Aug. 2014, doi: 10.5296/ijl.v6i4.5870.
[29] Z. Pi, Y. Zhang, F. Zhu, K. Xu, J. Yang, and W. Hu, “Instructors’ pointing gestures improve learning regardless of their use of
directed gaze in video lectures,” Computers and Education, vol. 128, pp. 345–352, Jan. 2019, doi:
10.1016/j.compedu.2018.10.006.
[30] P. J. Guo, J. Kim, and R. Rubin, “How video production affects student engagement: An empirical study of MOOC videos,” in
L@S 2014 - Proceedings of the 1st ACM Conference on Learning at Scale, New York, NY, USA: ACM, Mar. 2014, pp. 41–50.
doi: 10.1145/2556325.2566239.
[31] M. K. Afify, “Effect of interactive video length within e-learning environments on cognitive load, cognitive achievement and
retention of learning,” Turkish Online Journal of Distance Education, vol. 21, no. 4, pp. 68–89, Oct. 2020, doi:
10.17718/TOJDE.803360.
[32] S. Castillo, K. Calvitti, J. Shoup, M. Rice, H. Lubbock, and K. H. Oliver, “Production processes for creating educational videos,”
CBE Life Sciences Education, vol. 20, no. 2, pp. 1–12, Jun. 2021, doi: 10.1187/cbe.20-06-0120.
[33] Y. Ghilay, “Text-based video: the effectiveness of learning math in higher education through videos and texts,” Journal of
Education and Learning, vol. 10, no. 3, pp. 55–63, Apr. 2021, doi: 10.5539/jel.v10n3p55.
[34] C. Tarchi, S. Zaccoletti, and L. Mason, “Learning from text, video, or subtitles: a comparative analysis,” Computers and
Education, vol. 160, pp. 1–12, Jan. 2021, doi: 10.1016/j.compedu.2020.104034.
[35] I. Kosterelioglu, “Student Views on Learning Environments Enriched by Video Clips,” Universal Journal of Educational
Research, vol. 4, no. 2, pp. 359–369, Feb. 2016, doi: 10.13189/ujer.2016.040207.

BIOGRAPHIES OF AUTHORS

Catherine B. Aguanta aspires to be known as an outstanding Science educator,


as evidenced by her graduation from Cebu Normal University with a Bachelor of Secondary
Education Major in Science as a Cum Laude. She enjoys putting pen to paper for creative
projects such as songwriting and poetry. Her research interests focus more on science
education and environmental education. As a young woman, she devotes her time as an active
youth leader, inspiring young people to serve their communities with passion and commitment.
She can be contacted at email: [email protected].

Margery Anne T. Augusto holds an undergraduate degree in Secondary


Education, majoring in science. She graduated as Magna Cum Laude at Cebu Normal
University. Her current research focus is on establishing an improved understanding of the
probable reasons and factors that influence student behavior, particularly in the field of science
education. She excels in performing and consistently improves herself by training in dance
studios. She can be contacted at email: [email protected].

Factors affecting students’ concept retention in learning science online using … (Catherine B. Aguanta)
510  ISSN: 2089-9823

Jonajean V. Bajenting received her undergraduate degree in Secondary


Education, majoring in Science at Cebu Normal University-Main Campus. She graduated
Magna Cum Laude and was a beneficiary of the Department of Science and Technology-
Junior Level Science Scholarship Batch 2021 as a scholar. It was her stepping stone to open
the doors of her interest in sciences. Her underpinning research interests are solving
environmental problems and promising educational interventions. As her burning passion in
teaching, she is currently an english as a second language (ESL) teacher at Glats Inc. She can
be contacted at email: [email protected].

Katrina Claire Buayaban is a dedicated student at Cebu Normal University.


With her passion for science and teaching, she pursued a Bachelor of Secondary Education
Major in Science. Driven by her research interest in Environmental and Social Sciences, her
exceptional abilities were recognized, bagging the honor roll of Cum Laude. She is a
remarkable content producer who strives to develop unique literary works and presentations.
She is a prominent member of the Christian community who works to share the gospel and
help those in need. Nevertheless, she is a gifted vocalist and performer. She can be contacted
at email: [email protected].

El Jane P. Cruz earned her undergraduate degree in Secondary Education,


majoring in Science at Cebu Normal University-Main Campus. Graduated Magna Cum Laude.
She is also a scholar from the Department of Science and Technology (DOST). Her research
interests include experimental scientific research, especially in the fields of physical sciences
and life sciences. Currently, she is accepted as an Independent Service Provider (ISP) ESL
Teacher at Glats Inc. She can be contacted at email: [email protected].

Niña Faith Fantonial is an exceptional alumna of Cebu Normal University,


where she specialized in a Bachelor's degree in Secondary Education, majoring in science. Her
enthusiasm for the subject led her to consistently earn a place as Magna Cum Laude. Aspiring
to become one of the finest future Science educators, she is highly committed to her studies.
Her research interest is gaining a deeper understanding of the cognitive mechanisms that
influence human behavior, mainly focusing on exploring the connections between science. In
addition, she received a full scholarship from the Department of Science and Technology
(DOST). She is also enthusiastic about her work, which includes literary compositions and
scientific papers. She can be contacted at email: [email protected].

Jane Aubrey M. Kwan is an outstanding alumna graduating Magna Cum Laude


at Cebu Normal University, where she took up a bachelor's degree in Secondary Education,
majoring in science. She is primarily interested in examining the efficacy of interventions and
policies intended to diminish the prevalence of infectious diseases and enhance global health
outcomes. In addition, Aubrey is a scholar of the Department of Science and Technology
(DOST). She has a particular fondness for penning Science-related pieces. Owing to her
interest in science and writing, she joined the school newspaper production during high school
and quickly began winning distinctions for her writing. She can be contacted at email:
[email protected].

J Edu & Learn, Vol. 18, No. 2, May 2024: 499-511


J Edu & Learn ISSN: 2089-9823  511

Jimmoy Legaspino is a dedicated Cebu Normal University alumnus. He


courageously completed his Bachelor of Secondary Education Major in Science degree Cum
Laude. His interest in science prompted him to apply for a Department of Science and
Technology (DOST) scholarship. He intends to focus on exploring the scope of environmental
science as his research endeavor, particularly on biodiversity management and sustainability.
He has made the dean's list every semester and aspires to be a professional educator.
Furthermore, when writing, particularly scientific articles, he fully commits himself. He can be
contacted at email: [email protected].

Dharel P. Acut earned his Bachelor's degree in Science Education, majoring in


General Science at MSU-Iligan Institute of Technology, Philippines. He is pursuing his
Master's degree in Science Education at Cebu Normal University, Philippines. As an Associate
Member of the National Research Council of the Philippines (DOST-NRCP), his research is
directed toward science education, STEM education, systematic literature reviews,
environmental education, and science instrumentation. He also has publications indexed in
Elsevier Scopus and presented research papers at international conferences in Thailand, the
Philippines, Vietnam, and Taiwan. He can be contacted at email: [email protected].

Marchee T. Picardal is a faculty member of Cebu Normal University's College


of Teacher Education and a guest lecturer at the Philippine Normal University's Graduate
School. She holds a Doctor of Education degree in Science Education and a Master of Arts in
Education, majoring in Science Education from Cebu Normal University. She earned her
Bachelor's in Secondary Education, majoring in Biological Sciences at the Ateneo de
Zamboanga University. She is a passionate research teacher who has served the Department of
Education – Cebu City Division for five years. She has been a winning coach in science
investigatory projects and science and technology fairs. Dr. Picardal is a proud National
Research Council of the Philippines (DOST-NRCP) member. She has consistently published
research articles indexed in ACI, Clarivate Analytics, and Elsevier Scopus. She can be
contacted at email: [email protected].

Factors affecting students’ concept retention in learning science online using … (Catherine B. Aguanta)

You might also like