SciELO - Scientific Electronic Library Online

 
vol.13 issue1An exploration of in-service teachers' understanding of teaching mathematics in Grade R classrooms: A case study of Grade R in Lesotho University of KwaZulu-Natal, South AfricaConstructivism-led assistive technology: An experiment at a Namibian special primary school author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand

Article

Indicators

Related links

  • On index processCited by Google
  • On index processSimilars in Google

Share


South African Journal of Childhood Education

On-line version ISSN 2223-7682
Print version ISSN 2223-7674

SAJCE vol.13 n.1 Johannesburg  2023

http://dx.doi.org/10.4102/sajce.v13i1.1204 

REVIEW ARTICLE

 

Perspectives in eye-tracking technology for applications in education

 

 

Raimundo da Silva Soares JrI; Candida BarretoII; João R. SatoI

IGraduate Program in Neuroscience and Cognition, Federal University of ABC, Center of Mathematics, Computing and Cognition, São Bernardo do Campo, Brazil
IIDepartment of Integrated Studies of Learning Language, Science and Mathematics in the Primary School, Faculty of Education, University of Johannesburg, Johannesburg, South Africa

Correspondence

 

 


ABSTRACT

BACKGROUND: Many students struggle with mathematics difficulties, such as arithmetic problem-solving, intuitive geometry concepts and learning disabilities. Currently, there is an increasingly interesting in applying neuroscientific research paradigms to elucidate mathematical thinking and neural mechanisms that underlie academic achievement. On this matter, eye-tracking technology has been a valuable option for educational research. It provides a non-invasive and real-time measurement of participants' eye movements and pupil sizes during cognitive tasks. Moreover, the eye-tracker device is portable, allowing more ecological educational experimentations.
AIM: Our main goals are to provide an overview and different opportunities for educational eye-tracking research to investigate mathematical thinking at schools.
SETTING: This study was conducted in Sao Bernardo do Campo, Sao Paulo, Brazil.
METHODS: This is a perspective article that briefly introduces the eye-tracking technique and describes its possible use in educational research.
RESULTS: We present the popular measures and the trends of this technology that could enable educational practitioners and scientists to apply the eye-tracking system to benefit teaching and learning mathematics in naturalistic research.
CONCLUSION: The eye-tracking provides insights for innovative approaches to promote evidence-based practices and new interventions through self-directed learning and metacognition skills that could be helpful in mathematics education.
CONTRIBUTION: This article provides insight into eye-tracking system utility in educational research regarding the mathematics teaching-learning process.

Keywords: eye-tracking; eye movements; mathematics education; pupillometry; educational neuroscience.


 

 

Introduction

Eye-tracking is a technique that tracks a person's point of gaze or eye movements during a task, which can be helpful to research aspects of human cognition such as attention targets, focus and gaze patterns that suggest the observer's problem-solving strategy (Shayan et al. 2017). The eye-tracker device records eye movements and identifies gaze points by projecting an infrared or near-infrared light to the eye. The positioning factors (corneal reflection and the centre of the pupil) are processed by the eye-tracking software that estimates the 'point-of-regard' (point in the space of the gaze trajectory) by trigonometric calculations indicating the eye movements (Hansen & Ji 2009). More than a century ago, scientific research used to use an eye-tracking system to obtain information about eye movement and explore how such data can expand our knowledge of human behaviour (Delabarre 1898). Since the first insights into the characteristics of eye movements in the late 1800s, several studies have investigated the gaze and reading (Erdmann & Dodge 1898; Huey 1898; Javal 1878). Over the years, a tremendous technological advance has improved the accuracy of the eye-tracker devices employed in research (Duchowski & Duchowski 2017). Which has increased the possibility of applications of this tool in research.

The eye-tracker equipment has been applied to estimate where an individual is looking at a given moment, which allows researchers to make assumptions about what the observer deems relevant while observing stimuli. Moreover, eye-tracker can provide the looking time data, which have been influential as a measure in developmental psychology for decades (Lai et al., 2013). For example, Yeung et al. (2016) recorded infants' gaze during surprising, neutral, or unsurprising events, showing that eye movement data can shreds light on infants' reasoning regarding a sampling event's likelihood. Interestingly, the study highlights that eye tracking can extract a more precise measurement than traditional looking measures, i.e., manual looking time coding, and therefore reveal some subtleties of response patterns in an automated way. The eye movement data is helpful to investigate the human cognition, including attention, focus and gaze patterns of the observer's problem-solving strategy (Shayan et al. 2017).

The equipment is a low-cost, harmless and highly portable system, enabling experimental settings outside the laboratory (Holmqvist, Nyström & Mulvey 2012). Such characteristics turn out to be a valuable option for educational research, including investigations on reading (Kennedy 1992; Rayner & Pollatsek 1992; Taylor 1937), mathematical reasoning (Andrà et al. 2015; Suppes 1990) and geometric problem-solving (Bolden et al. 2015; Epelboim & Suppes 2001).

Interest in using eye-tracking in educational research has increased recently. Studies have applied research paradigms to elucidate mathematical thinking by investigating eye movements during controlled experiments (Was, Sansosti & Morris 2017). However, only in the last decades has the improvement of eye-tracking technology enabled more naturalistic tasks, that is, out of the traditional labs (Foulsham 2015; Hayhoe & Ballard 2005). In this sense, there is a trend in eye-tracking research in mathematics education (Lilienthal & Schindler 2019). Regarding the potential of eye-tracking applications in educational research and the growing use of computer resources in schools, it is vital to foster discussions in multidisciplinary research to propose solutions and paradigms that can benefit mathematics teaching learning. An analysis of eye movement studies related to learning would help education practitioners by providing insights into how eye-tracking technology can be helpful and the possibilities for future applications of the eye-tracking system in the educational context.

Our main goals are to provide an overview and different opportunities for educational eye-tracking research to investigate mathematical thinking at schools. Here, we present the usual measures and the trends of this technology that could enable educational practitioners and scientists to apply the eye-tracking system to benefit teaching and learning mathematics in naturalistic research.

 

Figure 1

 

Measures and applications

Eye fixation and Saccadic movement when solving mathematical problems

Eye-tracker devices usually offer the possibility for the experimenter previously selecting an area of interest (AOI), which are specific regions of the stimulus displayed that the researcher defines before the task and then extracts specific quantitative metrics of the eye movements into the selected locations recorded during the experiment (Figure 2a). Among the main eye movement measures, saccades and fixations stand out as the most popular data analysed in the AOI. Fixations are eye movements that stabilise the retina over an object of interest. It is a measure widely used in research with eye-tracking, especially to investigate engagement and visual attention (Holmqvist et al. 2011). It is well known that participants tend to fixate their eyes when they find interesting information during the search. Moreover, the more significant number of fixations directed to a particular region indicates greater visual attention (Duchowski & Duchowski 2017). The fixation count indicates how often a participant fixated the eyes within a relevant AOI.

On the other hand, dwell time (fixation time) measures how long the observer fixated the eyes on the AOI (Figure 2b). Evidence suggests that longer dwell time and higher fixation count indicate that learners require more cognitive capacity for processing information on a specific area (Carpenter & Just 1978; Lin & Lin 2014). For example, Hegarty, Mayer and Green (1992) employed eye-tracking technology to observe undergraduate students' dwell time during arithmetic problem-solving. The study demonstrated that unsuccessful problem-solvers tended to have longer dwell time on the problem area, which is consistent with recent experiments on the geometry domain showing that low-accuracy students had higher fixation count and spent more time fixating their eyes on the problem region (Lin & Lin 2014).

Eye movements between the fixations are called saccades, reflecting the foveas's the moment-to-moment positioning (Gregory 1990). Therefore, saccadic movements and eye fixations have become practical measures of visual attention in cognition (Liversedge & Findlay 2000) and educational research (Kennedy 1992; Rayner 1998; Rayner et al. 2006; Taylor 1937). For instance, a seminal study on reading tests demonstrated that as the text became conceptually more difficult for readers, the duration of fixations increased and the length of saccades decreased (Rayner & Pollatsek 1992). Regarding the mathematics domain, several studies investigate mathematical reasoning through fixation and saccades behaviour (Andrà et al. 2009, 2015; Hegarty et al. 1992; Suppes 1990; Susac et al. 2014; Verschaffel, De Corte & Pauwels 1992). Eye-tracking research showed that students with mathematical anxiety had more saccade movements and eye fixations count during the arithmetic problem-solving tasks (Hunt, Clark-Carter & Sheffield 2015). The findings suggest that eye movements can indicate difficulties in performance and reduce students' processing efficiency. Andrà et al. (2009) also demonstrated differences between how a novice and an expert student read mathematical representations. The study suggests that low-performance students have difficulties knowing where to direct their eyes to obtain relevant clues and solve the problem. Such information could be relevant for teachers that want to identify how students approach math problems and offer specific instructions. Thus, sacades and eye fixations have been demonstrated to be promising measurements of how students try to solve mathematical problems.

Heatmap and scanpath as an attention map

It is possible to present eye movement data, such as fixations and saccades, as visual representation through heatmaps and scanpaths (Holmqvist et al. 2011). The heatmap indicates the dwell time in the general distribution of eye movements through a colour gradient (Duchowski et al. 2012). Usually, warm colours (red and yellow) indicate the regions with extended dwell time, while cold colours (blue, purple or green) represent the AOIs with less dwell time (Figure 3). It is a method for quick identification of the regions that attract the most attention of the observer (Duchowski et al. 2012). It is possible to compare the Heatmaps of different individuals or even groups of people to analyse the behaviour of specific populations that differ when faced with the same stimulus (Holmqvist et al. 2011).

 

 

On the other hand, the scanpaths are a visual representation of the regions where the subject's eyes were directed during a presented stimulus. This gaze map is associated with fixations and saccades, as the circles represent the gaze, the circles' diameter indicates the dwell time, the numbers in the centres of the circles are the fixation count and the lines between the circles are the saccades (Holmqvist et al. 2011). Such an approach can reveal visual attention or how the observer search for some object or information of interest during a task (Bojko 2013; Poole & Ball 2006).

Several studies applied the scanpath to compare the differences and similarities of attention maps of experts and novices (Heminghous & Duchowski 2006; Jarodzka et al. 2010). Jarodzka et al. (2010) reported that the gaze patterns were more heterogeneous between experts than novices during the arithmetic task of fish locomotion animations. Moreover, both groups presented a similar scanpath when the task was easier with less required mental processing. Besides this approach, scanpath has been used to access memory (Hannula et al. 2010) and provide real-time visual instruction (Boucheix & Lowe 2010; Canham & Hegarty 2010; De Koning et al. 2010). Moreover, there are investigations on geometric problem-solving through scanpaths and heatmaps (Bolden et al. 2015; Chen & Yang 2014; Epelboim & Suppes 2001; Lin & Lin 2014). In fact, eye movements can be helpful in investigating the visuospatial abilities required from geometry problems and provide interventions to improve the students' spatial skills (Wang, Chen & Lin 2014).

Pupillometry studies and mental activity

In addition to the extrinsic movements of the eyeball, there is also a variation in the diameter of the pupils that allows more or less light to enter, which ends up being a relevant modulation for vision to occur correctly. Three main factors influence an individual's variation in pupil diameter: (1) the accommodation that occurs because of the focusing process, (2) the pupil light reflex (PLR) and (3) emotional factors that involve attention and engagement (Kardon 2005). Engagement in specific tasks may be associated with the release of norepinephrine. This specific signaling chemical transmits signals across the nervous system. One of the primary brain nuclei involved with the release of this neurotransmitter in the brain region is locus coeruleus. In this sense, the task-evoked pupillary response was and can be used as a surrogate measure for arousal and mental effort (Aston-Jones & Cohen 2005; Bradley et al. 2008; Mathôt 2018).

Pupil dilation is a suitable measure to evaluate the individual's strategy for solving mathematical problems. Hess and Polt's study (1964) showed that when participants try to solve multiplication problems mentally, their pupil diameter gradually increases as the arithmetic challenge becomes more difficult. This finding suggests that pupil dilation can indicate mental activity (i.e., cognitive processing) and has been replicated in mental arithmetic multiplication (Klingner, Tversky & Hanrahan 2011; Schaefer et al. 1968) and addition problems (Jainta & Baccino 2010). Ahern and Beatty (1979) showed that the relationship between math performance and pupil dilation varies with intelligence. Individuals with better scores on intelligence tests had less pupil dilation during the mental calculation test and performed better than individuals with lower intelligence test scores at all task difficulty levels. Thus, the authors concluded that better-performing individuals need less mental effort to do the calculations because they can process information more efficiently.

On the other hand, a more recent study showed the opposite. Individuals with high performance had more significant pupil dilation during reasoning tests (Van der Meer et al. 2010). The difference in the results might be explained by the nature of the tasks used in the studies. In the first study (Ahern & Beatty 1979), the authors investigated mental calculations, which required a skill already learned and well consolidated by high-performing individuals. On the other hand, the reasoning test proposed in the second study was unpredictable for the high-performing individuals, so it required more cognitive effort to complete. Thus, pupil dilation can be an indicator of mental effort and the difficulty level of tasks.

 

Trends and perspectives

Naturalistic research in schools

Traditionally, researchers have applied eye-tracking technology in laboratory environments with restrictions such as head fixation (Duchowski & Duchowski 2017). However, in the last decades, the device has been changing to a more portable and cost-effective system, making it possible to set up research in the classroom. Advances in camera quality are allowing eye-tracking research in mobile devices, such as webcams (Papoutsaki, Laskey & Huang 2017; Robal et al. 2018) or even cell phones (Chaudhuri et al. 2021; Cortina et al. 2015; Prieto et al. 2015). A recent study showed promising eye-tracking results in smartphone cameras using machine learning. This method uses data to automate computer programs to learn and improve without human intervention, to improve the method's accuracy. Interestingly, the device could replicate previous research results of high-resolution devices (Valliappan et al. 2020). Such findings exemplify the perspective of new algorithms allowing eye-tracking research to be increasingly accessible with several options for studies on mobile devices for more ecological validity and massive applications.

Eye-tracking research in schools is more realistic and inviting to students (Bolden et al. 2015). The less formal nature of the school environment turns out to be more comfortable for young students that intend to participate in the experiments (Mason, Pluchino & Tornatora 2016). An eye-tracking study on children reveals the strategies used during visual representations of mathematical problems (Bolden et al. 2015). The students' gaze patterns indicated difficulties in promoting multiplications, which could help teachers identify which instructions should be addressed to students. Following these ideas, other studies investigated eye-tracking usability from the view of professionals with experience in the classroom. First, we recorded students' eye movement data during geometric problem-solving in primary school. Then applied a questionnaire to teachers from another school to assess their expectations of the AOIs where they suppose that students would look more. The results showed that the overlap regions pointed by the teachers were different from the students' heatmaps, which indicates that they imagined other student behaviours before seeing the eye-tracking video (Figure 4) (Da Silva Soares et al. 2021). Therefore, eye-tracking could be valuable for teachers to obtain real-time monitoring access to students' performance. The discussion of the possible applications in this matter is presented in the following subsection, Eye-tracking videos to promote instruction.

 

 

Eye-tracking as a complementary educational instrument

It is more beneficial to employ eye-tracking in educational research as a complementary methodology and other approaches, such as the Think-Aloud interview and quantitative survey (Holsanova 2014; Schindler & Lilienthal 2018, 2019; Shayan et al. 2017). For example, Schindler and Lilienthal (2019) applied a 'stimulated recall interview' with a student watching the gaze video of himself solving a geometry problem. This creative approach enables the student to verbally express what he was thinking during the task verbally. The results confirmed that the student eye gaze pattern of looking back and forth between the AOIs during the geometry task was related to different mental processes. Combining eye movement data with complementary information made it possible to reduce the inherent ambiguity of eye movement data. Moreover, it was possible to investigate visual attention to know what students are looking at and explore why they direct their gaze to specific regions during the mathematics task.

Eye movement data are relevant to educational research but do not answer all questions about learning or performance in mathematics. It is not possible to know what the observer is thinking or to guarantee that the results reflect attention only using eye movement data. In addition, there are limitations to the methodology concerning lighting noise, head movement, contact lenses, or even observer' glasses that can interfere with data collection from the eye-tracker (Borah, 2006). In these cases, it is essential to do a good calibration before starting the experiment and to guide the participants not to move around too much during the task (O'Brien et al., 2009). It should be mentioned that it is challenging to implement the quality control protocol of studies with infants and toddlers as they would not be instructed to avoid head movements or keep looking at the screen during the calibration process. Despite the difficulties, there are studies with young infants and children showing that it is possible to use eye-tracking to understand some aspects of human cognition and neurodevelopment (Katus et al., 2019; Forssman et al., 2017; Guarini et al., 2021).

Eye-tracking technology alone to investigate students' reasoning, attention or engagement while performing mathematics tasks has significant limitations. For example, dissociation is when individuals may fix their eyeball in one AOI but think about something completely different (Posner 1980, Posner et al., 1980). Therefore, it is impossible to know what the observer thinks just by analysing the eye gaze. Although the long fixation duration within an AOI might indicate that the focused region was attractive to the observer, it might also suggest that the information was confusing or problematic for the student (Andrá et al. 2015; Duchowski & Duchowski 2017). Moreover, visual representations of eye movements such as heatmaps or scanpaths are just spatial distributions of the regions where participants look and nothing else (Bojko 2009). In this matter, it is helpful to combine complementary techniques and data to analyse human behaviour. For example, the think-aloud protocol is a technique that asks participants to verbalize their thoughts during a task (concurrent think-aloud) or after a task (retrospective think-aloud). The retrospective think-aloud method seems to be preferable, as speaking during a task could muddle participants' attention and performance (Russo et al., 1989; Alhadreti et al., 2017). Therefore, such an approach has been combined with eye-tracking to investigate attention based on participant reports and eye movement data. Likewise, we believe eye-tracking and retrospective think-aloud methods could be helpful in educational environments. In research, eye-tracking has also been used with other portable devices such as EEG (Rozado & Dunser, 2015; Pavlov et al., 2022) and fNIRS (Da Silva Soares et al., 2022; Yeung et al., 2021). This multimodal approach could enable more accurate and robust real-time monitoring of cognitive processes, such as attention and workload. Therefore, educational practices can benefit from multimodal studies that help elucidate students' cognitive abilities.

Eye-tracking videos to promote instruction

The eye-tracker device also allows recording a subject's eye movements and replaying the scanpath data in videos. Several studies applied eye-tracking videos as an instructional resource (Jarodzka et al. 2013; Mason et al. 2016; Van Gog et al. 2009). For example, Mason et al. (2016) used eye-tracking videos as Eye Movement Modeling Examples (EMME). This method consists of recording videos from experts in a given task and then presenting this pattern model of attentional cues to beginners or low-performing students to assist them in the learning process. The study showed that low-performing students training with EMMEs used the experts' gaze pattern as visual instructions to direct their attention, which resulted in better performance in the mathematical task.

The eye-tracking video presents eye movement data that can also be useful to identify student characteristics that are often unnoticed during mathematics tasks. In a recent study, we recorded eye-tracking videos without ID information about the students that solved the multiple-choice mathematics problems. Then, we showed the eye-tracking videos to teachers from other schools and asked them to guess if the student chose the right or wrong answer based on the scanpath. Results demonstrated that teachers had great precision in their guesses just by watching the eye-tracking videos. The teachers' prior knowledge and experience helped them interpret the students' scanpath. Moreover, the eye-tracking videos gave hints of why students' eye gaze presented a particular pattern, which was helpful for teachers to identify instructions that would help the students to improve their performance during the mathematical problem-solving task.

Hopefully, the combination of eye-movement data and educational research methodology will provide a better understanding of students' mental processes and behaviour involved in learning and solving mathematical problems, especially at individual levels of instruction.

Multimedia learning, metacognition and self-directed approach

Another current trend is to integrate technological tools to promote mathematical learning. The pandemic increased the need to integrate technology resources into the teaching process (Iannizzotto et al. 2020). A growing body of empirical studies investigating multimedia learning with the eye-tracking system (Scheiter & Eitel 2017; Van Gog & Jarodzka 2013; Van Gog & Scheiter 2010). Eye-tracking data can be used for metacognition development and self-regulated learning. Metacognition is a cognitive ability related to academic accomplishments, such as mathematical problem-solving skills (Cohors-Fresenborg et al. 2010; Van den Broek 2018). For example, one research used eye movements as a metacognitive tool to develop their arithmetic skills. After three intervention sessions, the students improved their test scores (Van den Broek 2018).

Moreover, several pieces of research used eye-movement data to enhance students' self-directed learning skills with eye-tracking techniques (Biedert et al. 2010; Buscher, Dengel & Van Elst 2008; Daraghmi et al. 2015; Hannula et al. 2010; Hyrskykari 2006; McDonald & Boud 2003). Most self-directed learning studies focus on reading skills. However, Gauthier et al. (2020) used eye movement data as a visual cue in the e-learning environment to train mathematics/Science skills and enhance the inhibitory control of young students. The proposed system provides insights for further innovative approaches using the eye-tracker device to promote evidence-based practices and design new interventions through self-directed learning and metacognition skills that could be helpful in mathematics education.

Eye-tracking as an educational apparatus is an opportunity to evaluate students' strategies and not just how many questions they can solve. For example, a case study with a child with dyscalculia showed a scattered fixation pattern during the multi-digit number processing task, suggesting a use of a dysfunctional strategy that was completely different from what was observed with typically developing children (Van Viersen et al. 2013). Such an approach represents the idea that eye movements could be increasingly used to unveil mathematical thinking to help students, especially those with more difficulties.

 

Conclusion

The eye-tracking system enables several approaches toward increasingly naturalistic educational research scenarios that allow us to study problem-solving strategies, aspects of visual attention and engagement in realistic classroom situations. Eye movement data can help teachers identify performance characteristics that lead to instructions regarding how a struggling student approaches math problems. Moreover, it is possible to apply eye-tracking as a tool for metacognition development in students and teachers, as it provides performance characteristics that would be unnoticed in daily school life. Such information could offer insights and resources for self-directed learning methods. In this sense, concerning so many possibilities for educational research applications and the continuous development of technological resources of eye-tracking systems and multimedia aimed at learning, we believe that eye-tracking tends to be increasingly used in schools to benefit education.

 

Acknowledgments

The authors are thankful to Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES) - Finance Code 001 and the Universidade Federal do ABC (UFABC). J.R.S. was supported by the São Paulo Research Foundation (FAPESP, Grants Nos. 2018/21934-5 and 2018/04654-9).

This study was developed based on a doctoral research project at the Graduate Program in Neuroscience and Cognition at the Universidade Federal do ABC.

Competing interests

The authors declare that they have no financial or personal relationships that may have inappropriately influenced them in writing this article.

Authors' contributions

R.S.S.J. wrote the manuscript. C.B. and J.R.S. reviewed the article.

Ethical considerations

This article followed all ethical standards for research without direct contact with human or animal subjects.

Funding information

This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.

Data availability

Data sharing is not applicable to this article as no new data were created or analysed in this study.

Disclaimer

The views and opinions expressed in this article are those of the authors and do not necessarily reflect the official policy or position of any affiliated agency of the authors.

 

References

Ahern, S. & Beatty, J., 1979, 'Pupillary responses during information processing vary with scholastic aptitude test scores', Science 205(4412), 1289-1292. https://doi.org/10.1126/science.472746        [ Links ]

Alhadreti, O., Elbabour, F. & Mayhew, P., 2017. Eye tracking in retrospective think-aloud usability testing: Is there added value? Journal of Usability Studies 12(3), 95-110.         [ Links ]

Andrà, C., Arzarello, F., Ferrara, F., Holmqvist, K., Lindström, P., Robutti, O. et al., 2009, 'How students read mathematical representations: An eye tracking study', in Proceedings of the 33rd conference of the International Group for the Psychology of Mathematics Education, vol. 2, pp. 49-56, PME, Thessaloniki.

Andrá, C., Lindström, P., Arzarello, F., Holmqvist, K., Robutti, O. & Sabena, C., 2015, 'Reading mathematics representations: An eye-tracking study', International Journal of Science and Mathematics Education 13(2), 237-259. https://doi.org/10.1007/s10763-013-9484-y        [ Links ]

Aston-Jones, G. & Cohen, J.D., 2005, 'Adaptive gain and the role of the locus coeruleus - Norepinephrine system in optimal performance', Journal of Comparative Neurology 493(1), 99-110. https://doi.org/10.1002/cne.20723        [ Links ]

Biedert, R., Buscher, G., Schwarz, S., Möller, M., Dengel, A. & Lottermann, T., 2010, 'The text 2.0 framework: Writing web-based gaze-controlled realtime applications quickly and easily', in Proceedings of the 2010 Workshop on Eye Gaze in Intelligent Human Machine Interaction, pp. 114-117.

Bojko, A., 2013, Eye tracking the user experience: A practical guide to research, Rosenfeld Media.

Bojko, A.A., 2009, 'Informative or misleading? Heatmaps deconstructed', in International Conference on Human-Computer Interaction, pp. 30-39, Springer, Berlin.

Bolden, D., Barmby, P., Raine, S. & Gardner, M., 2015, 'How young children view mathematical representations: A study using eye-tracking technology', Educational Research 57(1), 59-79. https://doi.org/10.1080/00131881.2014.983718        [ Links ]

Borah, J. & Webster, J.G., 2006, 'Measurement techniques for eye movement', Encyclopedia of Medical Devices and Instrumentation 3, 263-286. https://doi.org/10.1002/0471732877.emd112        [ Links ]

Boucheix, J.M. & Lowe, R.K., 2010, 'An eye tracking comparison of external pointing cues and internal continuous cues in learning with complex animations', Learning and Instruction 20(2), 123-135. https://doi.org/10.1016/j.learninstruc.2009.02.015        [ Links ]

Bradley, M.M., Miccoli, L., Escrig, M.A. & Lang, P.J., 2008, 'The pupil as a measure of emotional arousal and autonomic activation', Psychophysiology 45(4), 602-607. https://doi.org/10.1111/j.1469-8986.2008.00654.x        [ Links ]

Buscher, G., Dengel, A. & Van Elst, L., 2008, 'Eye movements as implicit relevance feedback', in CHI'08 Extended Abstracts on Human Factors in Computing Systems, pp. 2991-2996.

Canham, M. & Hegarty, M., 2010, 'Effects of knowledge and display design on comprehension of complex graphics', Learning and Instruction 20(2), 155-166. https://doi.org/10.1016/j.learninstruc.2009.02.014        [ Links ]

Carpenter, P.A. & Just, M.A., 1978, 'Eye fixations during mental rotation', in J.W. Sender, D.F. Fisher & R.A. Monty (eds.), Eye movements and the higher psychological functions, pp. 115-133, Erlbaum, Hillsdale, NJ.

Chaudhuri, S., Muhonen, H., Pakarinen, E. & Lerkkanen, M.K., 2021, 'Teachers' focus of attention in first-grade classrooms: Exploring teachers experiencing less and more stress using mobile eye-tracking', Scandinavian Journal of Educational Research 66(6), 1076-1092. https://doi.org/10.1080/00313831.2021.1958374        [ Links ]

Chen, Y.C. & Yang, F.Y., 2014, 'Probing the relationship between process of spatial problems solving and science learning: An eye tracking approach', International Journal of Science and Mathematics Education 12(3), 579-603. https://doi.org/10.1080/00313831.2021.1958374        [ Links ]

Cohors-Fresenborg, E., Kramer, S., Pundsack, F., Sjuts, J. & Sommer, N., 2010, 'The role of metacognitive monitoring in explaining differences in mathematics achievement', ZDM Mathematics Education 42(2), 231-244. https://doi.org/10.1007/s11858-010-0237-x        [ Links ]

Cortina, K.S., Miller, K.F., McKenzie, R. & Epstein, A., 2015, 'Where low and high inference data converge: Validation of CLASS assessment of mathematics instruction using mobile eye tracking with expert and novice teachers', International Journal of Science and Mathematics Education 13(2), 389-403. https://doi.org/10.1007/s10763-014-9610-5        [ Links ]

Da Silva Soares, R., Jr., Lukasova, K., Carthery-Goulart, M.T. & Sato, J.R., 2021, 'Student's perspective and teachers' metacognition: Applications of eye-tracking in education and scientific research in schools', Frontiers in Psychology 12, 673615. https://doi.org/10.3389/fpsyg.2021.673615        [ Links ]

Da Silva Soares R., Jr., Oku, A.Y.A., Barreto, C.S. & Sato, J.R., 2022, 'Applying functional near-infrared spectroscopy and eye-tracking in a naturalistic educational environment to investigate physiological aspects that underlie the cognitive effort of children during mental rotation tests', Frontiers in human neuroscience, 16, 889806        [ Links ]

Daraghmi, E.Y., Fan, C.T., Lin, W.J., Peng, Z.Y. & Yuan, S.M., 2015, 'Eye-tracking assisted self-directed learning system', in 2015 IEEE 15th international conference on advanced learning technologies, IEEE, pp. 52-54.

De Koning, B.B., Tabbers, H.K., Rikers, R.M. & Paas, F., 2010, 'Attention guidance in learning from a complex animation: Seeing is understanding?', Learning and Instruction 20(2), 111-122. https://doi.org/10.1016/j.learninstruc.2009.02.010        [ Links ]

Delabarre, E.B., 1898, 'A method of recording eye-movements', The American Journal of Psychology 9(4), 572-574. https://doi.org/10.2307/1412191        [ Links ]

Duchowski, A.T. & Duchowski, A.T., 2017, Eye tracking methodology: Theory and practice, Springer.

Duchowski, A.T., Price, M.M., Meyer, M. & Orero, P., 2012, 'Aggregate gaze visualization with real-time heatmaps', in Proceedings of the Symposium on Eye Tracking Research and Applications, pp. 13-20.

Epelboim, J. & Suppes, P., 2001, 'A model of eye movements and visual working memory during problem solving in geometry', Vision Research 41(12), 1561-1574. https://doi.org/10.1016/S0042-6989(00)00256-X        [ Links ]

Erdmann, B. & Dodge, R., 1898, Psychologische Untersuchungen über das Lesen auf experimenteller Grundlage, Niemeyer.

Foulsham, T., 2015, 'Eye movements and their functions in everyday tasks', Eye 29(2), 196-199. https://doi.org/10.1038/eye.2014.275        [ Links ]

Guarini, A., Tobia, V., Bonifacci, P., Faldella, G. & Sansavini, A., 2021, 'Magnitude comparisons, number knowledge and calculation in very preterm children and children with specific learning disability: a cross-population study using eye-tracking', Journal of Learning Disabilities, 54(2), 83-96.         [ Links ]

GazeRecorder, 2016, Real-time online Eye-Tracking Software. https://gazerecorder.com

Gauthier, I., 2020, 'What we could learn about holistic face processing only from nonface objects', Current Directions in Psychological Science 29(4), 419-425. https://doi.org/10.1177/0963721420920620        [ Links ]

Gregory, R.L., 1990, Eye and brain: The psychology of seeing, Princeton University Press, Princeton, NJ.

Hannula, D.E., Althoff, R.R., Warren, D.E., Riggs, L., Cohen, N.J. & Ryan, J.D., 2010, 'Worth a glance: Using eye movements to investigate the cognitive neuroscience of memory', Frontiers in Human Neuroscience 4, 166. https://doi.org/10.3389/fnhum.2010.00166        [ Links ]

Hansen, D.W. & Ji, Q., 2009, 'In the eye of the beholder: A survey of models for eyes and gaze', IEEE Transactions on Pattern Analysis and Machine Intelligence 32(3), 478-500. https://doi.org/10.1109/TPAMI.2009.30        [ Links ]

Hayhoe, M. & Ballard, D., 2005, 'Eye movements in natural behavior', Trends in Cognitive Sciences 9(4), 188-194. https://doi.org/10.1016/j.tics.2005.02.009        [ Links ]

Hegarty, M., Mayer, R.E. & Green, C.E., 1992, 'Comprehension of arithmetic word problems: Evidence from students' eye fixations', Journal of Educational Psychology 84(1), 76. https://doi.org/10.1037/0022-0663.84.1.76        [ Links ]

Heminghous, J. & Duchowski, A.T., 2006, 'iComp: A tool for scanpath visualization and comparison', in Proceedings of the 3rd Symposium on Applied Perception in Graphics and Visualization, pp. 152-152.

Hess, E.H. & Polt, J.M., 1964, 'Pupil size in relation to mental activity during simple problem-solving', Science 143(3611), 1190-1192. https://doi.org/10.1126/science.143.3611.1190        [ Links ]

Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H. & Van de Weijer, J., 2011, Eye tracking: A comprehensive guide to methods and measures, OUP Oxford.

Holmqvist, K., Nyström, M. & Mulvey, F., 2012, 'Eye tracker data quality: What it is and how to measure it', in Proceedings of the Symposium on Eye Tracking Research and Applications, pp. 45-52.

Holsanova, J., 2014, 'Reception of multimodality: Applying eye tracking methodology in multimodal research', in C. Jewitt (ed.), Routledge handbook of multimodal analysis, vol. 2, pp. 285-296, Routhledge.

Huey, E.B., 1898, 'Preliminary experiments in the physiology and psychology of reading', The American Journal of Psychology 9(4), 575-586. https://doi.org/10.2307/1412192        [ Links ]

Hunt, T.E., Clark-Carter, D. & Sheffield, D., 2015, 'Exploring the relationship between mathematics anxiety and performance: An eye-tracking approach', Applied Cognitive Psychology 29(2), 226-231. https://doi.org/10.1002/acp.3099        [ Links ]

Hyrskykari, A., 2006, 'Utilizing eye movements: Overcoming inaccuracy while tracking the focus of attention during reading', Computers in Human Behavior 22(4), 657-671. https://doi.org/10.1016/j.chb.2005.12.013        [ Links ]

Iannizzotto, G., Nucita, A., Fabio, R.A., Caprì, T. & Lo Bello, L., 2020, 'Remote eye-tracking for cognitive telerehabilitation and interactive school tasks in times of COVID-19', Information 11(6), 296. https://doi.org/10.3390/info11060296        [ Links ]

Jainta, S. & Baccino, T., 2010, 'Analyzing the pupil response due to increased cognitive demand: An independent component analysis study', International Journal of Psychophysiology 77(1), 1-7. https://doi.org/10.1016/j.ijpsycho.2010.03.008        [ Links ]

Jarodzka, H., Scheiter, K., Gerjets, P. & Van Gog, T., 2010, 'In the eyes of the beholder: How experts and novices interpret dynamic stimuli', Learning and Instruction 20(2), 146-154. https://doi.org/10.1016/j.learninstruc.2009.02.019        [ Links ]

Jarodzka, H., Van Gog, T., Dorr, M., Scheiter, K. & Gerjets, P., 2013, 'Learning to see: Guiding students' attention via a model's eye movements fosters learning', Learning and Instruction 25, 62-70. https://doi.org/10.1016/j.learninstruc.2012.11.004        [ Links ]

Javal, E., 1878, 'Essai sur la physiologie de la lecture', Annales d'Ocilistique 80, 97-117.         [ Links ]

Kardon, R., 2005, Anatomy and physiology of the autonomic nervous system: Walsh and Hoyt clinical neuro-ophthalmology, 6th edn., pp. 674-676, Williams & Wilkins, Baltimore, MD.

Katus, L., Hayes, N.J., Mason, L., Blasi, A., McCann, S., Darboe, M.K. et al., 2019, 'Implementing neuroimaging and eye tracking methods to assess neurocognitive development of young infants in low-and middle-income countries', Gates Open Research 3, 1113. https://doi.org/10.12688/gatesopenres.12951.2        [ Links ]

Kennedy, A., 1992, 'The spatial coding hypothesis', in Eye movements and visual cognition, pp. 379-396, Springer, New York, NY.

Klingner, J., Tversky, B. & Hanrahan, P., 2011, 'Effects of visual and verbal presentation on cognitive load in vigilance, memory, and arithmetic tasks', Psychophysiology 48(3), 323-332. https://doi.org/10.1111/j.1469-8986.2010.01069.x        [ Links ]

Lai, M.L., Tsai, M.J., Yang, F.Y., Hsu, C.Y., Liu, T.C., Lee, S.W.Y. et al., 2013, 'A review of using eye-tracking technology in exploring learning from 2000 to 2012', Educational research review, 10, 90-115.         [ Links ]

Lilienthal, A.J. & Schindler, M., 2019, 'Current trends in the use of eye tracking in mathematics education research: A PME survey', in M. Graven, H. Venkat, A.A. Essien & P. Vale (eds.), Proceedings of 43rd annual meeting of the International Group for the Psychology of Mathematics Education, PME, Pretoria, July 07-12, 2019.

Lin, J.J. & Lin, S.S., 2014, 'Tracking eye movements when solving geometry problems with handwriting devices', Journal of Eye Movement Research 7(1), 1-15. https://doi.org/10.16910/jemr.7.1.2        [ Links ]

Liversedge, S.P. & Findlay, J.M., 2000, 'Saccadic eye movements and cognition', Trends in Cognitive Sciences 4(1), 6-14. https://doi.org/10.1016/S1364-6613(99)01418-7        [ Links ]

Mason, L., Pluchino, P. & Tornatora, M.C., 2016, 'Using eye-tracking technology as an indirect instruction tool to improve text and picture processing and learning', British Journal of Educational Technology 47(6), 1083-1095. https://doi.org/10.1111/bjet.12271        [ Links ]

Mathôt, S., 2018, 'Pupillometry: Psychology, physiology, and function', Journal of Cognition 1(1), 16. https://doi.org/10.5334/joc.18        [ Links ]

McDonald, B. & Boud, D., 2003, 'The impact of self-assessment on achievement: The effects of self-assessment training on performance in external examinations', Assessment in Education: Principles, Policy & Practice 10(2), 209-220. https://doi.org/10.1080/0969594032000121289        [ Links ]

O'Brien, S., 2009. 'Eye tracking in translation process research: methodological challenges and solutions', Methodology, technology and innovation in translation process research, 38, 251-266        [ Links ]

Papoutsaki, A., Laskey, J. & Huang, J., 2017, 'Searchgazer: Webcam eye tracking for remote studies of web search', in Proceedings of the 2017 conference on conference human information interaction and retrieval, pp. 17-26.

Pavlov, Y.G., Kasanov, D., Kosachenko, A.I., Kotyusov, A.I. & Busch, N.A., 2022, 'Pupillometry and electroencephalography in the digit span task', Scientific Data, 9(1), 1-6.         [ Links ]

Poole, A. & Ball, L.J., 2006, 'Eye tracking in HCI and usability research', in Encyclopedia of human computer interaction, pp. 211-219, IGI global.

Posner, M.I., 1980, 'Orienting of attention', Quarterly Journal of Experimental Psychology 32(1), 3-25. https://doi.org/10.1080/00335558008248231        [ Links ]

Prieto, L.P., Sharma, K., Wen, Y. & Dillenbourg, P., 2015, The burden of facilitating collaboration: Towards estimation of teacher orchestration load using eye-tracking measures, International Society of the Learning Sciences, Inc.

Rayner, K., 1998, 'Eye movements in reading and information processing: 20 years of research', Psychological Bulletin 124(3), 372. https://doi.org/10.1037/0033-2909.124.3.372        [ Links ]

Rayner, K., Chace, K.H., Slattery, T.J. & Ashby, J., 2006, 'Eye movements as reflections of comprehension processes in reading', Scientific Studies of Reading 10(3), 241-255. https://doi.org/10.1207/s1532799xssr1003_3        [ Links ]

Rayner, K. & Pollatsek, A., 1992, 'Eye movements and scene perception', Canadian Journal of Psychology/Revue Canadienne de Psychologie 46(3), 342. https://doi.org/10.1037/h0084328        [ Links ]

Robal, T., Zhao, Y., Lofi, C. & Hauff, C., 2018, 'Webcam-based attention tracking in online learning: A feasibility study', in 23rd international conference on intelligent user interfaces, pp. 189-197.

Rozado, D. & Dunser, A., 2015., 'Combining EEG with pupillometry to improve cognitive workload detection', Computer, 48(10), 18-25.         [ Links ]

Russo, J.E., Johnson, E.J. & Stephens, D.L., 1989, 'The validity of verbal protocols. Memory & Cognition', Memory & cognition, 17, 759-769.         [ Links ]

Schaefer, T., Ferguson, J.B., Klein, J.A. & Rawson, E.B., 1968, 'Pupillary responses during mental activities', Psychonomic Science 12(4), 137-138. https://doi.org/10.3758/BF03331236        [ Links ]

Scheiter, K. & Eitel, A., 2017, 'The use of eye tracking as a research and instructional tool in multimedia learning', in Eye-tracking technology applications in educational research, pp. 143-164, IGI Global.

Schindler, M. & Lilienthal, A., 2018, 'Eye-tracking for studying mathematical difficulties: Also in inclusive settings', in Annual meeting of the International Group for the Psychology of Mathematics Education (PME-42), vol. 4, pp. 115-122, PME, Umeå, 3rd-8th July 2018.

Schindler, M. & Lilienthal, A.J., 2019, 'Domain-specific interpretation of eye tracking data: Towards a refined use of the eye-mind hypothesis for the field of geometry', Educational Studies in Mathematics 101(1), 123-139. https://doi.org/10.1007/s10649-019-9878-z        [ Links ]

Shayan, S., Abrahamson, D., Bakker, A., Duijzer, C.A. & Van der Schaaf, M., 2017, 'Eye-tracking the emergence of attentional anchors in a mathematics learning tablet activity', in Eye-tracking technology applications in educational research, pp. 166-194, IGI Global.

Suppes, P., 1990, 'Eye-movement models for arithmetic and reading performance', Eye Movements and Their Role in Visual and Cognitive Processes 4, 455-477.         [ Links ]

Susac, A.N., Bubic, A., Kaponja, J., Planinic, M. & Palmovic, M., 2014, 'Eye movements reveal students' strategies in simple equation solving', International Journal of Science and Mathematics Education 12(3), 555-577. https://doi.org/10.1007/s10763-014-9514-4        [ Links ]

Taylor, E.A., 1937, Controlled reading: A correlation of diagnostic, teaching, and corrective techniques, University of Chicago Press.

Valliappan, N., Dai, N., Steinberg, E., He, J., Rogers, K., Ramachandran, V. et al., 2020, 'Accelerating eye movement research via accurate and affordable smartphone eye tracking', Nature Communications 11(1), 1-12. https://doi.org/10.1038/s41467-020-18360-5        [ Links ]

Van den Broek, A.W., 2018, 'Gaze data as a metacognitive tool to support the development of structure sense in algebra', Master's thesis.

Van der Meer, E., Beyer, R., Horn, J., Foth, M., Bornemann, B., Ries, J. et al., 2010, 'Resource allocation and fluid intelligence: Insights from pupillometry', Psychophysiology 47(1), 158-169. https://doi.org/10.1111/j.1469-8986.2009.00884.x        [ Links ]

Van Gog, T., Jarodzka, H., Scheiter, K., Gerjets, P. & Paas, F., 2009, 'Attention guidance during example study via the model's eye movements', Computers in Human Behavior 25(3), 785-791. https://doi.org/10.1016/j.chb.2009.02.007        [ Links ]

Van Gog, T. & Scheiter, K., 2010, 'Eye tracking as a tool to study and enhance multimedia learning', Learning and Instruction 20(2), 95-99. https://doi.org/10.1016/j.learninstruc.2009.02.009        [ Links ]

Van Gog, T.V. & Jarodzka, H., 2013, 'Eye tracking as a tool to study and enhance cognitive and metacognitive processes in computer-based learning environments', in International handbook of metacognition and learning technologies, pp. 143-156, Springer, New York, NY.

Van Viersen, S., Slot, E.M., Kroesbergen, E.H., Van't Noordende, J.E. & Leseman, P.P., 2013, 'The added value of eye-tracking in diagnosing dyscalculia: A case study', Frontiers in Psychology 4, 679. https://doi.org/10.3389/fpsyg.2013.00679        [ Links ]

Verschaffel, L., De Corte, E. & Pauwels, A., 1992, 'Solving compare problems: An eye movement test of Lewis and Mayer's consistency hypothesis', Journal of Educational Psychology 84(1), 85. https://doi.org/10.1037/0022-0663.84.1.85        [ Links ]

Wang, H.S., Chen, Y.T. & Lin, C.H., 2014, 'The learning benefits of using eye trackers to enhance the geospatial abilities of elementary school students', British Journal of Educational Technology 45(2), 340-355. https://doi.org/10.1111/bjet.12011        [ Links ]

Was, C., Sansosti, F. & Morris, B. (eds.), 2016, Eye-tracking technology applications in educational research, IGI Global.

Yeung, H.H., Denison, S. & Johnson, S.P., 2016, 'Infants' looking to surprising events: When eye-tracking reveals more than looking time', PloS one, 11(12): e0164277.         [ Links ]

Yeung, M.K., Lee, T.L., Han, Y.M., Chan, A.S., 2021, Prefrontal activation and pupil dilation during n-back task performance: a combined fNIRS and pupillometry study. Neuropsychologia, 159:107954. https://doi.org/10.1016/j.neuropsychologia.2021.10795        [ Links ]

 

 

Correspondence:
Candida Barreto
candidasfb2010@gmail.com

Received: 17 Mar. 2022
Accepted: 11 Oct. 2022
Published: 19 June 2023

Creative Commons License All the contents of this journal, except where otherwise noted, is licensed under a Creative Commons Attribution License