GlassesValidator: A data quality tool for eye tracking glasses

Diederick C. Niehorster; Roy S. Hessels; Jeroen S. Benjamins; Marcus Nyström; Ignace T.C. Hooge

doi:10.3758/s13428-023-02105-5

GlassesValidator: A data quality tool for eye tracking glasses

Diederick C. Niehorster^*
, Roy S. Hessels
, Jeroen S. Benjamins
, Marcus Nyström
, Ignace T.C. Hooge

^*Corresponding author for this work

Lund University

Research output: Contribution to journal › Article › Academic › peer-review

Abstract

According to the proposal for a minimum reporting guideline for an eye tracking study by Holmqvist et al. (2022), the accuracy (in degrees) of eye tracking data should be reported. Currently, there is no easy way to determine accuracy for wearable eye tracking recordings. To enable determining the accuracy quickly and easily, we have produced a simple validation procedure using a printable poster and accompanying Python software. We tested the poster and procedure with 61 participants using one wearable eye tracker. In addition, the software was tested with six different wearable eye trackers. We found that the validation procedure can be administered within a minute per participant and provides measures of accuracy and precision. Calculating the eye-tracking data quality measures can be done offline on a simple computer and requires no advanced computer skills.

Original language	English
Pages (from-to)	1476–1484
Number of pages	9
Journal	Behavior Research Methods
Volume	56
Issue number	3
Early online date	8 Jun 2023
DOIs	https://doi.org/10.3758/s13428-023-02105-5
Publication status	Published - 2024

Bibliographical note

Publisher Copyright:
© The Author(s) 2023.

Funding

The authors thank SeeTrue Technologies Oy (Joensuu, Finland), Pupil Labs GmbH (Berlin, Germany) and Tobii Pro AB (Stockholm, Sweden) for lending us their eye trackers. The authors also thank Lund University Humanities Lab for the use of the laboratory and providing us with the SMI ETG 2.0 Glasses and the Tobii Pro Glasses 2. Author RH was supported by the Consortium on Individual Development (CID). CID is funded through the Gravitation program of the Dutch Ministry of Education, Culture, and Science and the NWO (Grant No. 024.001.003).

Funders	Funder number
Dutch Ministry of Education, Culture, and Science
Nederlandse Organisatie voor Wetenschappelijk Onderzoek	024.001.003
Nederlandse Organisatie voor Wetenschappelijk Onderzoek

Keywords

Accuracy
Calibration
Data quality
Eye tracking
Reporting practices
Validation

Access to Document

10.3758/s13428-023-02105-5Licence: CC BY

s13428-023-02105-5Final published version, 906 KBLicence: CC BY

Cite this

@article{ddb11b2985b041c7bc502b584612be6d,

title = "GlassesValidator: A data quality tool for eye tracking glasses",

abstract = "According to the proposal for a minimum reporting guideline for an eye tracking study by Holmqvist et al. (2022), the accuracy (in degrees) of eye tracking data should be reported. Currently, there is no easy way to determine accuracy for wearable eye tracking recordings. To enable determining the accuracy quickly and easily, we have produced a simple validation procedure using a printable poster and accompanying Python software. We tested the poster and procedure with 61 participants using one wearable eye tracker. In addition, the software was tested with six different wearable eye trackers. We found that the validation procedure can be administered within a minute per participant and provides measures of accuracy and precision. Calculating the eye-tracking data quality measures can be done offline on a simple computer and requires no advanced computer skills.",

keywords = "Accuracy, Calibration, Data quality, Eye tracking, Reporting practices, Validation",

author = "Niehorster, \{Diederick C.\} and Hessels, \{Roy S.\} and Benjamins, \{Jeroen S.\} and Marcus Nystr{\"o}m and Hooge, \{Ignace T.C.\}",

note = "Publisher Copyright: {\textcopyright} The Author(s) 2023.",

year = "2024",

doi = "10.3758/s13428-023-02105-5",

language = "English",

volume = "56",

pages = " 1476–1484",

journal = "Behavior Research Methods",

issn = "1554-351X",

publisher = "Springer Nature",

number = "3",

}

TY - JOUR

T1 - GlassesValidator

T2 - A data quality tool for eye tracking glasses

AU - Niehorster, Diederick C.

AU - Hessels, Roy S.

AU - Benjamins, Jeroen S.

AU - Nyström, Marcus

AU - Hooge, Ignace T.C.

N1 - Publisher Copyright: © The Author(s) 2023.

PY - 2024

Y1 - 2024

N2 - According to the proposal for a minimum reporting guideline for an eye tracking study by Holmqvist et al. (2022), the accuracy (in degrees) of eye tracking data should be reported. Currently, there is no easy way to determine accuracy for wearable eye tracking recordings. To enable determining the accuracy quickly and easily, we have produced a simple validation procedure using a printable poster and accompanying Python software. We tested the poster and procedure with 61 participants using one wearable eye tracker. In addition, the software was tested with six different wearable eye trackers. We found that the validation procedure can be administered within a minute per participant and provides measures of accuracy and precision. Calculating the eye-tracking data quality measures can be done offline on a simple computer and requires no advanced computer skills.

AB - According to the proposal for a minimum reporting guideline for an eye tracking study by Holmqvist et al. (2022), the accuracy (in degrees) of eye tracking data should be reported. Currently, there is no easy way to determine accuracy for wearable eye tracking recordings. To enable determining the accuracy quickly and easily, we have produced a simple validation procedure using a printable poster and accompanying Python software. We tested the poster and procedure with 61 participants using one wearable eye tracker. In addition, the software was tested with six different wearable eye trackers. We found that the validation procedure can be administered within a minute per participant and provides measures of accuracy and precision. Calculating the eye-tracking data quality measures can be done offline on a simple computer and requires no advanced computer skills.

KW - Accuracy

KW - Calibration

KW - Data quality

KW - Eye tracking

KW - Reporting practices

KW - Validation

UR - https://www.scopus.com/pages/publications/85161964421

U2 - 10.3758/s13428-023-02105-5

DO - 10.3758/s13428-023-02105-5

M3 - Article

AN - SCOPUS:85161964421

SN - 1554-351X

VL - 56

SP - 1476

EP - 1484

JO - Behavior Research Methods

JF - Behavior Research Methods

IS - 3

ER -

GlassesValidator: A data quality tool for eye tracking glasses

Abstract

Bibliographical note

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this