Psyc 737 - Seminar in Human Factors Engineering
Eye Tracking: Measurement, Theory & Applications
Spring 2017 (version 1.0)
Last updated 1/8/2017


Time: Tuesday & Thursday 12:30-1:45 PM
Room: 203 SDU
Professor: Frank Schieber, email address: schieber@usd.edu
Home Page: http://usd-apps.usd.edu/coglab/schieber/eyetracking/

Syllabus

Topic Assigned Readings
I. Overview of Eye Tracking and Human Factors Applications Duchowski (2002);
Richardson & Spivey (2004)
II. Recording & Quantification of Eye Movement Behavior  

A.Evaluation Criteria:
accuracy, precision, temporal latency/update rate, calibration, coordinates, data synchronization, etc.

 B. Survey of Approaches to Eye Movement Measurement
    1. Video capture with frame-by-frame analysis
    2. Electro-oculogram (EOG)
    3. Scleral Search Coil
    4. Corneal Reflection technique
           Dark/bright pupils; Dual-Purkinje image

C. Hands-on Experience with USD Vision Lab eyetrackers
1.  ASL 501 Head-mounted eye tracker
2.  ASL 501 with Eye-Head Integration (Ascension Flock-of-Birds)
3.  ASL ETS-PC remote eye tracker for driving research
4.  Gazepoint GP3 remote eye tracker for display-based research

D. Qualitative and Quantitative EM Data Analysis
1.  ASL Eyenal - Raw eye position time-series to fixation/saccade measures
2.  Gazepoint experimental control and data analysis suite
3.  iMAP - Creation and statistical evaluation of fixation "maps"

 B. Eyetracker Technology:
Eye Tracking Techniques
Buswell-1935
Schieber, et al. (1997)
Yarbus-1967
Wade & Tatler (2005)
 

C: Eyetracker Manuals:
Head-Mounted Manual
Eye-Head Integration
ASL 6000 Control Unit
ASL MiniManual

D: Fixation Analysis:
ASL Eyenal User's Manual
Quantitative Fixation Maps
III. Theoretical Importance of Eye Movements: The Active Vision Approach  

A. Inhomogeneity of retinal resolution/representation
B. Performance in peripheral visual field
C. Parallel visual pathways
D. Characteristics of saccadic eye movements
E. Saccadic suppression
F. Physiological mechanisms of saccadic guidance

 F&G (2003)-Chap.2
Bahill, Adler & Stark (1975)
IV. Covert vs. Overt Visual Attention  

 A. Characteristics of covert spatial attention
 B. Models of covert spatial attention
   1. Spotlight
   2. Zoom lens
   3. Late vs. early selection models
   4. Henderson (1992) sequential attention model
   5. Premotor theory
C. Object-based theories of attention
D. Some neurophysiology of attention

  F&G (2003)-Chap.3
V. Basic Principles of Saccadic Response: Simple Visual Orientation  

A. Eye-field versus Head-field
B. Factors influencing saccade latency
   1. Target eccentricity
   2. Gap effect/paradigm
   3. Remote distracter effect (Walker, et al., 1997)
   4. Express saccades (Fischer & Weber, 1993)
   5. Model of saccade latency distribution (LATER)
       (Carpenter & Williams, 1995)
C. Physiology of saccade initiation (Wurtz, 1996)
D. Saccadic guidance (accuracy)
   1. The double-step paradigm (Becker & Jurgens, 1979)
   2. The double-target paradigm
      a. Global effect
      b. Center-of-gravity effect
   3. Pipelined saccades (McPeek, et al., 2000)
   4. Antisaccades (Fischer & Weber, 1992)
   5. Working model of saccade guidance: Findlay & Walker (1999)

 F&G (2003)-Chap.4

Becker & Jurgens (1979)
Carpenter & Williams (1995)
Fischer & Weber (1993)
Fischer & Weber (1992)
Ludwig (2011)
McPeek, et al. (2000)
Walker, et al. (1997)
Wurtz (1996)

VI.  Text Reading

 Rayner (1998)
E-Z Reader ver. 7
VII.  Pupillometrics Beatty & Lucero-Wagoner (2000)
VIII. Visual Search: Static Laboratory Displays F&G (2003)-Chap. 7
IX. Visual Search: Natural/Dynamic Scenes Henderson (2003)
Henderson & Hollingworth (1999)
Land & Furneaux (1997)
Schieber, Willan & Schlorholtz (2006)
vonWartburg, et al (2005)
X. Automobile Driving Bhise & Rockwell (1973)
Green (2002)
Land & Lee (1994)
Recartes & Nunes (2000; 2003)
Schieber, et al. (2008)
Schieber & Gilland (2010)
XI.  Usability/HCI Applications Pernice & Nielsen (2009)
How recruiters scan a Resume
Nielson Norman on Web Design
see ETRA Archives
   
Resources:  
Journal of Eye Movement Research  
Nielsen Norman Group's Eyetracking & Usability Webpages  
ETRA Conference Paper Archives  

Text
Findlay, J.M. & Gilchrist, I.D. (2003).  Active vision: The psychology of looking and seeing.  Oxford, UK: Oxford University Press. ISBN: 0-19-852479-X

Reading List

Bahill, A.T., Adler, D. & Stark, L. (1975).  Most naturally occurring saccades have magnitudes of 15 degrees or less. Investigative Ophthalmology, 14, 468-469.
Beatty, J. & Lucero-Wagoner, B. (2000). The pupillary system. In J.T. Cacioppo, et al. (Eds.). Handbook of psychophysiology. 2nd edition. Cambridge University Press. (pp. 142-162).

Becker, W. & Jurgens, R. (1979).  An analysis of the saccadic system by means of double-step stimuli.  Vision Research, 19, 967-983.
Bhise, VD & Rockwell, TH (1973).  Development of a methodology for evaluating road signs.  Project EES-315B Final Report.  Engineering Experiment Station Bulletin 207. Engineering Publications, College of Engineering, The Ohio State University, 2070 Neil Avenue, Columbus, OH 43210. (241 pp.)
Brett, M., Penny, W. & Kiebel, S. (2003). An introduction to Random Field Theory. Chapter 14.  In J. Ashburner, K. Friston & W. Penny (Eds.), Human brain function (2nd ed.). Online Edition: http://www.fil.ion.ucl.ac.uk/spm/doc/books/hbf2/
Buswell, G.T (1935).  How people look at pictures: A study of the psychology of perception in art. Chicago: University of Chicago Press. 198 pp.
Caldara, R. & Miellet, S. (2011). iMap: A novel method for statistical fixation mapping of eye movement data. Behavior Research Methods, 43(3), 864-878.

Carpenter, R.H.S. & Williams, M.L.L. (1995).  Neural computation of log likelihood in control of saccadic eye movements.  Nature, 377, 59-62.
Chauvin, A., Worsley, K.J., Schyns, P.G., Arguin, M. & Gosselin, F. (2005).  Accurate statistical tests for smooth classification images.  Journal of Vision, 5, 659-667. http://journalofvision.org/5/9/1/
Duchowski, A.T. (2002). A breadth-first survey of eye tracking applications.  Behavior Research Methods, Instruments and Computers,

Findlay, J.M. & Gilchrist, I.D. (2003a).  Chapter 2. Visual orientation. In Active vision: The psychology of looking and seeing. New York: Oxford University Press. (pp. 9-34)

Findlay, J.M. & Gilchrist, I.D. (2003b).  Chapter 3.Visual selection, covert attention and eye movements. In Active vision: The psychology of looking and seeing. New York: Oxford University Press. (pp. 35-54)
Findlay, J.M. & Gilchrist, I.D. (2003e).  Chapter 4. Visual orientation...
Findlay, J.M. & Gilchrist, I.D. (2003c). Chapter 7. Visual search. In Active vision: The psychology of looking and seeing. New York: Oxford University Press. (pp. 35-54)
Findlay, J.M. & Gilchrist, I.D. (2003d).  References. Active vision: The psychology of looking and seeing. New York: Oxford University Press. (pp. 181-213)
Findlay, J.M. & Walker, R. (1999). A model of saccade generation based on parallel processing and competitive inhibition. Behavioral and Brain Sciences, 22, 661-721.

Fischer, B. & Weber, H. (1992).  Characteristics of ‘anti’ saccades in man.  Experimental Brain Research, 89, 415-424.

Fischer, B. & Weber, H. (1993).  Express saccades and visual attention. Behavioral and Brain Sciences, 16, 553-610.
Green, P (2002) Where do drivers look while driving (and for how long)? In R.E. Dewar & P.L.Olson (Eds), Human factors in traffic safety.  Tucson, AZ: Lawyers and Judges Publishing. (pp. 77-110)
Henderson, J.M. & Hollingworth, A. (1999). High-level scene perception. Annual Review of Psychology, 50, 243-271.
Henderson, J.M. (2003). Human gaze control during real-world scene perception. Trends in Cognitive Sciences, 7(11), 498-504.
Land & Lee (1994) Where we look when we steer.  Nature, 369, 742-744.
Land, M.F. & Furneaux, S. (1997).  The knowledge base of the oculomotor system. Philosophical Transactions of the Royal Society, London B, 352, 1231-1239.
Ludwig, C.J.H. (2011). Saccadic decision making. In S.P. Liversedge, I.D. Gilchrist & S. Everling (Eds.), The Oxford handbook of eye movements. (pp. 425-437). New York: Oxford University Press.

Mackworth, N.H. & Morandi, A.J. (1967).  The gaze selects informative detail within pictures.  Perception and Psychophysics, 2, 547-552.
Maltz & Shinar (1999) Eye movements of younger and older drivers. Human Factors, 41, 15-25.

McPeek, R.M., Skavenski, A.A. & Nakayama, K. (2000).  Concurrent processing of saccades in visual search.  Vision Research, 40, 2499-2516.
Pernice, K. & Nielsen, J. (2009). Eyetracking methodology: How to conduct and evaluate usability studies using eyetracking. Freemont, CA: Nielsen Norman Group. http://www.useit.com/eyetracking/methodology/
Rayner, K. (1998).  Eye movements in reading and information processing: 20 years of research.  Psychological Bulletin, 124, 372-422.
Recarte & Nunes (2000) Effects of verbal and spatial imagery tasks on eye fixations while driving. Journal of Experimental Psychology: Applied, 6, 31-43.
Recarte & Nunes (2003) Mental workload and driving: Effects on visual search, discrimination and decision making. Journal of Experimental Psychology: Applied, 9, 119-137.
Reddi, B.A.J. & Carpenter, R.H.S. (2000). The influence of urgency on decision time. Nature Neuroscience, 3(8), 827-830.
Richardson, D.C. & Spivey, M.J. (2004).  Eye-tracking: Research areas and applications.  In G. Wnek & G. Bowlin (Eds.), Encyclopedia of Biomaterials and Biomedical Engineering. New York: Taylor and Francis.
Reichle, ED, Rayner, K. & Pollatsek, A. (2003). The E-Z Reader model of eye-movement control in reading: Comparisons to other models.  Behavioral and Brain Sciences, 26, 445-536.
SAE (1998) Definition of experimental measures related to the specification of driver visual behavior using video based techniques. Draft SAE J-2396 Recommended practice. Society of Auotomotive Engineers [On-line Report] Date 12-98.
Schieber, F. & Gilland, J. (2010). Visual entropy metric reveals drivers' eye movement complexity across variations of age and subsidiary task load. Proceedings of the Human facators and Ergonomics Society, 52, 1883-1887.
Schieber, et al. (1997) Precision and accuracy of video-based measurements of driver’s gaze location.  Proceedings of the Human Factors and Ergonomics Society, Santa Monica, CA:  Human Factors and Ergonomics Society. pp. 929-933.
Schieber, F., Holtz, A., Schlorholtz, B. & McCall, R. (2008). Analysis of visual demands of in-vehicle text displays reveals an age-related increase in time needed to reallocate attention to the road. Proceedings of the Human Factors and Ergonomics Society, 52, 149-153.
Schieber, F., Willan, N. & Schlorholtz, B. (2006).  Fluorescent colored stimuli automatically attract visual attention: An eye movement study. Proceedings of the Human Factors and Ergonomics Society, 50, 1634-1637
Shinar, et al (1977) Eye movements in curve negotiation. Human Factors, 19, 63-71.
Steinhauer, SR, Siegle, GJ, Condray, R & Pless, M (2004).  Sympathetic and parasympathetic inervation of pupillary dilation during sustained processing. International Journal of Psychophysiology, 52, 77-86.
vonWartburg, R., et al. (2005).  Size matters: Saccades during scene perception.  Poster presented at the 13th European Conference on Eye Movements, Bern, Switzerland.
Wade, N.J. & Tatler, B.J. (2005).  Chapter 1 from The moving tablet of the eye.  New York: Oxford University Press. (pp.1-32)

Walker, R., Deubel, H., Schneider, W.X. & Findlay, J.M. (1997).  The effect of remote distractors on saccade programming: evidence for an extended fixation zone. Journal of Neurophysiology, 78, 1108-1119.
Worsley, K.J. (1996).  The geometry of random images. Chance, 9(1), 27-40. [Note: Some pages inverted during scanning; you must print this file to read it]

Wurtz, R.H. (1996).  Vision for the control of movement. Investigative Ophthalmology and Visual Science, 37, 2131-2145.
Yarbus, A.L. (1967).  Eye movements and vision.  New York: Plenum Press. 222 pp. (Translated from Russian by Basil Haigh & Lorrin Riggs)
 

Course Requirements
Regular class attendance is expected.  Once more, time outside of the regularly scheduled lecture will need to be spent in the vision and/or simulation laboratory in order for students to "get their hands dirty" while learning to use one of the eye trackers available at USD.  Students will be required to identify an eyetracking-based research topic by October 21.  After the topic is approved by the professor, students will prepare a research paper (complete with Abstract, Introduction, Methods, (proposed) Results and References sections) which is due by November 12.  Students will setup, test and verify the eyetracker and related instrumentation to demonstrate their ability to implement their proposed research protocol using equipment/expertise available in the Heimstra Labs.  Finally, students will be required to present their research projects via PowerPoint presentation during the last two weeks of class as well as sit for a comprehensive written exam on or about November 15.

Requirement Due Date Weight
Eyetracking Experimental Research Paper November 12 25%
Comprehensive Written Exam November 15-ish 25%
Class Presentation on Research Topic Last 2 weeks of class 25%
Experimental Protocol Development & Demonstration December 9 25%

 

USD faculty must include the following statements in all course syllabi:  

1.      Freedom in Learning
Under Board of Regents and University policy student academic performance may be evaluated solely on an academic basis, not on opinions or conduct in matters unrelated to academic standards. Students should be free to take reasoned exception to the data or views offered in any course of study and to reserve judgment about matters of opinion, but they are responsible for learning the content of any course of study for which they are enrolled. Students who believe that an academic evaluation reflects prejudiced or capricious consideration of student opinions or conduct unrelated to academic standards should contact the dean of the college that offers the class to initiate a review of the evaluation.

3.     Disability Accommodation
Any student who feels s/he may need academic accommodations or access accommodations based on the impact of a documented disability should contact and register with Disability Services during the first week of class or as soon as possible after the diagnosis of a disability.  Disability Services is the official office to assist students through the process of disability verification and coordination of appropriate and reasonable accommodations.  Students currently registered with Disability Services must obtain a new accommodation memo each semester.  
Please note: if your home institution is not the University of South Dakota but one of the other South Dakota Board of Regents institutions (e.g., SDSU, SDSMT, BHSU, NSU, DSU), you should work with the disability services coordinator at your home institution.

Ernetta L. Fox, Director
Disability Services, Room 119 Service Center
(605)677-6389   Web Site: www.usd.edu/ds   E-mail: disabilityservices@usd.edu

Academic Integrity
The College of Arts and Sciences considers plagiarism, cheating, and other forms of academic dishonesty inimical to the objectives of higher education.  The College supports the imposition of penalties on students who engage in academic dishonesty, as defined in the “Conduct” section of the University of South Dakota Student Handbook.
No credit can be given for a dishonest assignment.  At the discretion of the instructor, a student caught engaging in any form of academic dishonesty may be:

a.   a.  Given a zero for that assignment.
b. Allowed to rewrite and resubmit the assignment for credit.
c. Assigned a reduced grade for the course.
d. Dropped from the course.
e. Failed in the course.

USD Home Page - Psychology Home Page - Prof Schieber's Home Page