roccojiang / eye-tracker

A Python program that tracks the direction of your gaze

I'm a final-year student at Imperial College London studying Computing with an integrated Masters.

My research interests lie primarily in programming languages. Currently, I'm most interested in static program analysis and functional programming.

eye-tracker's Issues

Improve gaze ratio algorithm

Based on some (unscientific) tests:
Left average: 1.7 ± 0.25 (max ever seen ~2.2!)
Right average: 0.4 ± 0.15 (much less variation than left)

These values may not really work once they are used for car control... The algorithm may need to be changed. Maybe switch over to actual pupil tracking as in https://github.com/antoinelame/GazeTracking.

Improve face and eye detection

Face and eye detection should be improved first before moving on optimising pupil detection. Ideas for improvement include:

• Further adjust scaleFactor and minNeighbors values
• Use dlib library face landmark points to estimate eye region
• Look into histogram equalisation as a potential solution
• Look into hough circles
• Potentially adjust gaussian blur? (probably not needed)

Improve blink detection

Implement 'eye aspect ratio' detection method (Soukupová and Čech, 2016) to improve blink detection.

Adjust EAR threshold values

Need to experiment more to adjust EAR threshold values for gaze detection.

Improve debug window

Current debug window only shows one pupil. Code should be rewritten to identify left and right eyes so both can be shown.