الكتابة على شاشة الحاسبة باستخدام فعاليات العين == Writing on a Computer Screen via Eye Activities
Author name:
عمار سمير عناز
Supervisor name:
ضـياء مهـدي فارس | اياد يـونـس عبـد الله
General topic:
Computer Engineering
Specific topic:
Computer Engineering
Degree:
Master
University:
Northern Technical University - Engineering Technical College - Department Of Computer Technology Engineering
Language:
English
University location:
Mosul
Key words:
- OpenCV
- Human Computer Interaction (HCI)
Abstract:
Writing is considered as one of the most trusted communication methods among people. Writing has many forms and is fulfilled by many means according to different communities and civilization intervals. Hand is the most common tool for writing, but at certain disability conditions, this may not be possible. This thesis deals with the development and evaluation of a system with movements instead of using hands for disable persons. The eye is used to simulate the computer's mouse operation for controlling the available on-screen keyboard program. The mouse pointer is moved as the eye moves; it proposes an easy method for writing on the computer screen using eye looking angle and as the eye blinks for a specific time interval the letter is granted as the one wanted, simulating the mouse's left click. The process begins with filming the eye from near distance with infrared light to gain clear view of the pupil, then the images of video are sent to the main program. That is designed to process the images that include, reading the images then segmenting each image to extract the circular shape of the pupil, after that smoothing the resultant image and finally locating the central point of the pupil by applying (Circle Hough Transform) algorithm. The coordinates of the founded central point are converted from image coordinates to equivalent screen coordinates by mathematical calculations and using previous calibration points. Then the values of the final coordinates are sent to the mouse pointer, by this way the system controls the pointer position. However, left click process simulation was done, if the pupil shape disappeared (eye blink) for a period (from 10 ms to 100 ms as user adjustment), then the system sends mouse left click command to the pointer current position. The system succeeded to achieve its main purpose by printing on computer screen by the eye, in real time (less than one second). And the time to respond at maximum is 121 ms. In addition, testing the system by five male, their ages from 20 to 45 years, and results show different times to print according to person's ability to concentrate and learn, but in general the system average speed is one word per minutes. While the mean squared error of the system is 14%.
Full text:
0c132fd6e7.pdf