Upload File

tablet-based gaze tracker p13541 2012-2/ 2012-3 tina podrasky (ise)michael krenzer (ee)hemsley...

  • Home
  • Documents
  • Tablet-Based Gaze Tracker P13541 2012-2/ 2012-3 Tina Podrasky (ISE)Michael Krenzer (EE)Hemsley Pichardo (EE) Brad Wideman (CE)Matt Kelly (CE) Susan Farnand
1
Tablet-Based Gaze Tracker P13541 2012-2/ 2012-3 Tina Podrasky (ISE) Michael Krenzer (EE) Hemsley Pichardo (EE) Brad Wideman (CE) Matt Kelly (CE) Susan Farnand (Sponsor) Les Moore (Faculty Guide) MISSION STATEMENT: TO DESIGN AND MANUFACTURE A TABLET-BASED GAZE TRACKER THAT USES A MODIFIED WEB CAMERA TO DETERMINE WHERE THE USER IS LOOKING IN RESPECT TO A SECONDARY VIDEO BEING RECORDED BY THE TABLET’S BUILT-IN REAR CAMERA. MOTIVATION: oTEACHING TOOL FOR NOVICE PHOTOGRAPHERS oALLOWS FOR THE GREATEST LEVEL OF PORTABLITY CURRENTLY AVAILABLE BACKGROUND: CURRENTLY EXISTING GAZE TRACKERS oREMOTE GAZE TRACKER- ATTACHES TO A DESKTOP COMPUTER –NOT PORTABLE oEYEGLASSES WITH INTEGRATED CAMERAS- REQUIRES THE USER TO WEAR A LAPTOP BACKPACK- SEMI PORTABLE ADDITIONAL INFORMATION: FOR ADDITIONAL INFORMATION VISIT OUR TEAM WEBSITE AT http://edge.rit.edu/edge/P13541/public/Home INFRARED LED CIRCUIT: USED TO CREATE THE GLINTS REQUIRED FOR GAZE TRACKING o6 IR LEDS IN TWO CLUSTERS o2 RESISTORS 150Ω AND 22Ω oTWO PCB BOARDS ON EITHER END OF THE TABLET oOSRAM SFH-4550 LEDS oLEDs SANDED TO DIFFUSE INFRARED LIGHT RESULTS/ CONCLUSIONS: oMANY CUSTOMER NEEDS WERE MET, BUT GAZE TRACKING SHOULD BE MORE ROBUST oGAZE TRACKING IS DIFFICULT TO ACCURATELY IMPLEMENT, BUT EXTREMELY USEFUL oHUGE IMPLICATIONS FOR RESEARCH AND ACCESSIBIILITY PURPOSES oA POWERFUL AND PORTABLE OPEN-SOURCE GAZE TRACKING LIBRARY IS HIGHLY DESIRABLE o BO HU o JAN MANETI o JEFFERY PELZ o FLURIN RINDISBACHER o ANDREW SHUMAN MOUNT AND CASE DESIGN: oABS PLASTIC CASE – USED TO MOUNT CAMERA AND IR LEDS oCLEAR PLASTIC COVERS – ALLOWS IR LIGHT TO REFLECT OFF THE USERS EYE WHILE PROTECTING THE CAMERA’S LENS oMOUNT MADE OUT OF GOPRO CAMERA PARTS oCONNECTOR MADE OF ALUMINUM ALLOY – SIMILAR DESIGN TO EXISTING GOPRO CONNECTOR TEST RESULTS FOR USABILITY: o15 SUBJECTS RUN FOUR RANDOMIZED CALIBRATION ROUTINE oTHE SUBJECT FOLLOW A SINGLE DOT TO FIVE DIFFERENT LOCATIONS ON THE SCREEN oTWO DIFFERENT CALIBRATION VARIABLES - FAST OR SLOW AND WITH OR WITHOUT DIRECTION oFAST WITH DIRECTION WAS DETERMINED TO BE THE MOST ACCURATE ROUTINE DESIGN PROCESS: oSAFE AND PORTABLE DEVICE THAT OPERATES IN REAL-TIME oUTILIZES TWO CAMERAS: ONE TO CAPTURE THE USER’S EYE ANOTHER TO CAPTURE THE USERS SUBJECT MATTER oPROVIDES VISUAL FEEDBACK THAT OVERLAIYS THE USER’S GAZE POINTS WITH THE IMAGE ON THE TABLET’S DISPLAY DESIGN SPECIFICATIONS: oALL COMPONENTS MUST RUN OFF THE TABLET’S INTERNAL BATTERY AND LAST FOR 30 MINUTES BEFORE RECHARGING oTABLET MUST HAVE A REAR-FACING CAMERA AND RUN ANDROID oTABLET MUST HAVE A USB PORT FOR INTERFACING WITH THE CAMERA oTHE DEVICE MUST OPERATE SUCCESSFULLY INDOORS AND OUTDOOES oTHE SOFTWARE ON THE TABLET MUST NOT HAVE RESTRICTIONS ON MODIFICATION THAT CANNOT BE BYPASSED TESTING CAMERA FOCUS DISASSEMBLED CAMERA WITH REPLACEMENT FILTER MODIFICATION OF WEBCAM: oORIGINAL CAMERA IS THE LOGITECH C510 oCAMERA’S IR FILTER WAS REMOVED oREPLACEMENT FILTER MADE FROM FILM NEGATIVES WAS PLACED ABOVE THE IMAGE SENSOR CAMERA FOCUSING: oCAMERA WAS FOCUSED USING THE ISO12233 CHART o ADRIANA BECKER-GOMEZ o FRANK COST o KEVIN ENCARNACION o CHRIS FEUZ o DAVID HATHAWAY ACKNOWLEDGEMENTS: SPECIAL THANKS TO: MAIN EFFECT AND RESIDUAL PLOTS FOR SPEED AND DIRECTION SUBJECT USING THE CALIBRATION ROUTINE IMAGES USED FOR DEBUGGING: oPUPIL IS FOUND BY ALGORITHM AND CIRCLED oPUPIL CENTER IS CROSSED oCORNEAL REFLECTION CANDIDATES ARE FOUND AND CROSSED oCOMBINATION OF PUPIL CENTER AND CONREAL REFLECTIONS USED TO DETERMINE GAZE POINT DEBUGGING IMAGES TAKEN WITH GAZE TRACKER

Upload: bertha-watts

Post on 30-Dec-2015

214 views

Category:

Documents


0 download

Report

Tags:

TRANSCRIPT

Page 1: Tablet-Based Gaze Tracker P13541 2012-2/ 2012-3 Tina Podrasky (ISE)Michael Krenzer (EE)Hemsley Pichardo (EE) Brad Wideman (CE)Matt Kelly (CE) Susan Farnand

Tablet-Based Gaze TrackerP13541 2012-2/ 2012-3

Tina Podrasky (ISE)Michael Krenzer (EE) Hemsley Pichardo (EE)

Brad Wideman (CE)Matt Kelly (CE)

Susan Farnand (Sponsor) Les Moore (Faculty Guide)

MISSION STATEMENT: TO DESIGN AND MANUFACTURE A TABLET-BASED GAZE TRACKER THAT USES A MODIFIED WEB CAMERA TO DETERMINE WHERE THE USER IS LOOKING IN RESPECT TO A SECONDARY VIDEO BEING RECORDED BY THE TABLET’S BUILT-IN REAR CAMERA.

MOTIVATION:oTEACHING TOOL FOR NOVICE PHOTOGRAPHERS oALLOWS FOR THE GREATEST LEVEL OF PORTABLITY CURRENTLY AVAILABLE

BACKGROUND:CURRENTLY EXISTING GAZE TRACKERSoREMOTE GAZE TRACKER- ATTACHES TO A DESKTOP COMPUTER –NOT PORTABLEoEYEGLASSES WITH INTEGRATED CAMERAS- REQUIRES THE USER TO WEAR A LAPTOP BACKPACK- SEMI PORTABLE

ADDITIONAL INFORMATION: FOR ADDITIONAL INFORMATION VISIT OUR TEAM WEBSITE AT http://edge.rit.edu/edge/P13541/public/Home

INFRARED LED CIRCUIT:USED TO CREATE THE GLINTS REQUIRED FOR GAZE TRACKING o6 IR LEDS IN TWO CLUSTERSo2 RESISTORS 150Ω AND 22Ω oTWO PCB BOARDS ON EITHER END OF THE TABLEToOSRAM SFH-4550 LEDSoLEDs SANDED TO DIFFUSE INFRARED LIGHT

RESULTS/ CONCLUSIONS:oMANY CUSTOMER NEEDS WERE MET, BUT GAZE TRACKING SHOULD BE MORE ROBUSToGAZE TRACKING IS DIFFICULT TO ACCURATELY IMPLEMENT, BUT EXTREMELY USEFULoHUGE IMPLICATIONS FOR RESEARCH AND ACCESSIBIILITY PURPOSESoA POWERFUL AND PORTABLE OPEN-SOURCE GAZE TRACKING LIBRARY IS HIGHLY DESIRABLE

o BO HUo JAN MANETIo JEFFERY PELZo FLURIN RINDISBACHERo ANDREW SHUMAN

MOUNT AND CASE DESIGN:oABS PLASTIC CASE – USED TO MOUNT CAMERA AND IR LEDS oCLEAR PLASTIC COVERS – ALLOWS IR LIGHT TO REFLECT OFF THE USERS EYE WHILE PROTECTING THE CAMERA’S LENSoMOUNT MADE OUT OF GOPRO CAMERA PARTS oCONNECTOR MADE OF ALUMINUM ALLOY – SIMILAR DESIGN TO EXISTING GOPRO CONNECTOR

TEST RESULTS FOR USABILITY:o15 SUBJECTS RUN FOUR RANDOMIZED CALIBRATION ROUTINE oTHE SUBJECT FOLLOW A SINGLE DOT TO FIVE DIFFERENT LOCATIONS ON THE SCREENoTWO DIFFERENT CALIBRATION VARIABLES - FAST OR SLOW AND WITH OR WITHOUT DIRECTION oFAST WITH DIRECTION WAS DETERMINED TO BE THE MOST ACCURATE ROUTINE

DESIGN PROCESS:oSAFE AND PORTABLE DEVICE THAT OPERATES IN REAL-TIMEoUTILIZES TWO CAMERAS: ONE TO CAPTURE THE USER’S EYE ANOTHER TO CAPTURE THE USERS SUBJECT MATTERoPROVIDES VISUAL FEEDBACK THAT OVERLAIYS THE USER’S GAZE POINTS WITH THE IMAGE ON THE TABLET’S DISPLAY

DESIGN SPECIFICATIONS:oALL COMPONENTS MUST RUN OFF THE TABLET’S INTERNAL BATTERY AND LAST FOR 30 MINUTES BEFORE RECHARGINGoTABLET MUST HAVE A REAR-FACING CAMERA AND RUN ANDROIDoTABLET MUST HAVE A USB PORT FOR INTERFACING WITH THE CAMERAoTHE DEVICE MUST OPERATE SUCCESSFULLY INDOORS AND OUTDOOESoTHE SOFTWARE ON THE TABLET MUST NOT HAVE RESTRICTIONS ON MODIFICATION THAT CANNOT BE BYPASSED

TESTING CAMERA FOCUS

DISASSEMBLED CAMERA WITH REPLACEMENT FILTER

MODIFICATION OF WEBCAM:oORIGINAL CAMERA IS THE LOGITECH C510oCAMERA’S IR FILTER WAS REMOVED oREPLACEMENT FILTER MADE FROM FILM NEGATIVES WAS PLACED ABOVE THE IMAGE SENSOR

CAMERA FOCUSING:oCAMERA WAS FOCUSED USING THE ISO12233 CHART

o ADRIANA BECKER-GOMEZo FRANK COST o KEVIN ENCARNACIONo CHRIS FEUZo DAVID HATHAWAY

ACKNOWLEDGEMENTS:SPECIAL THANKS TO:

MAIN EFFECT AND RESIDUAL PLOTS FOR SPEED AND DIRECTION

SUBJECT USING THE CALIBRATION ROUTINE

IMAGES USED FOR DEBUGGING: oPUPIL IS FOUND BY ALGORITHM AND CIRCLEDoPUPIL CENTER IS CROSSEDoCORNEAL REFLECTION CANDIDATES ARE FOUND AND CROSSEDoCOMBINATION OF PUPIL CENTER AND CONREAL REFLECTIONS USED TO DETERMINE GAZE POINT

DEBUGGING IMAGES TAKEN WITH GAZE TRACKER

By: Matt Kelly (CE), Michael Krenzer (EE), Hemsley Pichardo (EE), Tina Podrasky (ISE), Brad Wideman(CE)

dcontrol.dld.go.thdcontrol.dld.go.th/dcontrol/images/IDP60/proj.pdf · ee CPI D c) 2) ee 3 ee B ee ee 22 L ee 0—) e) 2) ee e) a-Îl c) (2 d e) ee 2 ee ee d c.nn e) d e) d de ee

( 12 ) United States Patent - static.tongtianta.sitestatic.tongtianta.site/paper_pdf/212541bc-c7ea-11e9-bffa-00163e08bb86.pdfUS010192135B2 ( 12 ) United States Patent Krenzer et al

 · e) o O o e) c.) ee d e) de 2) ee 22 ee de ee ee c o o c.) e) e) 2) ee d . ee ee c2ee c) o e) o e) e) ee ee 2) ee c) XO o a xo 22 2) ee d o ee 22 ee

กองกลาง สป.มท. · 2018. 8. 2. · 9 e) a-ne c.) 22 ee c2 d ee 2- c.QD ee c) 2) de e) d 2) ee 2) ee ee d ee cnD 2) ee ee ee ee (2 e) ee a-ne ee c.) ee ee . ee

Nov. 2 - 5, 2018 Boston Convention and Exhibition Center ...iebms.heiexpo.com/nar/NAR18floorplan.pdf · plasma plasma plasma ee ee eeee ee ee ee ee ee ee ee max height for structures

Architectural Graphics II - جامعة نزوى · Architectural Graphics II Dr. Mohammed Faisal Al-Kazee Examples & Symbols . l-ee. l-ee. l-ee. l-ee. l-ee. l-ee. l-ee. l-ee. l-ee

 · 0—) ee ee 2) de d d 2) ee ee ee 2) de 22 d ee ee ee d de e2e ee de ee . 2) ee CTID e) 22 cnD ee cQD e) 2) ee d d 22 D 22 22 o d 2) ee 22 D d ee

Monique Krenzer ken in CAO’s blijft · Monique Krenzer Het Deetis e model: zorg als zaak van de overheid Ondanks wettelijke regelingen of afspra ken in CAO’s blijft zorg in Nederland

UAB „Elonika“ · 2014. 11. 18. · EE a3KD EE EE goo EE goo a EE arm) EE arb EE no EE a EE 800 al) EE arvub EE rtOO artl< EE EE 800 arb EE QOO arb EE a2KD EE ar thbG (IIJO(IGI)

 · CQe ee ee 9 o 9 o cne ee S 9 See z. ee 22 ee o cru SL ee ee 9 ee e) ee cne ee o . Created Date: 1/20/2020 1:29:45 PM

 · e cnq ee 2) ee c) d d c) d 2 2 ee OJI e ee 9 2) c.) ee ee 2 ee o ee ee 9 . o ee ee 2) ee d 2) 9 O O d ee .2 CAD 2) ee 9 e) O X x 9 9 9 d ee ee e) ee

pn . ae . ee ee pn . peranen a . ee pn . ready aaabe . ee

ee o b ee o o (2 9 c.) ee de ee OJI c.) d ee 2- e) 2) ee e ... · ee o b ee o o (2 9 c.) ee de ee OJI c.) d ee 2- e) 2) ee e) 2 2) e) 2) O . ee ee ee ee OJI e 2) c2 o 9 Q) e) 9 o

¸ลุ่มA.pdf · 0...Qe a-ne ee e) ee ee ee 2.) e) ee 5 ee d OJI e 2) ee d 2 o ee (2) ee . ee e) e) d ee o o o e) ee a-ne d e) 2) ee c.) ee ee 22 a-ne 9_ d ee (2 ee

 · cn 2) C) e) ee 9 o e) ee SD ee ee ee d cnD 2) C) d d 2) ee ee e) ee -.0 . ee e) e) ee cri 2) ee ee d 2 ee 22 ee ee d 22 d (2) (2) d Z. 9 o O O o 9

 · Compendio de métodos antropológico forenses para la reconstrucción del perfil osteo-biológico Udo Krenzer Tomo IV Determinación de la edad osteológica

€¦ · 2) c2D O ee ee c2 c2D ee (2 ee (2 ee O d ee 2) d 2) 2) ee aooaaaaaaaaoaoaaaaoa . O O c.) an ee ee d 2) e ee o ee ee n) ee 2) ee (2) ee ee ee d

 · c.) 22 cn cnq 2) ee cnD 2) 2 cnD can ee ee ee e) o cn cn ee ee d 2) ee a.nD 2 Za ee e) e) cn . c.) c.ne ee d d (2 Zo cn ee d Be 2 e) ee c2 ee ee

GENEREL ZELENE MESTA BANSKÁ BYSTRICA · 2019-09-04 · e ee eee e ee eee eeee ee e ee ee eee eee eee ee e e ee e e eee eee eee e e eee e ee ee ee e e ee

 · ee ee (2) 9 e) e) cnD 2) c.) C2 ee a ee e) Z. ee 2) (2) ee ee e) t) o o . ee g o 9 ee ee e) a-ne d ee C) CJD e) e) c) 90 z. 9 o 9 ee ee ee cnDA ee

(2).pdf · 2018-07-28 · 2) 2) c) 22 2) ee ee e) ee ee --)0 ee 9 22 c.) ee c) d e) e) c2 ee 2) ee e) c) c) e) e) ee 22 c) c: ee 1 9 ee ee e) 22 ee (2 ee SD ee n.) e) c) o ee ee ee

Eesti telekanalid · TV + Sport TV + Filmid TV Sport Filmid TV + Filmid + Sport TV3 HD EE TV6 HD EE 3+ EE ETV EE ETV+ EE ETV2 EE Kanal 2 EE Kanal 12 EE Kanal 11 EE Eesti Kanal EE

กองกลาง สป.มท. King 10.pdf · ee ee 2- 2) YD _ 22 d 2) c) c,QDq ee c2 ee ee 2: 2) ee e) e) ee d ee a-Jl . c.'1D cm CAD cm ee d 9 ee ee ee (2 c.nn O ee O ee O

มหาวิทยาลัยนเรศวร : Naresuan University · 2017. 1. 17. · 22 2) ee 0—-9 ee 22 OJI ee 2) ee d ee e) d ee 22 e) 2 o c) ee o 9 9 9 ee 22 d ee ee

Prince of Songkla University › resumeAdminFiles › resume... · 2- a [2 ee ten ee o O ee ee ee ee £2 cn 12 o O a o ee co 12 2 —3 ee 2 . 2) c: ee 2- ee 3 12 (2 2) ee

W A S A T C H - USDA...EE EE E E EE EE EE EE E EE EE EE E EE EE EE EE EE EE EE EE EE EE E E EE EE EE EE EE EE EE EE EE EE EEE EEE EE EE EE EE EE EE EE EE EE EE EE EE EE EEE EEE EE

Bridget Nyland, Sarah Farnand, Scott Smith, Kristin Holtz

 · 2018. 5. 3. · ee ee ee C) c) -o c) 22 L ee ee e) e) 22 ee ee ee C) e) ee O m e) 2) c) c.) c.) e) d e) ee e) 2) ee de a-ne d e) 2) ee . e.) d o ee c.) 9 a-ne n) e) 2) ee cn o

Walz & Krenzer - Flood Barriers · Introduction to Walz & Krenzer Walz & Krenzer (WK) has designed and manufactured custom watertight, airtight, and blast closures since 1939. A US

EE xx ee rr GG ee nn ii ee EE xx ee rr cc ii ss ee DD

EE-SX95 EE-SX77/87 EE-SX47/67 EE-SPX74/84 EE-SPX-W2A EE

Lebenslauf - Boris Krenzer - Beratung...Lebenslauf Dr. Boris Krenzer Vogelbeerweg 21 40880 Ratingen H 0151 - 40305398 T 02102 - 1499094 B [email protected] m Beruflicher

Ultrasonic Cool Mist Humidifier - Crane USA · Ultrasonic Cool Mist Humidifier FOR MODELS: EE-865, EE-3186, EE-3189, EE-3190, EE-3191, EE-4139, EE-4140, EE-5058, EE-6369, ... in the

Basic Color Theory Susan Farnand [email protected]