Transcript
Page 1: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

Venu GovindarajuDept. of Computer Science &

EngineeringUniversity at Buffalo

[email protected]

Pattern Analysis and Machine Intelligence Applications

Page 2: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

Research Projects Document Image Analysis and Recognition

Interactive Recognition NSF: 2003-04 Digital Libraries NSF: 2002-04 Public Health Surveillance NSF: 2003-04

Unified Biometrics and SensorsBiometric Systems NYSTAR: 2003-0Fingerprint Recognition Ultra-Scan Inc: 2002-04Hand Geometry Infinite Group Inc : 2003-04Cancelable Biometrics CUBRC: 2003-04Patho-biometrics AFMIC: 2003-04

Page 3: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

Document Analysis and Recognition

Goal: Everything that can be done with symbolically encoded data can also be done with scanned hardcopy documents.  

Searching document images, presenting them legibly, navigating within and among them.

Page 4: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

Context Ranked Lexicon

PhD Student: Vemulapati Ramanaprasad

I Interactive Recognition Models

Page 5: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

I Interactive Recognition Models

Context Ranked Lexicon

Page 6: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

Grapheme Models

Page 7: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

Structural Features, BAG

JunctionLoops

LoopTurns

End

End

Page 8: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

Continuous Attributes

grapheme

pos orientation

angle

Down cusp

3.0 -90o

Up loop

Down arc

Page 9: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

II Multilingual Digital Libraries

South Asian Languages South Asian Languages Hindi (Devanagari script), Urdu (Arabic Script), Hindi (Devanagari script), Urdu (Arabic Script), TeluguTeluguCovers a billion people! Covers a billion people! Script discriminationScript discriminationMultilingual queryingMultilingual querying

PhD Students: Faisal Farooq, Surya Kompalli

Page 10: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

Digital Library application

Script Analysis

Document TruthGrayscale Images

Manual Truthing

OCR design

Semi-Automatic Annotation

MultilingualDigital

Archives

Multi-lingual Query Panel

english

Page 11: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

II Public Health Surveillance

Thousands are filed a day.Passed from EMS to Hospital.

PCR Purpose:– Medical care/diagnosis– Legal Documentation– Quality Assurance

–EMS AbbreviationsCOPD Chronic Obstructive Pulmonary DiseaseCHF Congestive Heart FailureD/S Dextrose in SalinePID Pelvic Inflammatory DiseaseGSW Gunshot WoundNKA No known allergiesKVO Keep vein openNaCL Sodium Chloride

PhD Student: Robert Milewski

Page 12: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

Medical Text Recognition and Data Mining

Check box recognition, Numeral recognition

Large lexicons, partial recognition, abbreviations

Chronic Obstructive Pulmonary Disease”: CRC-OBV-UOARY-DISAE

Contextual knowledge, constraints and lexicon reduction

Page 13: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

Unified Biometrics and Sensors

Biometrics are automated methods of identifying a person or verifying the identity of a person based on a physiological or behavioral characteristic.

Page 14: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

I UB STARS: Unobtrusive Biometric Sense Transmit Assess and Respond Systems

Packaged Device

Bright (Chem) Cartwright &

Sensors(Materials

Development)

Titus (EE)

Analog VLSI(Smart Systems)

Biometrics

(PatternRecognition &

Analysis)

Govindaraju

Cartwright (EE)

Light Sources(Materials

Development & Characterization)

Page 15: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

II. Fingerprint Analysis and Recognition

PhD Students: Tsai-yang Jea, Chaohong Wu

Page 16: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

Partial matching

?

Latent partial fingerprints 0102030405060708090

100

0 10 20 30 40 50 60 70 80 90 100

Size(%)

Rate

CorrectRate

ErrorRate

Threshold 0.35

0102030405060708090

100

0 10 20 30 40 50 60 70 80 90 100

Size(%)

Rat

e

CorrectRate

ErrorRate

RejectRate

Page 17: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

III Hand Geometry

Hand geometry biometrics

and fingerprints

Page 18: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

IV Cancelable Biometrics

Intentional, repeatable distortion of Intentional, repeatable distortion of biometric signal based on a chosen biometric signal based on a chosen transform transform One-way non-invertible mapping using One-way non-invertible mapping using another biometric data giving layered another biometric data giving layered securitysecurity Transform minutiae points on Transform minutiae points on fingerprints using signature featuresfingerprints using signature features

PhD Student: Sergey Tulyakov

Page 19: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

V Animal Biometrics

Visible Symptoms of FMD

–Straying from the herd

–Swaying gait, sometimes with high stepping of the feet

–Difficulties in walking or getting up

–Loss of weight, milk yield

Page 20: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

Texture Analysis

Original image Empty field Animals

Page 21: Venu Govindaraju Dept. of Computer Science & Engineering University at Buffalo govind@cse.buffalo.eduvind@cse.buffalo.edu Pattern Analysis and Machine

Other Projects

Signature Verification HanSheng Lei (PhD) Srinivas Palla (MS)

Devanagari OCR Swapnil Khedekar (MS)

Biometric Data Representation Viraj Chavan (MS)

Web Security and CAPTCHA Sumit Manocha (MS)

Video HWR Sijun Kung (PhD)


Top Related