bxgrid: a data repository and computing grid for biometrics research

27
BXGrid: A Data Repository and Computing Grid for Biometrics Research Hoang Bui University of Notre Dame 1

Upload: dolan

Post on 18-Feb-2016

49 views

Category:

Documents


4 download

DESCRIPTION

   BXGrid: A Data Repository and Computing Grid for Biometrics Research. Hoang Bui University of Notre Dame. Overview. Biometrics Research What is BXGrid? BXGrid & Condor Future Works Questions. Biometric Research. Facial recognition Iris recognition. Acquisition process. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

   BXGrid: A Data Repository and Computing Grid for Biometrics 

ResearchHoang Bui

University of Notre Dame

1

Page 2:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

Overview

• Biometrics Research• What is BXGrid?• BXGrid & Condor• Future Works• Questions

2

Page 3:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

Biometric Research

• Facial recognition

• Iris recognition

3

Page 4:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

Acquisition process• Computer Vision Research Laboratory

4

Page 5:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

5

Page 6:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

Biometric Research

• Now what?– I have collected 100,000 irises.– I have an algorithm to compare 2 irises

– I want evaluate my algorithm by comparing only brown irises

– First, I need to convert raw iris images to iris codes

– But I need to find all brown irises

6

Page 7:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

BXGridHow do I search for brown irises fast?

Where do I store iris images?

How do I evaluate my algorithm?

DBMS

Relational Database (2x)

Active Storage Cluster (16x)

CPU

Relational Database

CPU CPU CPU

CPU CPU CPU CPU

Condor Pool (500x)

7

Page 8:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

8

Page 9:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

9

Page 10:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

10

Page 11:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

11

Page 12:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

12

Page 13:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

Workflow Abstractions

B1

B2

B3

A1 A2 A3

F F F

F

F F

F F

F

L brown

L blue

R brown

R brown

S1

S2

S3

eye color

F

F

F

ROCCurve

S = Select( color=“brown” )

B = Transform( S,F )

M = AllPairs( A, B, F )

Bui, Thomas, Kelly, Lyon, Flynn, ThainBXGrid: A Repository and Experimental Abstraction… poster at IEEE eScience 200813

Page 14:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

Transform Abstraction• B = Transform( S,F )• Transform set S into set B using function F

• Single PC and 100,000 iris images– Core 2 Duo 1.8Ghz 1GB RAM PC– 6 seconds/transform 170 hours– Storage: 30GB• Let’s use Condor• You want to:– Do it faster– Manage resource properly

14

Page 15:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

• Fileservers

J1

Condor pool

J2 J3 J J J1 JN

User Local Machine

15

Page 16:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

• Fileservers

J1

Condor pool

J2 J3 J J J1 JN

User Local Machine

Wait()

J2 JN+1

16

Page 17:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

Result

17

Page 18:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

18

Page 19:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

Transform Summary

• Use up to 1GB local storage• Transform 10,000 irises– Single PC: 60,000 seconds– Condor: 1400 seconds

• Speedup: ~43 times

19

Page 20:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

AllPairs AbstractionAllPairs( set A, set B, function F )

returns matrix M whereM[i][j] = F( A[i], B[j] ) for all i,j

B1

B2

B3

A1 A2 A3

F F F

A1A1An

B1B1Bn

F

AllPairs(A,B,F)F

F F

F F

F20

Page 21:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

AllPairs Result

• 10,000 irises vs. 10,000 irises• Condor pool: 32 nodes• AllPairs took 150 minutes to complete 100,000,000 comparisons

• Speedup:  ~ 7 times

21

Page 22:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

ROC Cruve

22

Page 23:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

Workflow Summary

23

Transform AllPairsB1

B2

B3

A1 A2 A3

F F F

F

F F

F F

F

Condor Condor

Iris Iris Code

Result Matrix

Storage Cluster

Page 24:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

Future Works

• Run bigger Transform & All-Pairs experiments• Using Condor to perform Automated Validation

• Extend the repository for other types of data

24

Page 25:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

25

Page 26:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

Acknowledgments

• Cooperative Computing Lab– http://www.cse.nd.edu/~ccl

• BXGrid– http://bxgrid.cse.nd.edu

Grad StudentsGrad Students– Chris MorettiChris Moretti– Li YuLi Yu– Deborah ThomasDeborah Thomas– Karen HollingswortKaren Hollingswort– Tanya PetersTanya Peters

Faculty:Faculty:– Douglas ThainDouglas Thain– Patrick FlynnPatrick Flynn

Undergrads & StaffUndergrads & Staff– Mike KellyMike Kelly– Rory CarmichaelRory Carmichael– Mark PasquierMark Pasquier– Christopher LyonChristopher Lyon– Diane WrightDiane Wright

26

Page 27:    BXGrid: A Data Repository and Computing Grid for Biometrics Research

Question

27