intech-spam recognition using linear regression and radial basis function neural network

8/4/2019 InTech-Spam Recognition Using Linear Regression and Radial Basis Function Neural Network

1/20

5RCO4GEQIPKVKQPWUKPI.KPGCT4GITGUUKQPCPF4CFKCN$CUKU(WPEVKQP0GWTCN0GVYQTM

:


7LFK3KXRF7UDQ0LQ/L'DW7UDQDQG'DP'XRQJ7RQ

&HQWUHIRU4XDQWXP&RPSXWDWLRQDQG,QWHOOLJHQW6\VWHPV4&,68QLYHUVLW\RI7HFKQRORJ\6\GQH\16:$XVWUDOLD

^WLSWUDQPLQOL`#LWXWHGXDX

)DFXOW\RI,QIRUPDWLRQ6FLHQFHVDQG(QJLQHHULQJ8QLYHUVLW\RI&DQEHUUD$&7$XVWUDOLD

GDWWUDQ#FDQEHUUDHGXDX

)DFXOW\RI&RPSXWHU6FLHQFH8QLYHUVLW\RI,QIRUPDWLRQ7HFKQRORJ\918+&0&9LHWQDP

GDPGW#XLWHGXYQ

.H\ZRUGV6SDP5HFRJQLWLRQ5HGLDO%DVLV)XQFWLRQ/LQHDU5HJUHVVLRQ

#DUVTCEV6SDPPLQJLVWKHDEXVHRIHOHFWURQLFPHVVDJLQJV\VWHPVWRVHQGXQVROLFLWHGEXONPHVVDJHV,WLVEHFRPLQJDVHULRXVSUREOHPIRURUJDQL]DWLRQVDQGLQGLYLGXDOHPDLOXVHUVGXHWRWKHJURZLQJ SRSXODULW\ DQG ORZ FRVW RI HOHFWURQLF PDLOV 8QOLNH RWKHU ZHE WKUHDWV VXFK DVKDFNLQJ DQG ,QWHUQHW ZRUPV ZKLFK GLUHFWO\ GDPDJH RXU LQIRUPDWLRQ DVVHWV VSDP FRXOGKDUP WKH FRPSXWHU QHWZRUNV LQ DQ LQGLUHFW ZD\ UDQJLQJ IURP QHWZRUN SUREOHPV OLNHLQFUHDVHGVHUYHUORDGGHFUHDVHGQHWZRUNSHUIRUPDQFHDQGYLUXVHVWRSHUVRQQHOLVVXHVOLNHORVW HPSOR\HH WLPH SKLVKLQJ VFDPV DQG RIIHQVLYH FRQWHQW 7KRXJK D ODUJH DPRXQW RIUHVHDUFK KDV EHHQ FRQGXFWHG LQ WKLV DUHD WR SUHYHQW VSDPPLQJ IURP XQGHUPLQLQJ WKHXVDELOLW\ RI HPDLO FXUUHQWO\ H[LVWLQJ ILOWHULQJ PHWKRGV SHUIRUPDQFH VWLOO VXIIHUV IURP

H[WHQVLYH FRPSXWDWLRQ ZLWK ODUJH YROXPH RI HPDLOV UHFHLYHG DQG XQUHOLDEOH SUHGLFWLYHFDSDELOLW\ GXH WR KLJKO\ G\QDPLF QDWXUH RI HPDLOV ,Q WKLV FKDSWHU ZH GLVFXVV WKHFKDOOHQJLQJ SUREOHPV RI 6SDP 5HFRJQLWLRQ DQG WKHQ SURSRVH DQ DQWLVSDP ILOWHULQJIUDPHZRUNLQZKLFKDSSURSULDWHGLPHQVLRQUHGXFWLRQVFKHPHVDQGSRZHUIXOFODVVLILFDWLRQPRGHOV DUH HPSOR\HG ,Q SDUWLFXODU 3ULQFLSDO &RPSRQHQW $QDO\VLV WUDQVIRUPV GDWD WR DORZHUGLPHQVLRQDOVSDFHZKLFKLVVXEVHTXHQWO\XVHGWRWUDLQDQ$UWLILFLDO1HXUDO1HWZRUNEDVHG FODVVLILHU $FRVWVHQVLWLYH HPSLULFDODQDO\VLVZLWKD SXEOLFO\DYDLODEOHHPDLOFRUSXVQDPHO\/LQJ6SDPVXJJHVWVWKDWRXUVSDPUHFRJQLWLRQIUDPHZRUNRXWSHUIRUPVRWKHUVWDWHRIWKHDUWOHDUQLQJPHWKRGVLQWHUPVRI VSDPGHWHFWLRQFDSDELOLW\,QWKHFDVHRIH[WUHPHO\


2/20

2CVVGTP4GEQIPKVKQP

KLJKPLVFODVVLILFDWLRQFRVW ZKLOH RWKHU PHWKRGVSHUIRUPDQFHGHWHULRUDWHV VLJQLILFDQWO\ DVWKHFRVWIDFWRULQFUHDVHVRXUPRGHOVWLOOUHPDLQVVWDEOHDFFXUDF\ZLWKORZFRPSXWDWLRQFRVW

+PVTQFWEVKQP

(PDLOLVZLGHO\DFFHSWHGE\WKHEXVLQHVVFRPPXQLW\DVDORZFRVWFRPPXQLFDWLRQWRROWRH[FKDQJH LQIRUPDWLRQ EHWZHHQ EXVLQHVV HQWLWLHV ZKLFK DUH SK\VLFDOO\ GLVWDQW IURP RQHDQRWKHU,WPLQLPL]HVWKHFRVWRIRUJDQL]LQJDQLQSHUVRQPHHWLQJ,WLVUHSRUWHGE\DUHFHQWVXUYH\6XUH3D\UROO6XUHSD\UROORYHURIVPDOOEXVLQHVVRZQHUVEHOLHYHHPDLOLVDNH\WRWKHVXFFHVVRIWKHLUEXVLQHVVDQGPRVWSHRSOHWRGD\VSHQGEHWZHHQWRRIWKHLUZRUNLQJWLPHXVLQJHPDLOLQFOXGLQJUHDGLQJVRUWLQJDQGZULWLQJHPDLOV'XHWRWKHYHU\ORZFRVWRIVHQGLQJHPDLORQHFRXOGVHQGWKRXVDQGVRIPDOLFLRXVHPDLOPHVVDJHVHDFKGD\ RYHU DQ LQH[SHQVLYH ,QWHUQHWFRQQHFWLRQ 7KHVH MXQN HPDLOV UHIHUUHG WRDV VSDP FDQVHYHUHO\ UHGXFH VWDII SURGXFWLYLW\ FRQVXPH VLJQLILFDQW QHWZRUN EDQGZLGWK DQG OHDG WR

VHUYLFHRXWDJHV,QPDQ\FDVHVVXFKPHVVDJHVDOVRFDXVHH[SRVXUHWRYLUXVHVVS\ZDUHDQGLQDSSURSULDWHFRQWHQWVWKDWFDQFUHDWHOHJDOFRPSOLDQFHLVVXHVORVVRISHUVRQDOLQIRUPDWLRQDQGFRUSRUDWHDVVHWV7KHUHIRUHLWLVLPSRUWDQWWRDFFXUDWHO\HVWLPDWHFRVWVDVVRFLDWHGZLWKVSDP DQG HYDOXDWH WKH HIIHFWLYHQHVV RI FRXQWHUPHDVXUHV VXFK DV VSDPILOWHULQJ WRROV7KRXJKVXFKVSDPSUHYHQWLRQFDSDELOLW\LVLPSOHPHQWHGLQH[LVWLQJHPDLOFOLHQWVWKHUHDUHVRPH EDUULHUV WKDW GLVFRXUDJH XVHUV IURP XWLOL]LQJ WKLVIHDWXUH LQFOXGLQJ HUURUSURQH DQGODERULQWHQVLYH PDLQWHQDQFHRI ILOWHULQJUXOHV 0DQ\ UHVHDUFKHUV KDYHGHYHORSHGGLIIHUHQWDXWRPDWLFVSDPGHWHFWLRQV\VWHPVEXWPRVWRIWKHPVXIIHUIURPORZDFFXUDF\DQGKLJKIDOVHDODUP UDWH GXH WR KXJH YROXPH RI HPDLOV WKH ZLGH VSHFWUXP RI VSDPPLQJ WRSLFV DQGUDSLGO\FKDQJLQJFRQWHQWVRIWKHVHPHVVDJHVHVSHFLDOO\LQWKHFDVHRIKLJKPLVFODVVLILFDWLRQFRVW %D\OHU 7R GHDO ZLWK VXFK FKDOOHQJHV WKLV FKDSWHU SURSRVHV DQ DQWLVSDP

ILOWHULQJ IUDPHZRUN XVLQJ D KLJKO\ SHUIRUPLQJ $UWLILFLDO 1HXUDO 1HWZRUN $11 EDVHGFODVVLILHU $11 LV ZLGHO\ FRQVLGHUHG DV D IOH[LEOH PRGHOIUHH RU GDWDGULYHQ OHDUQLQJPHWKRG WKDW FDQ ILW WUDLQLQJ GDWD YHU\ ZHOO DQG WKXV UHGXFH OHDUQLQJ ELDV KRZ ZHOO WKHPRGHOILWVWKHDYDLODEOHVDPSOHGDWD+RZHYHUWKH\DUHDOVRVXVFHSWLEOHWRWKHRYHUILWWLQJSUREOHP ZKLFK FDQ LQFUHDVH JHQHUDOL]DWLRQ YDULDQFH LH PDNLQJ WKH SUHGLFWLYH PRGHOXQVWDEOHIRUXQVHHQLQVWDQFHV7KLVOLPLWDWLRQFDQEH RYHUFRPH E\FRPELQLQJ$11ZLWKDVLPSOH/LQHDU5HJUHVVLRQDOJRULWKPZKLFKPDNHVWKHUHVXOWLQJFODVVLILFDWLRQPRGHODVWDEOHVHPLSDUDPHWULF FODVVLILHU6XFK PRGHO FRPELQDWLRQDLPVDWVWDELOL]LQJQRQOLQHDUOHDUQLQJWHFKQLTXHV ZKLOH UHWDLQLQJ WKHLU GDWD ILWWLQJ FDSDELOLW\ (PSLULFDO DQDO\VLV ZLWK WKH /LQJ6SDPEHQFKPDUNFRQILUPVRXUVXSHULRUVSDPGHWHFWLRQDFFXUDF\DQGORZFRPSXWDWLRQFRVWLQFRPSDULVRQZLWKRWKHUH[LVWLQJDSSURDFKHV

7KLVFKDSWHULVRUJDQL]HGDV IROORZ)LUVWO\DQRYHUYLHZRIWKHVSDPSUREOHPLV SUHVHQWHGZLWK DVVRFLDWHG QHJDWLYH LPSDFWV DQG SURWHFWLRQ WHFKQLTXHV 7KLV LV IROORZHG E\ WKHDSSOLFDWLRQRI0DFKLQH/HDUQLQJ0/WRVSDPUHFRJQLWLRQUHODWHGZRUNVDQGGHWDLOVRIWKH/LQJ6SDPFRUSXV1H[WDEULHIUHYLHZRIVHYHUDOFRPPRQO\XVHGFODVVLILFDWLRQPRGHOVDQGRXUSURSRVHGIUDPHZRUNLVJLYHQ7KHVXEVHTXHQWVHFWLRQFRPSDUHVWKHSHUIRUPDQFHRIRXUPHWKRG ZLWK RWKHU OHDUQLQJ WHFKQLTXHV XVLQJ WKH EHQFKPDUN FRUSXV XQGHU GLIIHUHQW FRVWVFHQDULRV)LQDOO\ZHSURYLGHVRPHFRQFOXVLRQUHPDUNVIRUWKLVFKDSWHUDQGIXWXUHUHVHDUFKGLUHFWLRQV


3/20


4/20

2CVVGTP4GEQIPKVKQP

7KRXJK VSDP HPDLOV DUH WURXEOHVRPH PRVW RI WKHP FDQ EH HDVLO\ UHFRJQL]HG E\ KXPDQXVHUVGXHWRWKHLUREYLRXVVLJQDWXUHV)RUH[DPSOHVSDPHPDLOVQRUPDOO\UHODWHWRVSHFLILFWRSLFVVXFKDVSUHVFULSWLRQGUXJVJHWULFKTXLFNVFKHPHVILQDQFLDOVHUYLFHVTXDOLILFDWLRQV

RQOLQH JDPEOLQJ GLVFRXQWHG RU SLUDWHG VRIWZDUH +RZHYHUZLWK D KXJHYROXPH RI VSDPPHVVDJHVUHFHLYHGHYHU\GD\LWZRXOGQRWEHSUDFWLFDOIRUKXPDQXVHUVWRGHWHFWVSDPE\UHDGLQJ DOO RI WKHP PDQXDOO\ )XUWKHUPRUH VSDP VRPHWLPHV FRPHV GLVJXLVHG ZLWK DVXEMHFWOLQHWKDWUHDGVOLNHDSHUVRQDOPHVVDJHRUDQRQGHOLYHU\PHVVDJH7KLVPDNHVKLJKO\DFFXUDWHVSDPGHWHFWLRQVRIWZDUHGHVLUDEOHIRUHQFRXQWHULQJVSDP

+ORCEVUQH5RCOOKPICPF2TGXGPVKXG6GEJPKSWGU

(YHQWKRXJKVSDPGRHVQRWWKUHDWHQRXUGDWDLQWKHVDPHZD\WKDWYLUXVHVGRLWGRHVFDXVHEXVLQHVVHVELOOLRQVRIORVWGROODUVZRUOGZLGH6HYHUDOQHJDWLYHLPSDFWVRIVSDPDUHOLVWHGDVIROORZ6FKU\HQ

x 6SDPLVUHJDUGHGDVSULYDF\LQYDVLRQEHFDXVHVSDPPHUVLOOHJDOO\FROOHFWYLFWLPVHPDLODGGUHVVFRQVLGHUHGDVSHUVRQDOLQIRUPDWLRQ

x 8QVROLFLWHGHPDLOVLUULWDWH,QWHUQHWXVHUVx 1RQVSDPHPDLOVDUHPLVVHGDQGRUGHOD\HG6RPHWLPHVXVHUVPD\HDVLO\RYHUORRNRU

GHOHWHFULWLFDOHPDLOVFRQIXVLQJWKHPZLWKVSDPx 6SDPZDVWHVVWDIIWLPHDQGWKHUHE\VLJQLILFDQWO\UHGXFHHQWHUSULVHVSURGXFWLYLW\x 6SDPXVHVDFRQVLGHUDEO\ODUJHEDQGZLGWKDQGXVHVXSGDWDEDVHFDSDFLW\7KLVFDXVHV

VHULRXVORVVRI,QWHUQHWSHUIRUPDQFHDQGEDQGZLGWKx 6RPHVSDPFRQWDLQVRIIHQVLYHFRQWHQWx 6SDP PHVVDJHVFDQFRPH DWWDFKHG ZLWK KDUPIXO FRGH LQFOXGLQJYLUXVHV DQG ZRUPV

ZKLFKFDQLQVWDOOEDFNGRRUVLQUHFHLYHUVV\VWHPVx 6SDPPHUV FDQ KLMDFN RWKHU SHRSOHV FRPSXWHUV WR VHQG XQZDQWHG HPDLOV 7KHVH

FRPSURPLVHG PDFKLQHV DUH UHIHUUHG WR DV ]RPELH QHWZRUNV QHWZRUNV RI YLUXV RUZRUPLQIHFWHGSHUVRQDOFRPSXWHUVLQKRPHVDQGRIILFHVDURXQGWKHJOREH7KLVHQVXUHVVSDPPHUVDQRQ\PLW\DQGPDVVLYHO\LQFUHDVHVWKHQXPEHURIVSDPPHVVDJHVFDQEHVHQW

9DULRXV FRXQWHUPHDVXUHV WR VSDP KDYH EHHQ SURSRVHG WR PLWLJDWH WKH LPSDFWV RIXQVROLFLWHGHPDLOVUDQJLQJIURPUHJXODWRU\WRWHFKQLFDODSSURDFKHV7KRXJKDQWLVSDPOHJDOPHDVXUHVDUHJUDGXDOO\EHLQJDGRSWHGWKHLUHIIHFWLYHQHVVLVVWLOOYHU\OLPLWHG$PRUHGLUHFWFRXQWHUPHDVXUH LV VRIWZDUHEDVHG DQWLVSDP ILOWHUVZKLFK DWWHPSW WR GHWHFW VSDP IURPOHJLWLPDWHPDLOVDXWRPDWLFDOO\0RVWRIWKH H[LVWLQJ HPDLO VRIWZDUHSDFNDJHVDUH HTXLSSHGZLWK VRPH IRUP RI SURJUDPPDEOH VSDP ILOWHULQJ FDSDELOLW\ W\SLFDOO\ LQ WKH IRUP RIEODFNOLVWVRINQRZQVSDPPHUVLHEORFNHPDLOVWKDWFRPHIURPDEODFNOLVWFKHFNZKHWKHUHPDLOVFRPHIURPDJHQXLQHGRPDLQQDPHRUZHEDGGUHVVDQGKDQGFUDIWHGUXOHVLHEORFNPHVVDJHV FRQWDLQLQJVSHFLILFNH\ZRUGVDQG XQQHFHVVDU\HPEHGGHG +70/ FRGH%HFDXVHVSDPPHUV QRUPDOO\ XVH IRUJHG DGGUHVVHV WKH EODFNOLVW DSSURDFK LV YHU\ LQHIIHFWLYH+DQGFUDIWHG UXOHVDUH DOVR OLPLWHG GXH WR WKHLU UHOLDQFH RQ SHUVRQDO SUHIHUHQFHV LHWKH\QHHGWREHWXQHGWRFKDUDFWHULVWLFVRIPHVVDJHVUHFHLYHGE\DSDUWLFXODUXVHURUJURXSVRIXVHUV 7KLV LV D WLPH FRQVXPLQJ WDVN UHTXLULQJ UHVRXUFHV DQG H[SHUWLVH DQG KDV WR EHUHSHDWHG SHULRGLFDOO\ WR DFFRXQW IRU FKDQJLQJ QDWXUH RI VSDP PHVVDJHV / ) &UDQRU/D0DFFKLD%$6SDPGHWHFWLRQLVFORVHO\UHODWHGWR7H[W&DWHJRUL]DWLRQ7&GXHWRWKHLUWH[WEDVHGFRQWHQWVDQGVLPLODUWDVNV+RZHYHUXQOLNHPRVW7&SUREOHPVVSDPPLQJLVWKHDFWRIEOLQGO\PDVV


5/20


PDLOLQJDQXQVROLFLWHGPHVVDJHWKDWPDNHVLWVSDPQRWLWVDFWXDOFRQWHQW6FKU\HQDQ\RWKHUZLVHOHJLWLPDWHPHVVDJHEHFRPHVVSDPLIEOLQGO\PDVVPDLOHG)URPWKLVSRLQWRIYLHZVSDPPLQJEHFRPHVDYHU\FKDOOHQJLQJSUREOHPWR WKHVXVWDLQDELOLW\ RIWKH ,QWHUQHW

JLYHQ WKH FRQWHQW RI HPDLOV WKH RQO\ IRXQGDWLRQ IRU VSDP UHFRJLQLWLRQ 1HYHUWKHOHVV LWVHHPVWKDWWKHODQJXDJHRI FXUUHQWVSDPPHVVDJHVFRQVWLWXWHVDGLVWLQFWLYHJHQUHDQGWKDWWKH WRSLFV RI PRVW FXUUHQW VSDP PHVVDJHV DUH UDUHO\ PHQWLRQHG LQ OHJLWLPDWH PHVVDJHVPDNLQJLWSRVVLEOHWRWUDLQVXFFHVVIXOO\DWH[WFODVVLILHUIRUVSDPUHFRJQLWLRQ

/CEJKPG.GCTPKPIHQT5RCO4GEQIPKVKQP

5HFHQW DGYDQFHV RI 0DFKLQH /HDUQLQJ 0/ WHFKQLTXHV LQ 7H[W &ODVVLILFDWLRQ 7& KDYHDWWUDFWHG LPPHQVH DWWHQWLRQ IURP UHVHDUFKHUV WR H[SORUH WKH DSSOLFDELOLW\ RI OHDUQLQJDOJRULWKPV LQ DQWLVSDP ILOWHULQJ %D\OHU ,Q SDUWLFXODU D FROOHFWLRQ RI PHVVDJHV LVLQSXWWRD OHDUQLQJDOJRULWKPZKLFKLQIHUVXQGHUO\LQJIXQFWLRQDOGHSHQGHQFLHV RIUHOHYDQWIHDWXUHV7KHUHVXOWRIWKLVSURFHVVLVDPRGHOWKDWFDQZLWKRXWKXPDQLQWHUYHQWLRQFODVVLI\DQHZLQFRPLQJHPDLODVVSDPRUOHJLWLPDWHDFFRUGLQJWRWKHNQRZOHGJHFROOHFWHGIURPWKHWUDLQLQJVWDJH$SDUWIURPDXWRPDWLRQZKLFKIUHHVRUJDQL]DWLRQVIURPWKHQHHGRIPDQXDOO\FODVVLI\LQJ D KXJH DPRXQW RI PHVVDJHV WKLV PRGHO FDQ EH UHWDLQHG WR FDSWXUH QHZFKDUDFWHULVWLFVRI VSDP HPDLOV7REH PRVWXVHIXO LQUHDOZRUOGDSSOLFDWLRQVWKHDQWLVSDPILOWHUV QHHG WR KDYH D JRRG JHQHUDOL]DWLRQ FDSDELOLW\ WKDW LV WKH\ FDQ GHWHFW PDOLFLRXVPHVVDJHV ZKLFKQHYHU RFFXU GXULQJ WKH OHDUQLQJ SURFHVV7KHUH KDV EHHQ D JUHDWGHDO RIUHVHDUFKFRQGXFWHGLQWKLVDUHDUDQJLQJIURPVLPSOHPHWKRGVVXFKDVSURSRVLWLRQDOOHDUQHU5LSSHUZLWKNH\ZRUGVSRWWLQJUXOHV&RKHQWRPRUHFRPSOLFDWHGDSSURDFKHVVXFKDV%D\HVLDQQHWZRUNVXVLQJ EDJVRIZRUGVUHSUHVHQWDWLRQDQGELQDU\FRGLQJ6DKDPL,Q $QGURXWVRSRXORV .RXWVLDV &KDQGULQRV 3DOLRXUDV 6S\URSRXORV D V\VWHPLPSOHPHQWLQJ1DwYH%D\HVDQGD N11WHFKQLTXHLVUHSRUWHGWR EHDEOHWRRXWSHUIRUPWKH

NH\ZRUGEDVHG ILOWHU RI 2XWORRN RQ WKH /LQJ6SDP FRUSXV (QVHPEOH PHWKRGV DOVRSURYH WKHLU XVHIXOQHVV LQ ILOWHULQJ VSDP )RUH[DPSOHVWDNHG 1DwYH%D\HV DQGN11FDQDFKLHYH JRRG DFFXUDF\ 'UXFNHU :X 9DSQLN DQG%RRVWHG WUHHV ZHUHVKRZQWRKDYHEHWWHU SHUIRUPDQFHWKDQ LQGLYLGXDO WUHHV 1DwYH %D\HV DQG N11DORQH &DUUHUDV 0DUTXH]$VXSSRUWYHFWRUPDFKLQH690'UXFNHUHWDOLVDOVRUHSRUWHGWRDFKLHYH D KLJKHU GHWHFWLRQ UDWH DV ZHOO DV ORZHU IDOVH DODUP UDWH IRU VSDP UHFRJQLWLRQFRPSDUHG ZLWK RWKHU GLVFULPLQDWLYH FODVVLILFDWLRQ PHWKRGV ,W LV VXJJHVWHG WKDW HPDLOKHDGHUVSOD\DYLWDOUROHLQVSDPUHFRJQLWLRQDQGWRJHWEHWWHUUHVXOWVFODVVLILHUVVKRXOGEHWUDLQHGRQIHDWXUHVRIERWKHPDLOKHDGHUVDQGHPDLOERGLHV$QGURXWVRSRXORVHWDO

.KPI5RCO$GPEJOCTM7KH/LQJ6SDPFRUSXV$QGURXWVRSRXORVHWDOLVXVHGDVDEHQFKPDUNWRHYDOXDWHRXUSURSRVHGDOJRULWKPZLWKRWKHUH[LVWLQJWHFKQLTXHVWKHDQWLVSDPILOWHULQJWDVN8VLQJWKLV SXEOLFO\ DYDLODEOH GDWDVHW ZH FDQ FRQGXFW WUDFWDEOH H[SHULPHQWV DQG DOVR DYRLGFRPSOLFDWLRQVRISULYDF\LVVXHV:KLOHVSDPPHVVDJHVGRQRWSRVHWKLVSUREOHPDVWKH\DUHEOLQGO\GLVWULEXWHGWRD ODUJHQXPEHURI UHFLSLHQWVOHJLWLPDWHHPDLO PHVVDJHVPD\FRQWDLQSHUVRQDOLQIRUPDWLRQDQGFDQQRWXVXDOO\EHUHOHDVHGZLWKRXWYLRODWLQJWKHSULYDF\RIWKHLUUHFLSLHQWVDQGVHQGHUV


6/20

2CVVGTP4GEQIPKVKQP

7KH FRUSXV FRQWDLQV OHJLWLPDWH PHVVDJHV FROOHFWHG IURP D PRGHUDWHG PDLOLQJ OLVW RQSURIHVVLRQ DQG VFLHQFH RI OLQJXLVWLFV DQG WKH VSDP PHVVDJHV FROOHFWHG IURP SHUVRQDOPDLOER[HV

x OHJLWLPDWHPHVVDJHVZLWKWH[WDGGHGE\WKHOLVWVVHUYHUUHPRYHGx VSDPPHVVDJHVGXSOLFDWHVSDPPHVVDJHVUHFHLYHGRQWKHVDPHGD\H[FOXGHG

7KHKHDGHUV+70/WDJVDQGDWWDFKPHQWVRIWKHVHPHVVDJHVDUHUHPRYHGOHDYLQJRQO\WKHVXEMHFWOLQHDQGERG\WH[W7KHGLVWULEXWLRQRI WKHGDWDVHWLVVSDPPDNHVLW HDV\WRLGHQWLI\OHJLWLPDWHHPDLOVEHFDXVHRIWKHWRSLFVSHFLILFQDWXUHRIWKHOHJLWLPDWHPDLOV7KLVGDWDVHWLVSDUWLWLRQHGLQWRVWUDWLILHGVXEVHWVZKLFKPDLQWDLQWKHVDPH UDWLRRIOHJLWLPDWHDQGVSDPPHVVDJHVDVLQWKHHQWLUHGDWDVHW7KRXJKVRPHUHVHDUFK$QGURXWVRSRXORVHWDO &DUUHUDV 0DUTXH] +VX &KDQJ /LQ 6DNNLV HW DO KDV EHHQFRQGXFWHGRQWKLVGDWDVKRZLQJWKHLUFRPSDUDWLYHHIILFLHQF\PRVWRIWKHPVXIIHUIURPKLJKDIDOVHDODUPUDWHZKLFKUHVXOWVLQDGHJUDGHGSHUIRUPDQFHZKHQWKHPLVFODVVLILFDWLRQFRVWLVKLJK2YHUFRPLQJWKLVSUREOHPLVRXUPDMRUREMHFWLYHLQWKLVFKDSWHU

5RCO4GEQIPKVKQP/GVJQFU

7KLVVHFWLRQGLVFXVVHVFRPPRQO\XVHGOHDUQLQJDOJRULWKPVIRUVSDPUHFRJQLWLRQSUREOHPV

0CXG$C[GU1DLYH %D\HV LV D ZHOONQRZQ SUREDELOLVWLF FODVVLILFDWLRQ DOJRULWKP ZKLFK KDV EHHQ XVHGZLGHO\IRUVSDP UHFRJQLWLRQ$QGURXWVRSRXORVHW DO $FFRUGLQJ WR%D\HVWKHRUHP

ZH FDQ FRPSXWH WKH SUREDELOLW\ WKDW D PHVVDJH ZLWK YHFWRUEHORQJVWRDFODVV

7KH FDOFXODWLRQ RI LV SUREOHPDWLF EHFDXVH PRVW DOO QRYHO PHVVDJHV DUHGLIIHUHQWIURPWUDLQLQJPHVVDJHV7KHUHIRUHLQVWHDGRIFDOFXODWLQJSUREDELOLW\IRUPHVVDJHVD FRPELQDWLRQ RI ZRUGV ZH FDQ FRQVLGHU WKHLU ZRUGV VHSDUDWHO\ %\ PDNLQJ WKHDVVXPSWLRQWKDW DUHFRQGLWLRQDOO\LQGHSHQGHQWJLYHQWKHFODVVFZHKDYH

/GOQT[$CUGF.GCTPKPI

,Q $QGURXWVRSRXORV HW DO DQ DQWLVSDP ILOWHULQJ WHFKQLTXH XVLQJ 0HPRU\%DVHG/HDUQLQJ 0%/ WKDW VLPSO\ VWRUHV WKH WUDLQLQJ PHVVDJHV 7KH WHVW PHVVDJHV DUH WKHQFODVVLILHGE\HVWLPDWLQJWKHLUVLPLODULW\WRWKHVWRUHGH[DPSOHVEDVHGRQWKHLU RYHUODSPHWULFZKLFK FRXQWV WKH DWWULEXWHV ZKHUH WKH WZR PHVVDJHV KDYH GLIIHUHQW YDOXHV *LYHQ WZRLQVWDQFHV DQG WKHLURYHUODSGLVWDQFHLV

:KHUH LI[\RURWKHUZLVH


7/20


7KHFRQILGHQFHOHYHOWKDWDPHVVDJH EHORQJVWRDFODVVFLVFDOFXODWHGEDVHGRQWKHFODVVHVRIRWKHUQHLJKERULQVWDQFHV

0%/VSHUIRUPDQFHFDQEHVLJQLILFDQWO\LPSURYHGE\LQWURGXFLQJVRPHZHLJKWLQJVFKHPHV

&KUVCPEG9GKIJVKPI'HSHQGLQJRQKRZIDUDWHVWLQVWDQFHLVDZD\IURPLWVQHLJKERUKRRGLWVFRQILGHQFHOHYHOLVHVWLPDWHG

#VVTKDWVG9GKIJVKPI

8QOLNH WKH EDVLF NQHLJKERUKRRG FODVVLILHUV ZKHUH DOO DWWULEXWHV DUH WUHDWHG HTXDOO\ 0%/DVVLJQV GLIIHUHQW ZHLJKWV WR WKH DWWULEXWHV GHSHQGLQJ RQ KRZ ZHOO WKH\ GLVFULPLQDWHEHWZHHQWKHFDWHJRULHVDQGDGMXVWWKHGLVWDQFHPHWULFDFFRUGLQJO\,QSDUWLFXODUDQDWWULEXWH

KDVDZHLJKWRI ZKLFKLVWKHUHGXFWLRQRIHQWURS\+&XQFHUWDLQW\RQDQ\FDWHJRU\&RIDUDQGRPO\VHOHFWHGLQVWDQFHDQGWKHH[SHFWHGYDOXHRIHQWURS\ XQFHUWDLQO\RQDQ\FDWHJRU\&JLYHQWKHYDOXHRIDWWULEXWH;7KLVPHDQVDQDWWULEXWHZRXOGKDYHDKLJKHUZHLJKWLINQRZLQJLWVYDOXHUHGXFHVXQFHUWDLQW\RQFDWHJRU\&

:KHUH

7KHGLVWDQFHEHWZHHQWZRLQVWDQFHVLVUHFDOFXODWHGDVEHORZ

$QQUVGF&GEKUKQP6TGG

%RRVWHG7UHH%7LVDSRSXODUPHWKRGLPSOHPHQWHGLQPDQ\DQWLVSDPILOWHUVZLWKJUHDWVXFFHVVHV&DUUHUDV0DUTXH],WXVHVWKH$'$%RRVWDOJRULWKP6FKDSLUH6LQJHU WR JHQHUDWH D QXPEHU RI 'HFLVLRQ 7UHVV FODVVLILHUV ZKLFK DUH WUDLQHG E\ GLIIHUHQWVDPSOH VHWV GUDZQ IURP WKH RULJLQDO WUDLQLQJ VHW (DFK RI WKHVH FODVVLILHUV SURGXFHV D

K\SRWKHVLVIURPZKLFKDOHDUQLQJHUURUFDQEHFDOFXODWHG:KHQWKLVHUURUH[FHHGVDFHUWDLQOHYHOWKHSURFHVVLVWHUPLQDWHG$ILQDOFRPSRVLWHK\SRWKHVLVLVWKHQFUHDWHGE\FRPELQLQJLQGLYLGXDOK\SRWKHVHV

5WRRQTV8GEVQT/CEJKPG

6XSSRUW 9HFWRU 0DFKLQHV 690 'UXFNHU HW DO KDYH EHFRPH RQH RI WKH SRSXODUWHFKQLTXHV IRU WH[W FDWHJRUL]DWLRQ WDVNV GXH WR WKHLU JRRG JHQHUDOL]DWLRQ QDWXUH DQG WKHDELOLW\ WR RYHUFRPH WKH FXUVH RI GLPHQVLRQDOLW\ 690 FODVVLILHV GDWD E\ D VHW RIUHSUHVHQWDWLYHVXSSRUW YHFWRUV $VVXPH WKDW ZH ZDQW WR ILQG D GLVFULPLQDQWIXQFWLRQI[VXFK WKDW $ SRVVLEOH OLQHDU GLVFULPLQDQW IXQFWLRQ FDQ EH SUHVHQWHG DV


8/20

2CVVGTP4GEQIPKVKQP

ZKHUH LV D VHSDUDWLQJ K\SHUSODQH LQ WKH GDWD VSDFH&RQVHTXHQWO\ FKRRVLQJ D GLVFULPLQDQW IXQFWLRQ LV WR ILQG D K\SHUSODQH KDYLQJ WKHPD[LPXPVHSDUDWLQJPDUJLQZLWKUHVSHFWWRWKH WZRFODVVHV$690PRGHOLV FRQVWUXFWHG

E\VROYLQJWKLVRSWLPL]DWLRQSUREOHP

#TVKHKEKCN0GWTCN0GVYQTM

$UWLILFLDOQHXUDOQHWZRUN$11KDVJDLQHGVWURQJLQWHUHVWVIURPGLYHUVHFRPPXQLWLHVGXHWRLWVDELOLW\WRLGHQWLI\WKHSDWWHUQVWKDWDUHQRWUHDGLO\REVHUYDEOH0XOWL/D\HU3HUFHSWURQ0/3LVWKHPRVWSRSXODUQHXUDOQHWZRUNDUFKLWHFWXUHLQXVHWRGD\7KLVQHWZRUNXVHVDOD\HUHGIHHGIRUZDUGWRSRORJ\LQZKLFKWKHXQLWVHDFKSHUIRUPDELDVHGZHLJKWHGVXPRIWKHLU LQSXWV DQG SDVV WKLV DFWLYDWLRQ OHYHO WKURXJK D WUDQVIHU IXQFWLRQ WR SURGXFH WKHLURXWSXW5XPHOKDUW0F&OHOODQG7KRXJKPDQ\DSSOLFDWLRQVKDYHLPSOHPHQWHG0/3IRUVXSHULRUOHDUQLQJFDSDFLW\LWVSHUIRUPDQFHLVXQUHOLDEOHZKHQQHZGDWDLVHQFRXQWHUHG$ UHFHQWO\ HPHUJLQJ EUDQFK RI $11 WKH 5%) QHWZRUNV LV DOVR UHSRUWHG WR JDLQ JUHDWVXFFHVVHV LQ GLYHUVH DSSOLFDWLRQV ,Q WKLV FKDSWHU 0/3 LV LPSOHPHQWHG DV W\SLFDO $11PRGHOVIRUVSDPUHFRJQLWLRQ

%NCUUKHKECVKQP(TCOGYQTMHQT5RCO4GEQIPKVKQP

$OWKRXJKOHWWLQJXQGHWHFWHGVSDPSDVVWKURXJKDILOWHULVQRWDVGDQJHURXVDVEORFNLQJDOHJLWLPDWHPHVVDJHRQHFDQDUJXHWKDWDPRQJRQHPLOOLRQLQFRPLQJHPDLOVDIHZWKRXVDQGXQVROLFLWHG PHVVDJH WKDW DUHPLVFODVVLILHGDV QRUPDO LV VWLOO YHU\FRVWO\+HQFHDQWLVSDPILOWHUV UHDOO\ QHHG WR EH DFFXUDWH HVSHFLDOO\ ZKHQ WKH\ DUH XVHG LQ ODUJH RUJDQL]DWLRQV$GYDQFHG 0/ WHFKQLTXHV KDYH EHHQ XVHG WR LPSURYH SHUIRUPDQFH RI VSDP ILOWHULQJ

V\VWHPV$PRQJVWWKRVHPHWKRGV$UWLILFLDO1HXUDO1HWZRUN $11KDVEHHQJDLQLQJVWURQJLQWHUHVWV IURP GLYHUVH FRPPXQLWLHV GXHWR LWV DELOLW\ WR LGHQWLI\ WKH SDWWHUQV WKDW DUH QRWUHDGLO\ REVHUYDEOH 'HVSLWH UHFHQW VXFFHVVHV $11 EDVHG DSSOLFDWLRQV VWLOO KDYH VRPHGLVDGYDQWDJHVVXFKDVH[WHQVLYHFRPSXWDWLRQDQGXQUHOLDEOHSHUIRUPDQFH,QWKLVVWXG\ZHXVH D 0RGLILHG 3UREDELOLVWLF 1HXUDO 1HWZRUN 0311 ZKLFK LV GHYHORSHG E\ =DNQLFK=DNQLFK,I WKHUH H[LVWV D FRUUHVSRQGLQJ VFDODU RXWSXW IRU HDFK ORFDO UHJLRQ FOXVWHU ZKLFK LVUHSUHVHQWHGE\DFHQWHUYHFWRU 0311FDQEHPRGHOHGDVIROORZ=DNQLFK

:LWK*DXVVLDQIXQFWLRQ

:KHUHFHQWHUYHFWRUIRUFOXVWHULLQWKHLQSXWVSDFHVFDODURXWSXWUHODWHGWR QXPEHURILQSXWYHFWRUV ZLWKLQFOXVWHU

VLQJOHVPRRWKLQJSDUDPHWHUFKRVHQGXULQJQHWZRUNWUDLQLQJ0QXPEHURIXQLTXHFHQWHUV 7KRXJK0311LV UHSRUWHGWRSURYLGHDFFHSWDEOHDFFXUDF\DQG DIIRUGDEOH FRPSXWDWLRQ LW

MXVWOLNHRWKHU$11FDQQRWFODVVLI\UHOLDEO\ZKHQDQXQXVXDOLQSXWZKLFKGLIIHUVIURPWKHLUWUDLQLQJGDWDHPHUJHV$VDUHVXOWLWLVHVVHQWLDOWKDWVRPHGHJUHHRIJHQHUDOL]DWLRQFDSDFLW\


9/20


PXVWEHLQFRUSRUDWHGLQWKH0311EDVHGFODVVLILHUV$SRVVLEOHDSSURDFKWRWKLVSUREOHPLVWR LQFRUSRUDWH 0311 ZLWK D OLQHDU PRGHO ZKLFK RIIHUV VWDELOLW\ DQDO\]DELOLW\ DQG IDVWDGDSWDWLRQ+D\HV

&GUETKRVKQP

)LJXUH VKRZV WKH RYHUDOO ILOWHULQJ IUDPHZRUN SURSRVHG IRU VSDP UHFRJQLWLRQ SUREOHP7KHUHDUHPDLQSKDVHV

)LJ3URSRVHGDQWLVSDPILOWHULQJIUDPHZRUN

2JCUG&CVC4GRTGUGPVCVKQPCPF2TGRTQEGUUKPI

7KH SXUSRVH RI GDWD SUHSURFHVVLQJ LV WR WUDQVIRUP PHVVDJHV LQ WKH PDLO FRUSXV LQWR DXQLIRUPIRUPDWWKDWFDQEHXQGHUVWRRGE\WKHOHDUQLQJDOJRULWKPV)HDWXUHVIRXQGLQPDLOVDUH QRUPDOO\ WUDQVIRUPHG LQWR D YHFWRU VSDFH LQ ZKLFK HDFK GLPHQVLRQ RI WKH VSDFHFRUUHVSRQGVWRDJLYHQIHDWXUHLQWKHHQWLUHFRUSXV(DFKLQGLYLGXDOPHVVDJHFDQWKHQEHYLHZHGDVDIHDWXUHYHFWRU7KLVLVUHIHUUHGWRDVWKHEDJRIZRUGVDSSURDFK7KHUHDUHWZRPHWKRGVWRUHSUHVHQWHOHPHQWVRIWKHIHDWXUHYHFWRUPXOWLYDULDWHSUHVHQWDWLRQDVVLJQVDELQDU\YDOXHWRHDFKHOHPHQWVKRZLQJWKDWWKHZRUGRFFXUVLQWKHFXUUHQWPDLORUQRWDQGPXOWLQRPLDO SUHVHQWDWLRQ UHSUHVHQWV HDFK HOHPHQW DV D QXPEHU WKDW VKRZV WKH RFFXUUHQFHIUHTXHQF\ RIWKDW ZRUG LQ WKH FXUUHQW PDLO $ FRPELQDWLRQ RIEDJRI ZRUGV DQG PXOWLYDULDWH SUHVHQWDWLRQ LV XVHG LQ RXU H[SHULPHQWV WKH RUGHU RI WKH ZRUGV LV QHJOHFWHG7RFRQVWUXFW WKH IHDWXUH YHFWRUV WKH LPSRUWDQW ZRUGV DUH VHOHFWHG DFFRUGLQJ WR WKHLU0XWXDO,QIRUPDWLRQ0,6DNNLVHWDO


10/20

2CVVGTP4GEQIPKVKQP

7KHZRUGVZLWKWKHKLJKHVW0,YDOXHVDUHVHOHFWHGDVWKHIHDWXUHV$VVXPHWKDWWKHUHDUHQIHDWXUHVWREHFKRVHQHDFKPDLOZLOOEHUHSUHVHQWHGE\DIHDWXUHYHFWRU ZKHUH

DUHWKHYDOXHVRIELQDU\DWWULEXWHV LQGLFDWLQJWKHSUHVHQFHRUDEVHQFHRIDQDWWULEXWHZRUGLQFXUUHQWPHVVDJH0RUHRYHU ZRUGVWHPPLQJDQG VWRSZRUGUHPRYDODUHWZRLPSRUWDQWLVVXHVWKDWQHHGWREHFRQVLGHUHG LQ SDUVLQJ HPDLOV :RUG VWHPPLQJ UHIHUV WR FRQYHUWLQJ ZRUGV WR WKHLUPRUSKRORJLFDOEDVHIRUPVHJJRQHDQGZHQWDUHUHGXFHGWRURRWZRUGJR6WRSZRUGUHPRYDOLVDSURFHGXUHWRUHPRYHZRUGVWKDWDUHIRXQGLQDOLVWRIIUHTXHQWO\XVHGZRUGVVXFKDVDQGIRUD7KHPDLQDGYDQWDJHVRIDSSO\LQJWKHWZRWHFKQLTXHVDUHWKHUHGXFWLRQ RI IHDWXUH VSDFH GLPHQVLRQ DQG SRVVLEOH LPSURYHPHQW RQ FODVVLILHUV SUHGLFWLRQDFFXUDF\ E\ DOOHYLDWLQJ WKH GDWD VSDUVHQHVV SUREOHP$QGURXWVRSRXORV HW DO 7KH/LQJ6SDP FRUSXV KDV IRXU YHUVLRQV HDFK GLIIHUV IURP HDFK RWKHU E\ WKH XVDJH RI DOHPPDWL]HUDQGDVWRSOLVWUHPRYHVWKHPRVWIUHTXHQWO\XVHGZRUGV:HXVHWKHYHUVLRQZLWK OHPPDWL]HU DQG VWRSOLVW HQDEOHG EHFDXVH LW SHUIRUPV EHWWHU ZKHQ GLIIHUHQW FRVWVFHQDULRVDUHFRQVLGHUHG$QGURXWVRSRXORVHWDO:RUGVWKDWDSSHDUOHVVWKDQWLPHVRUORQJHUWKDQFKDUDFWHUVDUHGLVFDUGHG$OVR LW LV IRXQG WKDW SKUDVDO DQG QRQWH[WXDO DWWULEXWHV PD\ LPSURYH VSDP UHFRJQLWLRQSHUIRUPDQFH $QGURXWVRSRXORV HW DO +RZHYHU WKH\ LQWURGXFH D PDQXDOFRQILJXUDWLRQSKDVH%HFDXVHRXUWDUJHWZDVWR H[SORUHIXOO\DXWRPDWLFDQWLVSDPILOWHULQJZHOLPLWHGRXUVHOYHVWRZRUGRQO\DWWULEXWHV)LQDOO\ VRPH GDWD FOHDQLQJ WHFKQLTXHV DUH UHTXLUHG DIWHU FRQYHUWLQJ UDZ GDWD LQWRDSSURSULDWHIRUPDW,QSDUWLFXODUWRGHDOZLWKPLVVLQJYDOXHVWKHVLPSOHVWDSSURDFKLVWRGHOHWHDOOLQVWDQFHVZKHUHWKHUHLVDWOHDVWRQHPLVVLQJYDOXHDQGXVHWKHUHPDLQGHU7KLV

VWUDWHJ\KDVWKHDGYDQWDJHRIDYRLGLQJLQWURGXFLQJDQ\GDWDHUURUV,WVPDLQSUREOHPLVWKDWGLVFDUGRIGDWDPDQ\GDPDJHWKHUHOLDELOLW\RIWKHUHVXOWLQJFODVVLILHU0RUHRYHUWKHPHWKRGFDQQRWEHXVHGZKHQDKLJKSURSRUWLRQRILQVWDQFHVLQWKHWUDLQLQJVHWKDYHPLVVLQJYDOXHV7RJHWKHU WKHVH ZHDNQHVVHV DUH TXLWH VXEVWDQWLDO $OWKRXJK LW PD\EH ZRUWK WU\LQJ ZKHQWKHUHDUHIHZPLVVLQJYDOXHVLQWKHGDWDVHWWKLVDSSURDFKLVJHQHUDOO\QRWUHFRPPHQGHG,QVWHDGZHXVHDQDOWHUQDWLYHVWUDWHJ\LQZKLFKDQ\PLVVLQJYDOXHVRIDFDWHJRULFDODWWULEXWHDUH UHSODFHG E\ LWV PRVW FRPPRQO\ RFFXUULQJ YDOXH LQ WKH WUDLQLQJ VHW )RU FRQWLQXRXVDWWULEXWHVPLVVLQJYDOXHVDUHUHSODFHGE\LWVDYHUDJHYDOXHLQWKHWUDLQLQJVHW

2JCUG(GCVWTG6TCPUHQTOCVKQP

7KH WUHPHQGRXV JURZWK LQ FRPSXWLQJ SRZHU DQG VWRUDJH FDSDFLW\ KDV PDGH WRGD\VGDWDEDVHV HVSHFLDOO\ IRUWH[WFDWHJRUL]DWLRQ WDVNVFRQWDLQ YHU\ODUJHQXPEHURI DWWULEXWHV$OWKRXJK IDVWHU SURFHVVLQJ VSHHGV DQG ODUJHU PHPRULHV PD\ PDNHLW SRVVLEOH WR SURFHVVWKHVH DWWULEXWHV WKLV LV LQHYLWDEO\ D ORVLQJ VWUXJJOH LQ WKH ORQJ WHUP %HVLGHV GHJUDGHGSHUIRUPDQFH PDQ\ LUUHOHYDQW DWWULEXWHV ZLOO DOVR SODFH DQ XQQHFHVVDU\ FRPSXWDWLRQDORYHUKHDG RQDQ\ GDWD PLQLQJ DOJRULWKP 7KHUHDUH VHYHUDO ZD\V LQZKLFK WKH QXPEHU RIDWWULEXWHVFDQEHUHGXFHGEHIRUHDGDWDVHWLVSURFHVVHG,QWKLVUHVHDUFKDGLPHQVLRQUHGXFWLRQDOVR FDOOHGIHDWXUH SUXQLQJRUIHDWXUH VHOHFWLRQ VFKHPH FDOOHG3ULQFLSDO&RPSRQHQW$QDO\VLV3&$-ROOLIIHLVSHUIRUPHGRQWKHGDWDWRVHOHFWWKHPRVWUHOHYDQWIHDWXUHV7KLVLVQHFHVVDU\ JLYHQ WKH YHU\ ODUJH VL]H DQG FRUUHODWHG QDWXUH RI WKH LQSXW YHFWRUV 3&$


11/20


HOLPLQDWHV KLJKO\ FRUUHODWHG IHDWXUHV DQG WUDQVIRUPV WKH RULJLQDO GDWD LQWR ORZHUGLPHQVLRQDO GDWD ZLWK PRVW UHOHYDQWIHDWXUHV )URP RXUREVHUYDWLRQWKHVHOHFWHGIHDWXUHVDUHZRUGV WKDW H[SUHVV WKH GLVWLQFWLRQ EHWZHHQ VSDP DQG QRQVSDPJURXSVLH WKH\DUH

HLWKHUFRPPRQLQVSDPRUOHJLWLPDWHPHVVDJHVQRWLQERWK6HYHUDOSXQFWXDWLRQDQGVSHFLDOV\PEROV HJ # DUHDOVR VHOHFWHG E\ 3&$ DQG WKHUHIRUH WKH\ DUH QRW HOLPLQDWHGGXULQJSUHSURFHVVLQJ

2JCUG'OCKN%NCUUKHKECVKQP

7KH GDWD DIWHU EHLQJ SURFHVVHG E\ WKH )HDWXUH VHOHFWLRQ PRGXOH LV LQSXW WR WUDLQ WKH&ODVVLILFDWLRQ0RGHO7KHUHVXOWLQJPRGHOLVWKHQXVHGWRODEHOHPDLOVDVHLWKHUOHJLWRUVSDP LQGLFDWLQJ ZKHWKHU D PHVVDJH LV FODVVLILHG DV OHJLWLPDWH RU D VSDP HPDLO 7RLPSOHPHQWWKH&ODVVLILFDWLRQ0RGHOZHSURSRVHDQLQWHOOLJHQWZD\RIFRPELQLQJWKHOLQHDUSDUW RI WKH PRGHOLQJ ZLWK D VLPSOH QRQOLQHDU PRGHO DOJRULWKP ,Q SDUWLFXODU 0311 LVDGDSWHGLQ WKHQRQOLQHDUFRPSHQVDWRUZKLFKZLOO RQO\ PRGHOKLJKHURUGHUHGFRPSOH[LWLHVZKLOH OLQHDU PRGHO ZLOO GRPLQDWH LQ FDVH RI GDWD IDU DZD\ IURP WUDLQLQJ FOXVWHUV ,W LVGHVFULEHGLQWKHIROORZLQJHTXDWLRQ

:KHUH/LQHDU5HJUHVVLRQ0RGHO

1RQOLQHDU5HVLGXDO&RPSHQVDWRU0311LQLWLDORIIVHWZHLJKWVRIWKHOLQHDUPRGHO

&RPSHQVDWLRQIDFWRU

GLIIHUHQFH EHWZHHQ WKH OLQHDU DSSUR[LPDWLRQ DQG WKH WUDLQLQJ

RXWSXWGLVWDQFHIURPWKHLQSXWYHFWRUWRFOXVWHULLQWKHLQSXWVSDFH

7KHFRPELQDWLRQRIOLQHDUUHJUHVVLRQPRGHODQG0311LVUHIHUUHGWRDV/LQHDU5HJUHVVLRQ0RGLILHG3UREDELOLVWLF1HXUDO1HWZRUN/503117KHSLHFHZLVHOLQHDUUHJUHVVLRQPRGHOLV ILUVWO\ DSSUR[LPDWHG E\ XVLQJ DOO DYDLODEOH WUDLQLQJ GDWD LQ D VLPSOH UHJUHVVLRQ ILWWLQJDQDO\VLV7KH0311LVWKHQFRQVWUXFWHGWRFRPSHQVDWHIRUKLJKHURUGHUHGFKDUDFWHULVWLFVRIWKHSUREOHP'HSHQGLQJRQGLIIHUHQWSRUWLRQVRIWKHWUDLQLQJVHWDQGKRZIDUWKHWHVWGDWDLVDZD\IURPWKHWUDLQLQJGDWDWKHLPSDFWRIQRQOLQHDUUHVLGXDOIXQFWLRQLVDGMXVWHGVXFKWKDWWKH RYHUDOO 0HDQ 6TXDUH (UURU LV PLQLPL]HG 7KLV DGMXVWPHQW LV IRUPXODWHG E\ WKHFRPSHQVDWLRQ IDFWRU ,Q SDUWLFXODU LV FRPSXWHG EDVHG RQ KRZ ZHOO WKH OLQHDU PRGHOSHUIRUPVRQDWUDLQLQJH[DPSOHVDQGGLVWDQFHVIURPDWHVWYHFWRUWRFOXVWHUVRIWUDLQLQJGDWD)LUVWO\WKHJRRGQHVVRIWKHOLQHDUPRGHO RQDSDUWLFXODUWUDLQLQJGDWDLVPHDVXUHVE\

ZKLFK LV GHILQHG DV WKH GLIIHUHQFH EHWZHHQ WKH OLQHDU DSSUR[LPDWLRQ DQG WKH DFWXDORXWSXWRIWKHWUDLQLQJGDWD$YHU\VPDOOYDOXHRI PHDQVWKDW ILWVWKHGDWDZHOOLQWKLVFDVHDQGWKHUHIRUHLWVKRXOGKDYHKLJKHUSULRULW\RU WKHLPSDFWRIWKHQRQOLQHDUPRGHO

LVPLQLPL]HG,QFRQWUDVWODUJHYDOXHRI LQGLFDWHVWKDW VKRXOGFRPSHQVDWH

PRUHIRUWKHGHJUDGHGDFFXUDF\RI 6HFRQGO\WRGHWHUPLQHKRZIDUDJLYHQWHVWYHFWRULVDZD\IURPWKHDYDLODEOHWUDLQLQJGDWDDGLVWDQFH IURPWKDWYHFWRUWRHDFKWUDLQLQJFOXVWHU LVFDOFXODWHG)RUDQ\GDWDZKLFKLV


12/20

2CVVGTP4GEQIPKVKQP

IDUDZD\IURP WKHWUDLQLQJ VHW LH LV ODUJH WKHYDOXH RI ZLOO EH PLQLPL]HG$VWKHUHVXOW ZLOOKDYHPLQLPDOUHVLGXDOHIIHFWDQG ZLOOGRPLQDWH7KLVLVEHFDXVH

KDVPRUHVWDEOHJHQHUDOL]DWLRQWKDQ IRUQHZLQVWDQFHV

2JCUG'XCNWCVKQP

7R HYDOXDWH WKH RYHUDOO SHUIRUPDQFH RI WKH IUDPHZRUN WKH &RVWVHQVLWLYH (YDOXDWLRQPRGXOHFRPSXWHVVHYHUDOSHUIRUPDQFHPHWULFVDQGDOVRWDNHVLQWRFRQVLGHUDWLRQGLIIHUHQWFRVWVFHQDULRV

2GTHQTOCPEG'XCNWCVKQP2GTHQTOCPEG/GCUWTGU

7R PHDVXUH WKHSHUIRUPDQFHRI GLIIHUHQW OHDUQLQJDOJRULWKPVWKH IROORZLQJ PHDVXUHVDUHXVHG

)URP WKH DERYH HTXDWLRQV 6SDP 5HFDOO 65 LVLQ IDFW WKHSHUFHQWDJH RI VSDP PHVVDJHV WKDWDUHFRUUHFWO\FODVVLILHG ZKLOH6SDP3UHFLVLRQ63FRPSDUHVWKHQXPEHURIFRUUHFWVSDPFODVVLILFDWLRQV WRWKHWRWDOQXPEHURIPHVVDJHVFODVVLILHGFRUUHFWO\ DQG LQFRUUHFWO\ DV VSDP $V WKH 0LVV 5DWH 05 LQFUHDVHV WKH

QXPEHURIPLVFODVVLILFDWLRQVRIOHJLWLPDWHHPDLOVLQFUHDVHVZKLOHWKH)DOVH$ODUP5DWH)$5LQFUHDVHVWKHQXPEHURIPLVFODVVLILFDWLRQVRIVSDPHPDLOVSDVVLQJIURPWKHILOWHULQFUHDVHV7KHUHIRUHERWKRI)$5DQG05VKRXOGEHDVVPDOODVSRVVLEOHIRUDILOWHUWREHHIIHFWLYHVKRXOGEHIRUDSHUIHFWILOWHU

%QUV5GPUKVKXG#PCN[UKU

D &RVW6FHQDULRV'HSHQGLQJRQZKDWDFWLRQLVWDNHQE\DVSDPILOWHULQUHVSRQVHWRDGHWHFWHGVSDPPHVVDJHWKHUH DUH WKUHH PDMRU PLVFODVVLILFDWLRQ FRVW VFHQDULRV 7KH QRFRVW FDVH LV ZKHQ WKH ILOWHUPHUHO\IODJVDGHWHFWHGVSDPPHVVDJH7KLVQRWLILFDWLRQRIVSDPGRHVQRWULVNORVLQJDQ\

OHJLWLPDWHPDLOGXHWRPLVFODVVLILFDWLRQHUURUQRPLVFODVVLILFDWLRQFRVWEXWLWVWLOOWDNHVWLPHIRUWKHKXPDQXVHUVWRFKHFNDQGGHOHWHWKHVSDPPHVVDJHVPDQXDOO\7RPLQLPL]HWKHXVHUHIIRUWVRQHOLPLQDWLQJVSDPWKHILOWHUFDQDXWRPDWLFDOO\GHWHFWDQGUHPRYHWKHVXVSLFLRXVPHVVDJHV+RZHYHUWKHWRWDOFRVWRIPLVFODVVLILFDWLRQLQWKLVFDVHFDQEHH[WUHPHO\KLJKGXHWRWKHVHULRXVQHVVRIIDOVHO\GLVFDUGLQJOHJLWLPDWHPDLOV7KLVUHIHUVWRWKHKLJKFRVWVFHQDULR%HVLGH WKH DERYH DSSURDFKHV WKH ILOWHU PD\ QRW HLWKHU IODJ RU FRPSOHWHO\ HOLPLQDWH WKHGHWHFWHGVSDPPHVVDJHV,QVWHDGLWPLJKWUHVHQGWKHPHVVDJHWRWKHVHQGHU7KLVDSSURDFKUHIHUUHGWRDVPRGHUDWHFRVWFRPEDWVVSDPPLQJE\LQFUHDVLQJLWVFRVWYLD+XPDQ,QWHUDFWLYH3URRIV+,3/)&UDQRU/D0DFFKLD7KDWLVWKHVHQGHULVUHTXLUHGWRJLYHDSURRIRIKXPDQLW\WKDWPDWFKHVDSX]]OHEHIRUHKLVPHVVDJHLVGHOLYHUHG7KHSX]]OHVFRXOGEHIRU


13/20


H[DPSOHLPDJHVFRQWDLQLQJVRPHWH[WWKDWLVGLIILFXOWWRDXWRPDWLFDOO\DQDO\]HE\SDWWHUQUHFRJQLWLRQVRIWZDUH$OWHUQDWLYHO\IRUDQWLVSDPSURJUDPVVLPSOHTXHVWLRQVHJZKDWLVRQHSOXVRQHFDQEHXVHGLQVWHDGRIJUDSKLFDOSX]]OHV

7KH FRQFHSW RI +,3 KDV EHHQ LPSOHPHQWHG LQ PDQ\ VHFXULW\ UHODWHG DSSOLFDWLRQV )RUH[DPSOH FHUWDLQ ZHEEDVHG HPDLO V\VWHPV XVH +,3 WR YHULI\ WKDW SDVVZRUG FUDFNLQJVRIWZDUHLVQRWV\VWHPDWLFDOO\EUXWHIRUFLQJWRJXHVVDFRUUHFWSDVVZRUGIRUHPDLODFFRXQWV:KHQ D XVHU W\SHV KLV SDVVZRUG ZURQJ WKUHH WLPHV D GLVWRUWHG LPDJH LV SUHVHQWHG WKDWFRQWDLQVDZRUGRUQXPEHUVDQGWKHXVHUPXVWYHULI\EHIRUHEHLQJDOORZHGWRFRQWLQXH$KXPDQFDQHDVLO\ FRQYHUWWKHLPDJH WRWH[W EXW WKH VDPH WDVN LVH[WUHPHO\ GLIILFXOWIRU DFRPSXWHU 6RPH HPDLO FOLHQW SURJUDPV KDYH DQWLVSDP ILOWHULQJ KHXULVWLFV XVLQJ +,3LPSOHPHQWHG:KHQVXFKSURJUDPVUHFHLYHDQHPDLOWKDWLVQRWLQWKHZKLWHOLVWRIWKHXVHUWKH\VHQGWKHVHQGHUDSDVVZRUG$KXPDQVHQGHUFDQWKHQUHVHQGWKHHPDLOFRQWDLQLQJWKHUHFHLYHG SDVVZRUG 7KLV V\VWHP FDQ HIIHFWLYHO\ GHIHDW VSDPPHUV EHFDXVH VSDP LV EXONPHDQLQJWKDW WKH VSDPPHUV GRQRW ERWKHU WRFKHFN UHSOLHV PDQXDOO\RU FRPPRQO\ XVH D

IRUJHGVRXUFHHPDLODGGUHVV7KHFRVWRIFUHDWLQJDQGYHULI\LQJWKHSURRIVLVVPDOOEXWWKH\FDQ EH FRPSXWDWLRQDOO\ LPSRVVLEOH IRU DXWRPDWHG PDVVPDLOLQJ WRROV WR DQDO\]H 7KRXJKVSDPPHUVFDQVWLOOXVHKXPDQODERUWRPDQXDOO\UHDGDQGSURYLGHWKHSURRIVDQGILQDOO\KDYH WKHLU VSDP PHVVDJH VHQW +,3DFWXDOO\ UHVWULFWV WKH QXPEHU RI XQVROLFLWHG PHVVDJHVWKDWWKH VSDPPHU FDQ VHQG IRU D FHUWDLQ SHULRG RI WLPHGXH WR WKH LQDELOLW\ WRXVH FKHDSDXWRPDWHG WRROV &DUUHUDV 0DUTXH] 7KLV EDUULHU IRU VSDPPHUV HIIHFWLYHO\LQWURGXFHVDGGLWLRQDOFRVWWRVHQGLQJVSDPPHVVDJHV,QWKLVFKDSWHUVSDPUHFRJQLWLRQH[SHULPHQWVDUHFRQGXFWHGLQDFRVWVHQVLWLYHPDQQHU$VHPSKDVL]HG SUHYLRXVO\ PLVFODVVLI\LQJ D OHJLWLPDWH PHVVDJH DV VSDP LV JHQHUDOO\ PRUHVHYHUH WKDQ PLVWDNHQO\ UHFRJQL]LQJ D VSDP PHVVDJH DV OHJLWLPDWH /HW OHJLWLPDWHFODVVLILHGDVVSDPDQG VSDPFODVVLILHGDVOHJLWLPDWHGHQRWHWKHWZRW\SHVRIHUURU

UHVSHFWLYHO\:HLQYRNHDGHFLVLRQWKHRUHWLFQRWLRQRIFRVWDQGDVVXPHWKDW LV WLPHVPRUH FRVWO\ WKDQ $ PDLO LV FODVVLILHG DV VSDP LI WKH IROORZLQJ FULWHULRQ LV PHW$QGURXWVRSRXORVHWDO

,QWKHFDVHRIDQWLVSDPILOWHULQJ

7KHDERYHFULWHULRQEHFRPHV

ZLWK

'HSHQGLQJRQZKLFKFRVWVFHQDULRVDUHFRQVLGHUHGWKHYDOXHRI LVDGMXVWHGDFFRUGLQJO\x

1RFRVWVFHQDULRHJIODJJLQJVSDPPHVVDJHV x 0RGHUDWHFRVWVFHQDULRHJVHPLDXWRPDWLFILOWHUZKLFKQRWLILHVVHQGHUVDERXWEORFNHG

PHVVDJHV x +LJKFRVWVFHQDULRHJDXWRPDWLFDOO\UHPRYLQJEORFNHGPHVVDJHV

E 7RWDO&RVW5DWLR$FFXUDF\DQGHUURUUDWHVDVVLJQHTXDOZHLJKWVWRWKHWZRHUURUW\SHV/66/DQGDUHGHILQHG

+RZHYHU LQ WKH FRVWVHQVLWLYH FRQWH[WV WKH DFFXUDF\ DQG HUURU UDWHV VKRXOG EH PDGHVHQVLWLYHWRWKHFRVWGLIIHUHQFH LHHDFKOHJLWLPDWHPHVVDJHLVFRXQWHGIRU WLPHV7KDWLV


14/20

2CVVGTP4GEQIPKVKQP

ZKHQD OHJLWLPDWHPHVVDJHLVPLVFODVVLILHGWKLVFRXQWVDV HUURUVDQGZKHQLWSDVVHVWKHILOWHUWKLVFRXQWVDV VXFFHVVHV7KLVOHDGVWRWKHGHILQLWLRQRIZHLJKWHGDFFXUDF\DQGZHLJKWHGHUURU:$FFDQG:(UU

7KHYDOXHVRISHUIRUPDQFHPHDVXUHVZHLJKWHGRUQRWDUHPLVOHDGLQJO\KLJK7RJHWDWUXHSLFWXUHRIWKHSHUIRUPDQFHRIDVSDPILOWHULWVSHUIRUPDQFHPHDVXUHVVKRXOGEHFRPSDUHGDJDLQVWWKRVHRIDEDVHOLQHDSSURDFKZKHUHQRILOWHULVXVHG6XFKDEDVHOLQHILOWHUQHYHUEORFNVOHJLWLPDWHPHVVDJHVZKLOHVSDPHPDLOVDOZD\VSDVVWKURXJKWKHILOWHU7KHZHLJKWHGDFFXUDF\DQGHUURUUDWHVIRUEDVHOLQHDUH

7RWDOFRVWUDWLR7&5LVDQRWKHUPHDVXUHZKLFKHYDOXDWHVSHUIRUPDQFHRIVSDPILOWHUWRWKDWRIDEDVHOLQH

*UHDWHU7&5YDOXHVLQGLFDWHEHWWHUSHUIRUPDQFH)RU7&5WKHEDVHOLQHLVEHWWHU,IFRVWLVSURSRUWLRQDOWRZDVWHGWLPHD7&5LVLQWXLWLYHO\HTXLYDOHQWWRPHDVXULQJKRZPXFKWLPHLVZDVWHGWR PDQXDOO\GHOHWHDOOVSDPPHVVDJHVZKHQWKH ILOWHULV XVHG FRPSDUHGWRWKHWLPH ZDVWHG WR PDQXDOO\ GHOHWH DQ\ VSDP PHVVDJHVWKDW SDVVHG WKH ILOWHU SOXV WKHWLPHQHHGHGWRUHFRYHUIURPPLVWDNHQO\EORFNHGOHJLWLPDWHPHVVDJHV

'ZRGTKOGPV4GUWNVU

'ZRGTKOGPV&GUKIP

7KHSURSRVHGVSDPUHFRJQLWLRQIUDPHZRUNLV WHVWHGRQ WKH/LQJ6SDPFRUSXVWRFRPSDUH

ZLWKRWKHUH[LVWLQJOHDUQLQJPHWKRGVLQFOXGLQJ1DwYH%D\HV1%:HLJKWHG0HPRU\%DVHG/HDUQLQJ:0%/%RRVWHG7UHHV%76XSSRUW9HFWRU0DFKLQH690DQG1HXUDO1HWZRUNPRGHOV0XOWLOD\HU3HUFHSWURQ0/38QOLNHRWKHUWH[WFDWHJRUL]DWLRQWDVNVILOWHULQJVSDPPHVVDJHV LV FRVW VHQVLWLYH &RKHQ KHQFH HYDOXDWLRQ PHDVXUHV WKDW DFFRXQW IRUPLVFODVVLILFDWLRQFRVWVDUHXVHG,QSDUWLFXODUZHGHILQHDFRVWIDFWRU ZLWKGLIIHUHQWYDOXHVFRUUHVSRQGLQJWRWKUHHFRVWVFHQDULRVILUVWQRFRVWFRQVLGHUHG HJPDUNLQJPHVVDJHVDVVSDPVHFRQGVHPLDXWRPDWLFILOWHULQJ HJLVVXLQJDQRWLILFDWLRQDERXWVSDPDQGIXOO\DXWRPDWLFILOWHULQJ HJGLVFDUGLQJWKHVSDPPHVVDJHV7KHUDWHDWZKLFKDOHJLWLPDWHPDLOLVPLVFODVVLILHGDVVSDPLVFDOFXODWHGE\)DOVH$ODUP5DWH)$5 DQG LW VKRXOG EH ORZ IRU D ILOWHU WR EH XVHIXO 6SDP 5HFDOO 65 PHDVXUHV WKHHIIHFWLYHQHVVRIWKHILOWHULHWKHSHUFHQWDJHRIPHVVDJHVFRUUHFWO\FODVVLILHGDVVSDPZKLOH

6SDP3UHFLVLRQ63LQGLFDWHVWKHILOWHUVVDIHW\LHWKHGHJUHHWRZKLFKWKHEORFNHGPHVVDJHVDUHWUXO\VSDP%HFDXVH65FDQEHGHULYHGIURP)$5HJ)$565ZHZLOOXVH6563DQG 7RWDO &RVW 5DWLR 7&5 IRU HYDOXDWLRQ %HVLGHV FRPSDULQJ KRZ DFFXUDWHO\ WKH ILOWHUVSHUIRUP WKHLU FRPSXWDWLRQ LV DOVR PHDVXUHG XVLQJ WKH FRPSXWDWLRQ WLPH LQ VHFRQGVUHTXLUHGIRUHDFKFODVVLILHU3DUWLFXODUO\WKHWRWDOFRPSXWDWLRQWLPHLVDVXPPDWLRQRIWKHWLPHWKDWD FODVVLILHUQHHGVWRSHUIRUPFURVVYDOLGDWLRQWHVWLQJRQGDWDDQGWRFDOFXODWHWKHUHOHYDQWSHUIRUPDQFHPHWULFVHJPLVFODVVLILFDWLRQUDWHDFFXUDF\6WUDWLILHG WHQIROG FURVV YDOLGDWLRQ LV HPSOR\HG IRU DOO H[SHULPHQWV 7KDW LV WKH FRUSXV LVSDUWLWLRQHGLQWRVWUDWLILHGSDUWVDQGHDFKH[SHULPHQWZDVUHSHDWHGWLPHVHDFKWLPH


15/20


UHVHUYLQJDGLIIHUHQWSDUWDVWKHWHVWLQJVHWDQGXVLQJWKHUHPDLQLQJSDUWVDVWKHWUDLQLQJVHW3HUIRUPDQFHVFRUHVDUHWKHQDYHUDJHGRYHUWKHLWHUDWLRQV,QDGGLWLRQWRWKHVWXGLHVFRQGXFWHGE\RWKHUUHVHDUFKHUVRQWKHVDPH/LQJ6SDPFRUSXV

1%$QGURXWVRSRXORVHWDO:0%/6DNNLVHWDO690+VXHWDO%7&DUUHUDV0DUTXH]ZHDOVRUHSURGXFHGWKHLUH[SHULPHQWVEDVHGRQWKHDYHUDJHYDOXHRI7&5RI WKUHHFRVWVFHQDULRVWRFRQILUPDQGGHWHUPLQHWKHSDUDPHWHUVYDOXHVWKDWJLYHEHVW SHUIRUPDQFH IRU GLIIHUHQW OHDUQLQJPHWKRGV 7KH RSWLPDO DWWULEXWH VL]H RI WKHVHPHWKRGVFDQEHIRXQGLQ)LJXUH$Q0/3ZWKQHXURQVLQKLGGHQOD\HULVGHSOR\HGXVLQJWKH0DWODE1HXUDO1HWZRUNWRROER[

'ZRGTKOGPV4GUWNV

6%4CPF#VVTKDWVG5GNGEVKQP)URP)LJXUHIRU DQG PRVWRIILOWHUVGHPRQVWUDWHDVWDEOHSHUIRUPDQFHZLWK

7&5 FRQVWDQWO\ JUHDWHU WKDQ 7KHVH ILOWHUV GLIIHU IURP RQH DQRWKHU LQ WHUPV RI WKHLUVHQVLWLYLW\RQDWWULEXWHVHOHFWLRQDQGWKHQXPEHURIDWWULEXWHVZKLFKJLYHPD[LPXP7&52XU/50311LVIRXQGWREH PRGHUDWHO\VHQVLWLYHWRDWWULEXWHVHOHFWLRQDQGLW REWDLQVWKHKLJKHVW7&5IRU ZLWKDWWULEXWHVVHOHFWHG:KHQ /50311DFKLHYHVYHU\FRPSHWLWLYH7&5FRPSDUHGWR690EXWZLWKOHVVQXPEHURI DWWULEXWHVDWWULEXWHVDQGKHQFHLQYROYHVOHVVFRPSXWDWLRQRYHUKHDGV

D


16/20

2CVVGTP4GEQIPKVKQP

E

F

)LJ7&5VFRUHRIVSDPUHFRJQLWLRQPHWKRGV)RU DOOFODVVLILHUVKDYHWKHLU7&5UHGXFHGVLJQLILFDQWO\IRUWKHHIIHFW RI YHU\KLJKPLVFODVVLILFDWLRQFRVW7KHGLIIHUHQFHEHWZHHQORZDQGKLJKYDOXHVRIPLVFODVVLILFDWLRQFRVW

LVWKHLQFUHDVHGSHUIRUPDQFHRIWKHEDVHOLQHILOWHUZKHQ LQFUHDVHV7KDWLVZLWKRXWDILOWHULQ XVH EDVHOLQH DOO OHJLWLPDWH PDLOV DUH UHWDLQHG SUHYHQWLQJ WKH EDVHOLQH IURPPLVFODVVLI\LQJ WKRVH OHJLWLPDWH PDLOVDV VSDP 7KHUHIRUODUJH EHQHILWV WKH EDVHOLQHDQGPDNHLWKDUGWREHGHIHDWHGE\RWKHUILOWHUV5HFDOOWKDW7&5LVWKHPHDVXUHRISHUIRUPDQFHWKDW D ILOWHU LPSURYHV RQ WKH EDVHOLQH FDVH $V D UHVXOW 7&5 JHQHUDOO\ UHGXFHV ZKHQ LQFUHDVHV$QRWKHULPSRUWDQWREVHUYDWLRQLVWKDWWKHSHUIRUPDQFHRIPRVWFODVVLILHUVH[FHSWIRU %7 DQG /50311 IDOO EHORZ WKH EDVH FDVH 7&5 IRU VRPH QXPEHUV RI VHOHFWHGDWWULEXWHV7KLVLVGXHWRWKHUHODWLYHLQVHQVLWLYLW\RI%7DQG/50311WRDWWULEXWHVHOHFWLRQ,QWKLVFDVHWKH/50311LVFRQVLGHUHGWREHWKHEHVWSHUIRUPLQJILOWHUZLWKWKHKLJKHVW7&5


17/20


5RCO2TGEKUKQPCPF5RCO4GECNN,QWKLVH[SHULPHQWWKHFODVVLILHUVDUHUXQLWHUDWLYHO\E\DWHQIROGFURVVYDOLGDWLRQSURFHVV7KH63DQV65UDWHVDUHUHFRUGHGLQ7DEOH:HREVHUYHWKDWIRUWKHQRFRVWVFHQDULR

RXUPHWKRG/50311LVIRXQGWRKDYHEHVW63ZKLOHLWV65LVYHU\VLPLODUWRWKHKLJKHVW65RI 1% )RU /50311REWDLQV WKHKLJKHVW 65 DQG VHFRQGKLJKHVW63DIWHU%7DOJRULWKP)LQDOO\LQWKHFDVHRIH[WUHPHO\KLJKPLVFODVVLILFDWLRQFRVW /50311 VLJQLILFDQWO\ RXWSHUIRUPV RWKHU PHWKRGV ZLWK DOO HYDOXDWLRQPHWULFVDUHRIKLJKHVWYDOXHV

0HWKRG O O O65 63 65 63 65 63

1%

:0%/

690

%7 0/3

/50311

7DEOH3UHFLVLRQ5HFDOOHYDOXDWLRQRQ/LQJ6SDPGDWD

%QORWVCVKQPCN'HHKEKGPE[

$SDUWIURPFRPSDULQJSUHFLVLRQUHFDOODQG7&5VFRUHVEHWZHHQFODVVLILHUVZHDOVRPHDVXUHWKHLUFRPSXWDWLRQDOHIILFLHQF\7DEOHVKRZVWKDW:0%/KDGWKHPLQLPXPFRPSXWDWLRQWLPH PLQV IROORZHG E\ 1% /50311 690 0/3 %7 UHVSHFWLYHO\ /50311FDQDFKLHYHFRPSDUDWLYHVSDP SUHFLVLRQDQGUHFDOOZLWKD VKRUWHUFRPSXWDWLRQWLPH PLQV

FRPSDUHGZLWK%7PLQVDQG690PLQV0RUHRYHUFRQVLGHULQJ7&5VFRUHVWKHPRGHOVWKDWUHTXLUHOHVVWLPH:0%/1%WKDQ/50311GRQRWSHUIRUPDVDFFXUDWHO\DV/50311

0HWKRG &RPSXWDWLRQ7LPHPLQV O O O

7&5 7&5 7&51% :0%/ 690

%7 0/3

/50311 7DEOH&RPSXWDWLRQ7LPH0HPRU\VL]HHYDOXDWLRQRQ/LQJ6SDPGDWD,QVXPPDU\WKHPRVWLPSRUWDQWILQGLQJLQRXUH[SHULPHQWLVWKDWWKHSURSRVHG/50311PRGHO FDQ DFKLHYH YHU\ DFFXUDWH FODVVLILFDWLRQ KLJK 7&5 63 65 FRPSDUHG WR RWKHUFRQYHQWLRQDO OHDUQLQJ PHWKRGV 6XFK VXSHULRU SHUIRUPDQFH RI /50311 ZDV REVHUYHGPRVWFOHDUO\IRU WKRXJKLWDOZD\VREWDLQVWKHKLJKHVW7&5DQGYHU\FRPSHWLWLYH6365UDWHVIRURWKHUFDVHVRI 2XUDOJRULWKPDOVRUHTXLUHVUHODWLYHO\VPDOOFRPSXWDWLRQWLPHWRREWDLQFRPSDUDEOHRUHYHQKLJKHUSUHGLFWLYHDFFXUDF\WRRWKHUPHWKRGV


18/20

2CVVGTP4GEQIPKVKQP

%QPENWUKQPUCPF(WVWTG9QTM

,QWKLVFKDSWHUZHSURSRVHGDQRYHODQWLVSDPILOWHULQJIUDPHZRUNLQZKLFKDSSURSULDWH

GLPHQVLRQ UHGXFWLRQ VFKHPHV DQG SRZHUIXO FODVVLILFDWLRQ PRGHOV DUH HPSOR\HG3DUWLFXODUO\ 3ULQFLSDO&RPSRQHQW$QDO\VLVWUDQVIRUPVGDWDWR DORZHUGLPHQVLRQDOVSDFH$WWKHFODVVLILFDWLRQVWDJHZHFRPELQHDVLPSOHOLQHDUUHJUHVVLRQPRGHOZLWKDOLJKWZHLJKWQRQOLQHDUQHXUDOQHWZRUNLQDQDGMXVWDEOHZD\7KLVOHDUQLQJPHWKRGUHIHUUHGWR DV/LQHDU5HJUHVVLRQ 0RGLILHG 3UREDELOLVWLF 1HXUDO 1HWZRUN /50311 FDQ WDNH DGYDQWDJH RI WKHYLUWXHVRIERWK7KDWLVWKHOLQHDUPRGHOSURYLGHVUHOLDEOHJHQHUDOL]DWLRQFDSDELOLW\ZKLOHWKHQRQOLQHDU FDQ FRPSHQVDWH IRU KLJKHU RUGHU FRPSOH[LWLHV RI WKH GDWD $ FRVWVHQVLWLYHHYDOXDWLRQ XVLQJ D SXEOLFO\ DYDLODEOH FRUSXV /LQJ6SDP KDV VKRZQ WKDW RXU /50311FODVVLILHU FRPSDUHV IDYRUDEO\ WR RWKHU VWDWHRIWKHDUW PHWKRGV ZLWK VXSHULRU DFFXUDF\DIIRUGDEOH FRPSXWDWLRQ DQG KLJK V\VWHP UREXVWQHVV (VSHFLDOO\ IRU H[WUHPHO\ KLJKPLVFODVVLILFDWLRQFRVWZKLOHRWKHUPHWKRGVSHUIRUPDQFHGHWHULRUDWHVDV LQFUHDVHVWKH/5

0311GHPRQVWUDWHVDQDEVROXWHO\VXSHULRURXWFRPHEXWUHWDLQVORZFRPSXWDWLRQFRVW/50311DOVR KDVVLJQLILFDQW ORZFRPSXWDWLRQDOUHTXLUHPHQW LHLWVWUDLQLQJWLPHLV VKRUWHUWKDQRWKHUDOJRULWKPVZLWKVLPLODUDFFXUDF\DQGFRVW7KRXJKRXUSURSRVHGPRGHODFKLHYHVJRRG UHVXOWV LQ WKH FRQGXFWHG H[SHULPHQWV LW LV QRW QHFHVVDULO\ WKH EHVW VROXWLRQ IRU DOOSUREOHPV+RZHYHUFRPSDUDWLYHO\KLJKSUHGLFWLYHDFFXUDF\DORQJZLWKORZFRPSXWDWLRQDOFRPSOH[LW\ GLVWLQJXLVK LW IURP RWKHU VWDWHRIWKHDUW OHDUQLQJ DOJRULWKPV DQG SDUWLFXODUO\VXLWDEOHIRUFRVWVHQVLWLYHVSDPGHWHFWLRQDSSOLFDWLRQV

4GHGTGPEGU

$QGURXWVRSRXORV , .RXWVLDV - &KDQGULQRV . 9 3DOLRXUDV * 6S\URSRXORV & '

$Q(YDOXDWLRQRI1DLYH%D\HVLDQ$QWL6SDP)LOWHULQJ3DSHUSUHVHQWHGDWWKH3URFRIWKH(&0/%D\OHU*3HQHWUDWLQJ%D\HVLDQ6SDP)LOWHUV9'09HUODJ'U0XHOOHUH.&DUUHUDV ; 0DUTXH] / %RRVWLQJ 7UHHV IRU $QWL6SDP (PDLO )LOWHULQJ 3DSHU

SUHVHQWHGDWWKH5$1/37]LJRY&KDUN%XOJDULD&RKHQ:/HDUQLQJUXOHVWKDWFODVVLI\HPDLO$$$,6XPS2Q0DFKLQH/HDUQLQJLQ

,QI$FFHVV&UDQRU/)/D0DFFKLD%$6SDP3DSHUSUHVHQWHGDWWKH&RPPXQLFDWLRQVRI

$&0&UDQRU/)/D0DFFKLD%$6SDP3DSHUSUHVHQWHGDWWKH&RPPXQLFDWLRQVRI

$&0

'UXFNHU + :X ' 9DSQLN 9 1 6XSSRUW 9HFWRU 0DFKLQHV IRU 6SDP&DWHJRUL]DWLRQ,(((7UDQVDFWLRQV2Q1HXUDO1HWZRUNV+D\HV0+6WDWLVWLFDO'LJLWDO6LJQDO3URFHVVLQJDQG0RGHOLQJ-RKQ:LOH\6RQV

,QF+VX&:&KDQJ&&/LQ-&/,%690DOLEUDU\IRUVXSSRUWYHFWRUPDFKLQHV

IURPKWWSZZFVLHQWXHGXWZaFMOLQOLEVY-ROOLIIH,73ULQFLSOH&RPSRQHQW$QDO\VLVHG1HZ


19/20


6DKDPL 0 6 'XPDLV ' +HFNHUPDQ DQG ( +RUYLW] $ %D\HVLDQ $SSURDFK WR)LOWHULQJ-XQN (0DLO 3DSHU SUHVHQWHG DW WKH /HDUQLQJ IRU 7H[W&DWHJRUL]DWLRQ $$$,7HFKQLFDO5HSRUW:6

6DNNLV * $QGURXWVRSRXORV , 3DOLRXUDV * .DUNDOHWVLV 9 6S\URSRXORV & ' 6WDPDWRSRXORV 3 $ 0HPRU\%DVHG $SSURDFK WR $QWL6SDP )LOWHULQJ IRU0DLOLQJ/LVWV3DSHUSUHVHQWHGDWWKH,QIRUPDWLRQ5HWULHYDO

6FKDSLUH 5 ( 6LQJHU


20/20

2CVVGTP4GEQIPKVKQP

intech-spam recognition using linear regression and radial basis function neural network

Documents