,QWHUQDWLRQDO&RQIHUHQFHRQ$GYDQFH&RPSXWLQJDQG,QQRYDWLYH7HFKQRORJLHVLQ(QJLQHHULQJ ,&$&,7( 

'HSDUWPHQWRI(OHFWULFDO (OHFWURQLFV(QJLQHHULQJ*DOJRWLDV&ROOHJHRI(QJLQHHULQJDQG7HFKQRORJ\*U1RLGD,QGLD

,PDJH5HFRJQLWLRQ8VLQJ$UWLILFLDO,QWHOOLJHQFH
VW 0DQLVK.XPDU QG 6LGGKDUWK6KDUPD UG 'LY\&KDXGKDU\ WK 63UDNDVK
6FKRRORI&RPSXWLQJ6FLHQFH 6FKRRORI&RPSXWLQJ6FLHQFH 6FKRRORI&RPSXWLQJ6FLHQFH 6FKRRORI&RPSXWLQJ6FLHQFH
2021 International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE) | 978-1-7281-7741-0/20/$31.00 ©2021 IEEE | DOI: 10.1109/ICACITE51222.2021.9404606

(QJLQHHULQJ (QJLQHHULQJ (QJLQHHULQJ (QJLQHHULQJ

*DOJRWLDV8QLYHUVLW\ *DOJRWLDV8QLYHUVLW\ *DOJRWLDV8QLYHUVLW\ *DOJRWLDV8QLYHUVLW\
*UHDWHU1RLGD8WWDU3UDGHVK *UHDWHU1RLGD8WWDU3UDGHVK *UHDWHU1RLGD8WWDU3UDGHVK *UHDWHU1RLGD8WWDU3UDGHVK
PDQLVK#JPDLOFRP LWVVPHVGGKDUWK#JPDLOFRP GLY\FK#\DKRRLQ VSUDNDVK#JDOJRWLDVXQLYHUVLW\HGXLQ

Abstract² 7KHOHDGLQJ LQWHQWLRQ RIWKH SURMHFWLVWRSURYLGHD ,PDJH UHFRJQLWLRQ SURWRW\SH LQVWUXFWHG RQ LPDJH WKDW
QHZ DSSURDFK IRU LPDJH UHFRJQLWLRQ XVLQJ 3\WKRQ DQG LWV VTXDUHPHDVXUHWDJJHGDV³FULFNHWEDW´RU³QRWDFULFNHWEDW´
OLEUDU\LQZKLFKZHH[WHQVLYHO\XVHS\WKRQOLEUDULHVOLNHQXPS\ DVDGGLWLRQDOO\H[DPSOHGE\>@
%LQJLPDJHGRZQORDGHUPDWSORWOLEVNOHDUQDQGVHYHUDORWKHUV
DV ZHOO IRU WKH XVH RI PDFKLQH OHDUQLQJ DQG LWV SURSHUWLHV OLNH 3URWRW\SH,QSXW,PDJHRUSLFWXUHIUDPH
VXSSRUWYHFWRUPDFKLQH 690  $QLPDJHUHFRJQLWLRQWHFKQLTXH
XWLOL]LQJ DD LQIR RI LPDJH FKDUDFWHULVWLFV LV LQWURGXFHG WKLV 3URWRW\SH 2XWSXW 8QLW QDPH LH FULFNHW EDW  ZLWK D
^PHWKRG`LVWRWDOO\GLIIHUHQWIURPFKHPLVWLPDJHPHWKRGZKLFK FRQILGHQFH VQLFN WKDW UHVXOWV WKH SURVSHFW RI WKDW SLFWXUH
QHHGV DQ RXWVL]HG TXDQWLW\ RI NQRZOHGJH RI FRDFKLQJ VHW KDYLQJ WKDWXQLW RIREMHFW
SLFWXUHVLQWHUPVRIWKHGLPHQVLRQVRIHYHU\LPDJHDQGDOVRWKH
ZKDWUHDVRQDEO\SLFWXUHVDUHWKH\YHU\(VSHFLDOO\WKLVV\VWHP
>@  >@ RXWOLQHG 3LFWXUH UHFRJQLWLRQ LV DOVR DQ
LVKHOSIXOIRUUHFRJQL]LQJSLFWXUHVWKDWKDYHIDVWHQHGIRUPDQG H[WHQVLYHDQGIDUUHDFKLQJ FKRUHWKDW¶VJLYHVXVDQLGHDDERXW
VWUXFWXUH OLNH SDLQWLQJV DQG GRFXPHQWV 7KHQ ZH KDYH D SLFWXUH UHFRJQLWLRQ $V VXFK WKHUH DUH D XQLW NLQG RI PDLQ
WHQGHQF\ WR FUHDWH XVH QHXUDO QHWZRUN WKDW SURFHVVHV WKH IHDWXUHV WKDW QHHGV WR EH FUHDWHG RQFH DOO LQ DOO ZKDW
LQGLYLGXDOSL[HOVRIDSLFWXUH UHVROXWLRQLVIRUHPRVWIRUWKHPDWWHUZH¶UHHQJDJLQJ
Keywords—Python, Artificial Intelligence, Image Processing. ,Q JHQHUDO ZH WHQG WR VTXDUH PHDVXUH DEOH WR GLVMRLQW
SLFWXUH UHFRJQLWLRQ LQWR WZR GLIIHUHQW DQRPDOLHV VLQJOH DQG
, ,1752'8&7,21 PXOWLFODVVUHFRJQLWLRQ,QRQHVLQJOH XQLWSLFWXUHUHFRJQLWLRQ
SURWRW\SHV UHVXOW MXVW RQH WDJ SHU SLFWXUH ,I ZH¶UH
,PDJH UHFRJQLWLRQ FRXOG DOVR EH D SRUWDEOH FRPSXWHU HPSOR\PHQW DFULFNHWEDWRUPRQLWRUUHFRJQLWLRQSURWRW\SH D
QHFHVVLW\WHFKQLTXHWKDWDOORZVFRPSXWHUVODSWRSVDQGRWKHU SLFWXUH ZLWK D FULFNHW EDW DQG D PRQLWRU ZLOO VWLOO DORQH EH
VLPLODUHOHFWULFDORUHOHFWURQLFGHYLFHVRUV\VWHP WRLQWHUSUHW DSSRLQWHG RQHWDJ
DQG UHDVRQ ZKDW ZH DOO ³VHH´ LQ IRRWDJH RU FDQQHG DV LQ
>@XVXDOO\ FLWHG DV ³SLFWXUH FDWHJRUL]DWLRQ´ RU ³SLFWXUH ,QFDVHVZKHUHDORQHWZRXQLWVRIPHDVXUHPHQWLQYROYHG
WDJJLQJ´WKLVFUXFLDO WDVNFRXOGDOVREHDKHUPHQHXWLFDO KDOI FULFNHW EDW QRW D FULFNHW EDW  ZH¶YH JRW D EHQW WR KXQW
ILQG VHYHUDO SRUWDEOH FRPSXWHUV ODSWRSV DQG RWKHU VLPLODU UHFRPPHQGDWLRQIURPWKLV
HOHFWULFDORUHOHFWURQLF GHYLFHVRUV\VWHP OHDUQLQJDQRPDOLHV
KRZHYHU DOVR FDQ SLFWXUH UHFRJQLWLRQ UHDOO\ ZRUN" :KDW ,, /,7(5$785(6859(<
DUHDXQLWWKHDVVRUWHGSHUVSHFWLYH ZKDWDUHDXQLWLWVSUREDEOH
SURV DQG FRQVDQGWKHUHIRUHWKHDSSURDFKFRXOG\RXVHHLWLQ &RPSXWHUVODSWRSVDQGRWKHUVLPLODUNLQGRIHOHFWULFDORU
\RXUWUDGH" HOHFWURQLFGHYLFHVRUV\VWHPV H[HUWLRQV E\SUDFWLFHDVVRFLDWH
IRUPXOD DQG VHQVRUV WR H[SHUWLVH KXPDQ YLVXDO LPDJH WR
,Q WKLV FRQILGDQW HYHU\RQH XQGHUVWDQGV UHMRLQGHU WR DQ\ LQVWLQFWLYH WDNH RXW QHFHVVDU\ LQIRUPDWLRQ IURP DVVRFLDWH
RU HQWLUH TXHULHV DQG D JUHDW GHDO RI ZKHWKHU RU QRW RU QRW REMHFW&RPSDUHGWRWUDGLWLRQDOZD\VWKDWWDNHDOHQJWK\ WLPH
\RXU DVVRFLDWHGHJUHH NQRZOHGJHDEOH H[SHUW V\VWHP SODQQHU DQG ZLVK UHILQHG DQDO\VLV SF WKHPDQQHU RI WU\LQJ WKH VWDWH
RUKDQGOHU DOOLQDOO H[HFXWLRQDQLQLWLDWRU GHVLURXVWRDFTXLUH RI DIIDLUV KDV EHHQ EURDGHQHG RI WHFKQRORJ\ DUWLILFLDO
D JUHDW GHDO RI RU D E\SURGXFW VXSHUYLVRU GHVLURXV WR LQWHOOLJHQFH DQG H[SHUWLVH KXPDQYLVXDO LPDJH
WUDYHUVHZKDW¶VUHDOL]DEOHZLWKODSWRSVFRPSXWHUVDQGRWKHU
VLPLODUNLQGRIHOHFWULFDORUHOHFWURQLFGHYLFHVRUV\VWHPVDQG ,W FRQMRLQWO\ WR SURGXFH H[WUHPHO\ IDVW V\VWHPV WR FRPH
LPDJHUHFRJQLWLRQWKLVFRQILGDQW LVIRU\RX XS ZLWK LPDJH SURFHVVLQJ FRQWLQXLQJ ZLWK SLFWXUH WKDW DUH
FDSDEOHWRDGGLWLRQDOGHWDLOWKHGLIIHUHQWDQDO\VLVRILPDJHV
>@ SURMHFWHG WKDW ,PDJH UHFRJQLWLRQ FRXOG DOVR EH D LV   LPDJH LQWURGXFWLRQ GXH WR WKLV ZH FDQ DEOH WR JHW
ODSWRS FRPSXWHUV DQG RWKHU VLPLODU HOHFWULFDO RU HOHFWURQLF GDWDVHWVRILPDJHVRIDSDUWLFXODUREMHFW LPDJHVFDQQLQJ
GHYLFHV RU V\VWHPV FKRUH WKDW RSHUDWHV WR NQRZ DQG UHDVRQ ZKHUHWKHTXDOLW\RIWKHSDUWLFXODUVFDQQHGLPDJHLVJRLQJWR
QXPHURXVSDUWVRISLFWXUHV DQGRUFDQQHG,PDJHUHFRJQLWLRQ EH DFFXUDWHO\ FRUUHFW   LPDJH VXEGLYLVLRQ DPRQJ WKDW WKH
SURWRW\SH XQLW RI PHDVXUHPHQWV LQVWUXFWHG WRQHHG DSLFWXUH DUWLFOH LPDJH LV NQRZQ DQG VHSDUDWHG IURP WKH EDFNHQG  
DV DQ LQSXW DQG DQ RXWSXW WDJV QDUUDWLQJ WKH SLFWXUH 7KH SLFWXUH PHDVXULQJ ZKHUHYHU PDQ\ LPSRUWDQW IHDWXUHV DUHD
JURXS RI DFKLHYDEOH RXWSXW WDJV XQLW RI PHDVXUHPHQWV FLWHG XQLW PHDVXUH DQG   LPDJH LQWHUSUHWDWLRQ ZKHUH WKH LQSXW
DVWDUJHWFODVVHVDVJLYHQE\>@DQGLQFRQMXQFWLRQHVFRUWHG SLFWXUHGVTXDUHPHDVXUH WKHQXQGHUVWRRG
E\ D SURSKHV\ XQLW SLFWXUH UHFRJQLWLRQ SURWRW\SH DOVR FDQ
UHVXOW DFRQILGHQFHVQLFN UHODWHGWREXWFHUWDLQWKHSURWRW\SH ,PDJH UHFRJQLWLRQ DV D SDUW RI GRLQJ VRPHWKLQJ
LVWKDWDSLFWXUHEHLQWRDXQLW H[WUDRUGLQDULO\ E\ JHWWLQJ NQRZQ WR D SDUWLFXODU NLQG RI
LPDJH LQ D GHILQLWH ZD\ DV UHFRJQLWLRQ WKURXJK SLFWXUH
)RU FLWH LI ZH UHTXLUHG WR IRUP D SLFWXUH UHFRJQLWLRQ DOWHUDWLRQWRLQGXFH EHVWLPDJHVWDWXV DQGLPDJHDQDO\VLV
SURWRW\SH WKDW LQVWLQFWLYHO\ ILQGV ZKHWKHU RU QRW RU QRW DQ
LPDJH GRJ ZDV WHUULEO\` YHU\ JLYHQ LPDJH WKH SLSHOLQH +HUH PHWKRG SRLQW WR WDNH RXW LQIR WR FUHDWH VHOHFWLRQV
ZRXOGORRVHO\VHHPDVLIWKLV VXSSRUWHG SLFWXUHV JHWWLQJ ZLWK WKH KHOS RI VHQVRUV ,Q
GLIIHUHQW ZD\ LI ZH WDON DERXW WKH SURMHFW WKDW FDQ EH
DFFRPSOLVKHGE\XV LVQRQHRWKHUWKDQ WKH ZD\RINQRZLQJ

‹,((( 

Authorized licensed use limited to: California State University Fresno. Downloaded on June 27,2021 at 02:52:25 UTC from IEEE Xplore. Restrictions apply.
 ,QWHUQDWLRQDO&RQIHUHQFHRQ$GYDQFH&RPSXWLQJDQG,QQRYDWLYH7HFKQRORJLHVLQ(QJLQHHULQJ ,&$&,7( 
'HSDUWPHQWRI(OHFWULFDO (OHFWURQLFV(QJLQHHULQJ*DOJRWLDV&ROOHJHRI(QJLQHHULQJDQG7HFKQRORJ\*U1RLGD,QGLD

WKHH[DFWLPDJHLGHQWLILFDWLRQE\UHFRJQL]LQJLWDVDFFXUDWHDV WHFKQRORJ\ZKRMXVWNQRZKRZWR XVHGHVNWRSRUODSWRS,Q

SRVVLEOH DVSURSRVHGE\>@6RIRUWKDWZHXVHS\WKRQDQG WKLVSURMHFWZHKDYHVRPHGDWDVHWVRILPDJHVRIDSDUWLFXODU
LWV OLEUDULHV LQ ZKLFK ZH XVH S\WKRQ DQG LWV OLEUDULHV OLNH LPDJHRUREMHFWWRZKLFKZHDUHJRLQJWRUHFRJQL]HLWVQDPH
QXPS\ ± IRU PDWKHPDWLFDO FRPSXWDWLRQV PDWSORWOLEIRU VRILUVWRIDOOZHPDNHXVRI%LQJLPDJHGRZQORDGHUWKURXJK
SORWWLQJJUDSKVRIDQ\SDUWLFXODULPDJHVNOHDUQIRUPDNLQJ WKLVZHFDQGRZQORDGDQ\QXPEHURIGDWDVHWVLPDJHVDVZH
XVHRIVRPHRIWKHEHVWDOJRULWKPRIPDFKLQHOHDUQLQJ)LUVW ZDQWDQGWKHQDIWHUWKDWE\PDNLQJXVHRIQXPS\PDWSORWOLE
RI DOO ZH LQVWDOO %LQJ LPDJH GRZQORDGHU ± RQH RI WKH DQG VNOHDUQ ZH DQDO\]H WKH GDWDVHWV RI LPDJHV DQG GRQH
OLEUDULHV RIS\WKRQGXHWRWKLVZHFDQGRZQORDGDQ\QXPEHU QXPHULFDOFRPSXWDWLRQVDQGDIWHUJHQHUDWLQJHUURUPDWUL[ZH
RI LPDJHV DV ZH ZDQW GLUHFWO\ WKURXJK WKH LQWHUQHW RI D FDQ VLPSO\ WHOO WKH QDPH RI LPDJH DV SUHGLFWHG RXWSXW ZLWK
SDUWLFXODULPDJHRUREMHFW6REDVLFDOO\ ZHSURFHHGIRUZDUG PRUHDFFXUDF\
LQRUGHUWRSURFHHGRXUZRUNLQSRVLWLYHGLUHFWLRQVRQRZZH
DUH QRZ ORRNLQJ IRU VRPH RWKHU S\WKRQ OLEUDULHV WR EH XVHG 'DWDVHWV
DIWHU LQVWDOOLQJ WKHP IURP SLS DV GLUHFW S\WKRQ OLEUDULHV VR 0RQLWRUV'DWDVHWV
DIWHUVXFFHVVIXOO\GRZQORDGLQJWKHOLEUDULHVRIS\WKRQZHDUH
QRZJUHDWWRJRZLWKWKHSURMHFW>@KDVGRQHLWLQ ZD\1RZ
ZH VLPSO\ VWDUW WR GRZQORDG WKH GDWDVHWV RI RXU ILUVW
SDUWLFXODULPDJHOLNHFULFNHWEDWVR%LQJLPDJHGRZQORDGHU
QRZ FRPHV LQWR DQ DFWLRQ DQG GRZQORDGLQJ WKH LPDJHV DV
VRPHGDWDVHWVOLNHRUPRUHDVZHZDQWDQGWKDW¶VKRZ
VLPLODUO\ ZH FDQ EH GRZQORDGLQJ WKH LPDJHV RI GDWDVHWV
HDVLO\
7KHQ DIWHU GRZQORDGLQJ WKH GDWDVHWV RI LPDJHV ZH DUH
JRRGWRSURFHHGIXUWKHUOLNHQRZZHDUHJRLQJWRLPSOHPHQW
VRPH QXPHULFDO FRPSXWDWLRQV RI DOO RXU GDWDVHWV ZKLFK FDQ
EH GRQH E\ DQRWKHU S\WKRQ OLEUDU\ ZKLFK LV QXPS\ E\ WKH
XVHRIQXPS\ZHFDQH[WHQVLYHO\LGHQWLILHVDQGDQDO\]HRXU
LPDJHVRIGDWDVHWVRIDSDUWLFXODUREMHFWRULPDJHDQGWU\WR
VROYHWKHLUQXPHULFDOYDOXHVFRPSXWDWLRQDOO\DQGIRUWKDWZH )LJ 'DWDVHWLPDJHRI0RQLWRU
FDQ DOVR XVH VRPH EHVW DOJRULWKPV ZKLFK DUH RI PDFKLQH
OHDUQLQJDQGE\JHWWLQJXVHRIWKHVHWKLQJVZHFDQHIILFLHQWO\
PDNHRXUSURMHFWZRUNH[DFWO\DVZHZDQWVLWWREH E\>@
([DPSOH%URDGO\VSHDNLQJZHWHQGWRVTXDUHPHDVXUHDEOH
WR GLVMRLQW SLFWXUH UHFRJQLWLRQ LQWR WZR GLIIHUHQW DQRPDOLHV
VLQJOHDQGPXOWLFODVV UHFRJQLWLRQ>@GHILQHVLWLQRQHVLQJOH
XQLW SLFWXUH UHFRJQLWLRQ SURWRW\SHV UHVXOW MXVW RQH WDJ SHU
SLFWXUH ,I ZH¶UH HPSOR\PHQW D FULFNHW EDW RU PRQLWRU
UHFRJQLWLRQ SURWRW\SH D SLFWXUH ZLWK D FULFNHW EDW DQG D
PRQLWRU ZLOO VWLOODORQH EHDSSRLQWHG RQHWDJ
,QFDVHVZKHUH DORQHWZR XQLWVRIPHDVXUHPHQW LQYROYHG
FULFNHW EDW QRW D FULFNHW EDW  ZH¶YH JRW D EHQW WR KXQW
UHFRPPHQGDWLRQIURPWKLV
1RZILQDOO\LIZHWDONDERXWWKHHQGUHVXOWRIRXUSURMHFW )LJ'DWDVHWLPDJHRI0RQLWRU
WKHQ LW LV REYLRXVO\ TXLHW REYLRXV WKDW ZH DUH JRLQJ WR
JHQHUDWHSUHGLFWHGRXWSXWZKLFKZLOOWHOOXVWKHQDPHRIWKH
LPDJHEXWEHIRUHWKDWDVZHDOONQRZWKDWHYHU\V\VWHPKDV &ULFNHW%DW'DWDVHWV
VRPHHUURUVDOWKRXJKZKLFKFDQEHQHJOLJLEOH6RIRUWKDWZH
XV S\WKRQ DQG LWV OLEUDULHV DORQJ ZLWK DUWLILFLDO LQWHOOLJHQFH
DQGLWVDOJRULWKPDVGHILQHGE\>@DQGPDNHDQHUURUPDWUL[
ZKLFKZLOOJRLQJWR WHOOXV WKHHUURUVLQDOO D[HVDQGILQDOO\
ZH JRW RXWSXW DV SUHGLFWHG QDPH RI DQ\ LPDJH ZLWK PRUH
DFFXUDF\

,,, 0(7+2'2/2*<
,Q VLPSOH ZRUGV LI ZH WDON DERXW RXU SURMHFW WKHQ LW¶V
VLPSOHSURMHFWRI,PDJH5HFRJQLWLRQLQZKLFKZHH[WHQVLYHO\
XVHS\WKRQDQGLWVOLEUDULHVDORQJZLWK$UWLILFLDO,QWHOOLJHQFH
DQG LWV DOJRULWKP :H EDVLFDOO\ XVH VXSSRUW YHFWRU PDFKLQH
IRUKDQGOLQJDOOWKHSURSHULPSOHPHQWDWLRQVWKDWZHDUHJRLQJ
WR GR WKLV LQ RXU SURMHFW ZKLFK PDNHV RXU SURMHFW
WUHPHQGRXVO\ XQLTXH DQG DWWUDFWHG DQG DOVR XVHU IULHQGO\
DOWKRXJKLW¶VDOODERXWS\WKRQDQGLWVOLEUDULHVZHPDNHVXUH
WKDWLWZLOOEHDVVLPSOHDVWKDWZKLFKLVUHDOO\HIILFLHQWDQG )LJ 'DWDVHWLPDJHRI&ULFNHW%DW
HDV\ WR XVH E\ HYHU\RQH ZKR LV OLWWOH ELW IDPLOLDU ZLWK



Authorized licensed use limited to: California State University Fresno. Downloaded on June 27,2021 at 02:52:25 UTC from IEEE Xplore. Restrictions apply.
 ,QWHUQDWLRQDO&RQIHUHQFHRQ$GYDQFH&RPSXWLQJDQG,QQRYDWLYH7HFKQRORJLHVLQ(QJLQHHULQJ ,&$&,7( 
'HSDUWPHQWRI(OHFWULFDO (OHFWURQLFV(QJLQHHULQJ*DOJRWLDV&ROOHJHRI(QJLQHHULQJDQG7HFKQRORJ\*U1RLGD,QGLD

)LJ'DWDVHWLPDJHRI&ULFNHW%DW

,9 $1$/<6,6
)LJ3UHGLFWHGRXWSXWLPDJHRI&ULFNHW%DW
3+$6(,
3KDVH , ZLOO FRPSULVH RI YDULRXV VWUDWHJLHV DQG SODQ
DERXWSURMHFW 9, /,0,7$7,216 6&23(
L )LQDOL]LQJ 3URMHFW 'HWDLOV DUH RQH RI WKH PRVW
LPSRUWDQWWKLQJLQSKDVH,RISURMHFW
x 'LIILFXOWLHV DULVHV GXH WR VRPH WHFKQLFDO UHDVRQV
LL )XUWKHU VHWWLQJ XS FOHDU H[SHFWDWLRQV LH FKHFNLQJ
OLNH ODFN RI HOHFWURQLF JDGJHWV OLNH FRPSXWHU
WKDW ZH KDYH HYHU\WKLQJ ZKLFK FDQ OHDG XV WR
ODSWRSHWF
VXFFHVVIXOGHYHORSPHQWRIDSSOLFDWLRQ
LLL &KRRVLQJWKHULJKWWHDPDQGV\VWHPDOVRSOD\VDYLWDO x 7KHSUREOHPDULVHVGXHWRODFNRIHOHFWULFLW\VXSSO\
UROHLQDSSOLFDWLRQGHYHORSPHQWRISKDVH, LQVRPHUXUDODUHDV
LY 7KHQ GHILQLQJ 0LOHVWRQHV ZKLFK LQFOXGHV LQLWLDWLRQ x 3UREOHPVGXHWR ODFNRINQRZOHGJHDERXWZKDWLWLV
RISURMHFWSODQQLQJH[HFXWLRQDQGFORVXUH H[DFWO\ DQG WU\LQJ WR OHDUQ LW IURP GLUHFWO\ DW WKH
Y 0DQDJLQJ WKH SURMHFW ULVNV LH NHHSLQJ WKH EDFNXS WLPH RI LWV LPSOHPHQWDWLRQV LV QRW VR HDV\ DV LW
SODQVUHDG\IRUSUHYHQWLQJVWXFNVLWXDWLRQLQSURMHFW ORRNV
YL $YRLGLQJVFRSHFUHHSLHWRNHHSLQJSURMHFWRQWUDFN x 1RWEHQHILFLDOLQWKRVHDUHDVZKHUHWKHUHLVQRQHHG
RILW
3+$6(,, x /LPLWDWLRQV DOVR FRPHV LQWR DQ DFWLRQ ZKHQ
VRPHRQHKDVOLWHUDOO\QRSULRUNQRZOHGJHRIXVLQJ
1RZ 3KDVH ,, ZLOO EH GHSOR\PHQW RI RXU LPDJH HOHFWURQLFGHYLFHVOLNHGHVNWRSODSWRSHWF
UHFRJQLWLRQSURMHFW
,Q WKLV SKDVH ZH ZLOO EH JRLQJ XQGHU YDULRXV SURFHVVHV $VZHNQRZWKDWRXUSURMHFWLVEDVLFDOO\,PDJHUHFRJQLWLRQ
OLNH GHWHFWLQJ LPDJH UHFRJQL]LQJ LPDJH FUHDWH GDWDVHWV XVLQJ$UWLILFLDOLQWHOOLJHQFHVRLWFOHDUVE\LWVQDPHWKDWLWLV
DSSO\LQJWKHULJKWDOJRULWKPWRWUDLQWKHGDWDVHWVDQGILQDOO\ VRPHWKLQJ ZKLFK LV UHODWHG WR RQO\ DQG RQO\ LPDJH RI DQ\
XSORDGLQJWKHGDWDVHWVWKHUHE\UHFRJQL]LQJLPDJHV NLQG RI SDUWLFXODU LPDJH RU REMHFW ZKLFK ZH ZDQW WR NQRZ
WKDW ZKDW LV H[DFWO\ LI DQG RQO\ LI ZH GRQ¶W NQRZ DERXW LW
6WHS  *HWWLQJ GDWDVHWV RI LPDJH IURP %LQJ LPDJH
GRZQORDGHUDQGWKHQDIWHUDQDO\]LQJWKHPDSSURSULDWHO\RQH 6R EDVLFDOO\ RXU SURMHFW LV DOO DERXW E\ PDNLQJ XVH RI
E\RQHDQGDIWHUFRPSOHWLQJQXPHULFDOFRPSXWDWLRQVRQWKHP WHFKQRORJ\LIZHZDQWWRNQRZLGHQWLILFDWLRQRIDQ\LPDJH
ZHDUHJRRGWRSURGXFHSUHGLFWHGRXWSXWDVUHVXOW WKHQRXUSURMHFWZRXOGKDYHGRQHWKLVMREIRU\RXZLWKJUHDW
DQGYDVWDFFXUDF\
6WHS  ,Q WKLV VWHS ZH DUH PRYH IRUZDUG WR VRPH
WHFKQLFDO JOLWFK WKDW HYHU\ V\VWHP KDV DQG WR RYHUFRPH WKLV
SUREOHPZHPDNH XVHRIHUURUPDWUL[ZKLFKWHOOVXVDERXWWKH 9,, &21&/86,21
HUURUVLQRXUSURMHFWDQGJLYHVXVPRUHDFFXUDWHUHVXOWV :LWKWKHDVVLVWDQFHRIGHHSOHDUQLQJDOJRULWKPDQGQHXUDO
QHWZRUNV PDFKLQHV PD\ EH LQVWUXFWHG WR H[DPLQHV DQG
LQWHUSUHW SLFWXUHV ZLWKLQ WKH PDQQHU QHHGHG IRU D VSHFLILF
WDVN 3URJUHVVZLWKLQWKHLPSOHPHQWDWLRQRI$,EDVHGLPDJH
9 5(68/7
SURFHVVLVVSHFWDFXODUDQGRSHQVDODUJHYDU\RIRSSRUWXQLWLHV
7RPDNHLWHDVLHUWRXVHWKHVHWHFKQLTXHVVWLOORQLPSOHPHQW LQ ILHOGV IURP PHGLFDWLRQ DQG DJULFXOWXUH WR UHWDLO DQG
$,EDVHG LPDJH SURFHVV IXQFWLRQDOLWLHV LQ \RXU SURGXFW HQIRUFHPHQW $SULRULW\ VSHFLDOLVWV IURP WKH VXEVWLWXWH
\RX¶OOXVHVSHFLILFOLEUDULHVDQGIUDPHZRUNVZLWKLQWKHQH[W LQWHOOLJHQFH WHDP DUH H[WUDRUGLQDU\ LQWHUHVWHG E\ $, DQG
VHFWLRQZHKDYHDWHQGHQF\WRWDNHDJODQFHDWDQXPEHURI PDFKLQHOHDUQLQJWKHUHIRUHZHWHQGWRNHHSWUDFNRIWKHPRVW
WKH IRUHPRVW VWDQGDUG $6&,, WH[W ILOH OLEUDULHV IRU UHFHQW HQKDQFHPHQWV LQ $,SRZHUHG LPDJH SURFHVV DQG XVH
DFFRPSOLVKLQJ FRPSOHWHO\ GLIIHUHQW LPDJH SURFHVV WDVNV WKLVLQIRUPDWLRQRQFHSHUIRUPLQJRQRXU$,FRPHV,QVLPSOH
ZLWKWKHDVVLVWDQFHRI$,DOJRULWKPV ZRUGVLIZHWDONDERXWRXUSURMHFWWKHQLW¶VVLPSOHSURMHFWRI



Authorized licensed use limited to: California State University Fresno. Downloaded on June 27,2021 at 02:52:25 UTC from IEEE Xplore. Restrictions apply.
 ,QWHUQDWLRQDO&RQIHUHQFHRQ$GYDQFH&RPSXWLQJDQG,QQRYDWLYH7HFKQRORJLHVLQ(QJLQHHULQJ ,&$&,7( 
'HSDUWPHQWRI(OHFWULFDO (OHFWURQLFV(QJLQHHULQJ*DOJRWLDV&ROOHJHRI(QJLQHHULQJDQG7HFKQRORJ\*U1RLGD,QGLD

,PDJH5HFRJQLWLRQLQZKLFKZHH[WHQVLYHO\XVHS\WKRQDQG WRH[SUHVVRXUVSHFLDOWKDQNVRIJUDWLWXGHWRKLPEHFDXVHKLV
LWV OLEUDULHV DORQJ ZLWK $UWLILFLDO ,QWHOOLJHQFH DQG LWV FRQVLVWHQWO\ PDNLQJ XV FRQIRUPDEOH LQ ZKDWHYHU ZH DUH
DOJRULWKP :H EDVLFDOO\ XVH VXSSRUW YHFWRU PDFKLQH IRU GRLQJDQGDOVRGXHWRDOZD\VPRWLYDWHXVLQRUGHUPDNHRXW
KDQGOLQJDOOWKHSURSHULPSOHPHQWDWLRQVWKDWZHDUHJRLQJWR EHVWRIRXUVHOYHVDQGODVWEXWQRWWKHOHDVWDJHQXLQHWKDQNV
GRWKLVLQ RXUSURMHFWZKLFKPDNHVRXUSURMHFWWUHPHQGRXVO\ WRKLPWRJLYHXVDFKDQFHWRPDNHJRRGSURMHFWRQRQHRI
XQLTXH DQG DWWUDFWHG DQG DOVR XVHU IULHQGO\ DOWKRXJK LW¶V DOO WKH EHVW WRSLF ,PDJH 5HFRJQLWLRQ XVLQJ $UWLILFLDO
DERXWS\WKRQDQGLWVOLEUDULHVZHPDNHVXUHWKDWLWZLOOEHDV ,QWHOOLJHQFH
VLPSOH DV WKDW ZKLFK LV UHDOO\ HIILFLHQW DQG HDV\ WR XVH E\
HYHU\RQHZKRLVOLWWOHELWIDPLOLDUZLWKWHFKQRORJ\ZKRMXVW
NQRZKRZWRXVHGHVNWRSRUODSWRS,QWKLVSURMHFWZHKDYH ,; 5()(5(1&(6
VRPH GDWDVHWV RI LPDJHV RI D SDUWLFXODU LPDJH RU REMHFW WR >@ 3RRMD 6KDUPD *XUSUHHW 6LQJK $PDQGHHS .DXU ³GLIIHUHQW
ZKLFKZHDUHJRLQJWRUHFRJQL]HLWVQDPHVRILUVWRIDOOZH WHFKQLTXHV RI HGJH GHWHFWLRQ LQ GLJLWDO LPDJH SURFHVVLQJ´
PDNH XV RI %LQJ LPDJH GRZQORDGHU WKURXJK WKLV ZH FDQ 5HVHDUFK DQG $SSOLFDWLRQV ,-(5$  ,661  9RO 
GRZQORDG DQ\ QXPEHU RI GDWDVHWV LPDJHV DV ZH ZDQW DQG ,VVXH0D\-XQSS
WKHQ DIWHU WKDW E\ PDNLQJ XVH RI QXPS\ PDWSORWOLE DQG >@ ( 2MD 6XEVSDFH 0HWKRGV RI 3DWWHUQ 5HFRJQLWLRQ 5HVHDUFK
VNOHDUQ ZH DQDO\]H WKH GDWDVHWV RI LPDJHV DQG GRQH 6WXGLHV3UHVV
QXPHULFDOFRPSXWDWLRQVDQGDIWHUJHQHUDWLQJHUURUPDWUL[ZH >@ . . 6LQJK $ 6LQJK ³$ 6WXG\ RI ,PDJH 6HJPHQWDWLRQ
FDQ VLPSO\ WHOO WKH QDPH RI LPDJH DV SUHGLFWHG RXWSXW ZLWK $OJRULWKPV IRU 'LIIHUHQW 7\SHV RI ,PDJHV´ ,QWHUQDWLRQDO
-RXUQDORI&RPSXWHU6FLHQFH,VVXHVYROSS6HSWHPEHU
PRUHDFFXUDF\ 
>@ * $O.LQGL . *LOO DQG 5 %DXO $Q ([DPSOH RI $XWRPDWLF
7ZR 'LPHQVLRQDO &RPSRQHQW ,QVSHFWLRQ 8VLQJ &RPSXWHU
:H GHYHORS $, DQG GHHS OHDUQLQJ VROXWLRQV VXSSRUWHG WKH 9LVLRQ3URF,QVWQ0HFK(QJUV8.9RO3DUW%
PRVW UHFHQW DQDO\VLV LQ LPDJH SURFHVV DQG YLFWLPL]DWLRQ >@ ,QWHUQDWLRQDO -RXUQDO RI 6FLHQWLILF DQG 5HVHDUFK 3XEOLFDWLRQV
IUDPHZRUNV OLNH %LQJ LPDJH GRZQORDGHU QXPS\ DQG 9ROXPH,VVXH0D\,661
VNOHDUQRQFHWKHXOWLPDWH$,PRGHOLV SUHSDUHGDQGDFOLHQW >@ ==KDQJDQG*=KDR³%XWWHUZRUWK)LOWHUDQG6REHO(GJH
LVJODGZLWKWKHUHVXOWVZHWHQGWRIDFLOLWDWHWKHPLWLQWRDQ\ 'HWHFWLRQ  WR ,PDJH´   ,QW  &RQI 0XOWLPHG 7HFKQRO
SODWIRUP IURP GHVNWRS DQG PRELOH WR QHW FORXG DQG ,R7 ,&07SS±
*HW LQ JULSV ZLWK 86 DQG ZH¶OO IDLQ DVVLVW \RX LQ >@ 6FKZDU]*6FKZDU]0DQG6FKQHFN8  (IIHFWRI
WKH  VSHFLDO  SURSHUWLHV  RI PRQROD\HU  FHOO  SUHSDUDWLRQV  IRU
LPSOHPHQWLQJLPDJHSURFHVVSUDFWLFDOO\LQ\RXUFXUUHQWQHW DXWRPDWHG  FHUYLFDO  F\WRORJ\  RQ  YLVXDO  HYDOXDWLRQ  DQG
DSSOLFDWLRQ RU EXLOGLQJ D FXVWRP $,EDVHG UHVROXWLRQ IURP FODVVLILFDWLRQ  ZLWK  DQ  HVWLPDWLRQ  RI  WKH  QXPEHU  RI  FHOOV
VFUDWFKIRUDQ\SODWIRUP UHTXLUHGWREHVFUHHQHG$QDO\W4XDQW&\WRO
>@ ':/DPE DQG 5%%URZQ 5HPRWH6HQVLQJ DQG 0DSSLQJ RI
:HHGV LQ &URSV - DJULF (QJQJ 5HV SS  
6HSWHPEHU
9,,, $&.12:/('*(0(17 >@ 9HQNDWDODNVPL % DQG 7KLODJDYDWKL . ³$XWRPDWLF 5HG %ORRG
&HOO &RXQWLQJ 8VLQJ +RXJK 7UDQVIRUP´ 3URF RI  ,(((
,ZRXOGOLNHWRWKDQNVRXUJXLGHFRRUGLQDWRUPHQWRU0U6 &RQIHUHQFH RQ ,QIRUPDWLRQ DQG &RPPXQLFDWLRQ 7HFKQRORJ\
3UDNDVK IRU DOZD\V DSSUHFLDWH DQG SUDLVH RXU ZRUN LQ $SU
ZKDWHYHU ZH WULHG ZLWK RXUVHOYHV LQ RUGHU WR PDNH RXU >@ 'RQJ 3LQJ 7LDQ $ 5HYLHZ RQ ,PDJH )HDWXUH ([WUDFWLRQ
5HSUHVHQWDWLRQ7HFKQLTXHV,QWHUQDWLRQDO-RXUQDORI0XOWLPHGLD
SURMHFWIDUEHWWHUWKDQLWZRXOGEHH[SHFWHGDQGDOVR,ZDQW DQG8ELTXLWRXV(QJLQHHULQJ9RO1R-XO\



Authorized licensed use limited to: California State University Fresno. Downloaded on June 27,2021 at 02:52:25 UTC from IEEE Xplore. Restrictions apply.