6LPSOH5RDG6LGH'HWHFWLRQDQG7UDFNLQJRQ

(PEHGGHG3&


$EGXO0XLV -RKDQQHV0DH
(OHFWULFDO(QJLQHHULQJ'HSDUWPHQW &RPSXWHU(QJLQHHULQJ'HSDUWPHQW
8QLYHUVLWDV,QGRQHVLD,QGRQHVLD %LQXV8QLYHUVLW\,QGRQHVLD
DPXLV#LHHHRUJ MRKDQQHV#ELQXVHGX


Abstract²5RDG WUDFNLQJ LV KLJKO\ UHTXLUHG WR GULYH YHKLFOH 2WKHU ZLGHO\ XVHG DSSURDFK LV URDG WUDFNLQJ HLWKHU EDVHG
DXWRQRPRXVO\+RZHYHUWKHWUDFNLQJV\VWHPPXVWGHDOZLWKWZR RQ URDG PDUNLQJ GHWHFWLRQ ODQH GHWHFWLRQ RU URDG VLGH
PDLQ FRQVWUDLQWV UHDOWLPH FRPSXWDWLRQ DQG OLPLWHG FRPSXWLQJ GHWHFWLRQ0DLQO\WKHUHKDYHEHHQWUHPHQGRXVHIIRUWVRQURDG
SRZHU $PRQJ YDULRXV HIIRUWV D URDG VLGH GHWHFWLRQ LV DQ WUDFNLQJ .KDQ HWDO SURSRVHG URDG PDUNLQJ GHWHFWLRQ E\
DOWHUQDWLYHWRSURYLGHURDGWUDFNLQJ+RZHYHUGHDOLQJURDGVLGH WUDQVIRUPLQJURDGLPDJHWRELUGYLHZDQGWKHQQRUPDOL]HG>@
GHWHFWLRQ ZLWK WKRVH FRQVWUDLQWV LV VWLOO FKDOOHQJLQJ 7KHUHIRUH 7KH URDG PDUNLQJ LV FOHDUO\ YLVLEOH RQ SLFWXUHV EXW KDV QR
WKLV SDSHU SURSRVHV D VLPSOH URDG VLGH GHWHFWLRQ DQG WUDFNLQJ TXDQWLWDWLYH YDOXH WR FDU 2WKHU ZRUN E\ /LDQJ ;LDR HWDO
ZKLFK LV DGHTXDWH IRU ORZ FRVW HPEHGGHG 3& 0DLQO\ WKH URDG SUHVHQWHGIDVWSDUWLFOHILOWHUIRUURDGGHWHFWLRQDQGWUDFNLQJ>@
DSSHDUDQFHKDVGLIIHUHQWWH[WXUHWRWKHURDGVLGH$QDOJRULWKPLV
$ VWDWH YHFWRU ZDV GHYHORSHG DV YHKLFOH UHODWLYH SRVH WR WKH
GHYHORSHG E\ VHDUFKLQJ WKH FKDQJLQJ WH[WXUH IURP WKH FHQWHU WR
WKHURDGVLGH+HUHWKLVSDSHUREVHUYHVURDGH[LVWHQFHDERXWKDOI
URDG EDVHGRQ URDG PRGHO ,W WRRN DERXW PV ZLWK KLJKHQG
SDUW RI URDG DSSHDUDQFH RQ LPDJH :KLFK LV DERXW  a P FRUHL3&,QZKLFKLWLVQRWDGHTXDWHIRUPRELOLW\WKDWXVXDOO\
DKHDG,WGHSHQGVRQSHUVSHFWLYHDSSHDUDQFHRIKDUGZDUHVHWXS XVHV HPEHGGHG 3& 3UDVKDQWK &KDQGUDQ HWDO DOVR XVHG
7KLV LQWHUHVWHG UHJLRQ LV REVHUYHG KRUL]RQWDOO\ RQ FHUWDLQ SDUWLFOHILOWHUIRUVHJPHQWLQJDQGWUDFNLQJWKHHGJHRIURDGV>@
FRQVHFXWLYH GLVWDQFH /DWHU SURMHFWLRQ RQ LPDJH SODQH RI HDFK 7ZR SUHGLFWLRQ PRGHOV ZHUH FRQVLGHUHG SRO\QRPLDO FXUYH
FRUUHVSRQGLQJ GLVWDQFH DUH REVHUYHG IRU FKDQJLQJ WH[WXUH 7KH ILWWLQJ DQG ILUVW RUGHU DXWR UHJUHVVLYH PRGHO 8QIRUWXQDWHO\
SURSRVHG PHWKRG LV HYDOXDWHG ZLWKLQ WKH ILUVW  FRQVHFXWLYH FRPSXWDWLRQZDVGRQHRIIOLQHZLWKORZLPDJHUHVROXWLRQ,KDV
LPDJH IUDPHV IURP WKH VWDUWLQJ WLPH RQ PRYLQJ FDU )RXU WULDOV QR MXVWLILFDWLRQ WR EH DSSOLHG IRU UHDO WLPH LPSOHPHQWDWLRQ DV
ZLWK GLIIHUHQW WUDFNV DUH FRQVLGHUHG IRU HYDOXDWLRQ 7KH VWDWHGLQWKHLUSDSHU,QVSLWHRISDUWLFOHILOWHU0DUF5HYLOORXG
DOJRULWKPZDVVXFFHVVIXOO\UXQZLWK[LPDJHUHVROXWLRQRQ HWDO SURSRVHG PXOWLODQH VKDSH HVWLPDWLRQ EDVHG RQ URDG
UDVSEHUU\ 3L ZLWK DFFXUDF\  7KH LPDJH ZDV WDNHQ ZLWK PDUNLQJ GHWHFWLRQ DQG WUDFNLQJ>@ 8QIRUWXQDWHO\ URDG
ISVDQGWKHFRPSXWDWLRQIRUURDGGHWHFWLRQZDVQRWPRUHWKDQ PDUNLQJLVQRWDOZD\VWKHUHDQGHDVLO\GLVDSSHDUHGE\WKHWLPH
PV JRHVE\,QFRQWUDVW0%DKJDWSURSRVHGVLPSOHDSSURDFKIRU
XQPDUNHGURDGE\FDOFXODWLQJWKHYDQLVKLQJSRLQWORFDWLRQ>@
Keywords— road side; detection; tracking; embedded PC +RZHYHU WKH FRPSXWDWLRQ ZDV GRQH RIIOLQH DQG WRRN 
IUDPHVZKLFKLVWRRVORZWREHLPSOHPHQWHGLQUHDOZRUOG
, ,1752'8&7,21
$XWRQRPRXV GULYH UHTXLUHV WKH DOJRULWKP WR EH IDVW DQG
$XWRQRPRXVFDUKDVEHHQDWUHQGLQJSXEOLFLVVXHLQWKHODVW UHOLDEOH 7KXV WKH DOJRULWKP VKRXOG FRQVLGHU WKH SHUIRUPDQFH
IHZ \HDUV (YHQ LQ 6LQJDSRUH D SXEOLF WUDQVSRUWDWLRQ VHUYLFH RI FRPSXWLQJ XQLW 2Q WKH RWKHU KDQG D SRZHUIXO 3& LV QRW
KDG VWDUWHG WDNLQJ SDVVHQJHU WR GHVLUHG ORFDWLRQ ZLWK DGHTXDWH IRU PRELOLW\ DVSHFW )RUWXQDWHO\ UHFHQW WHFKQRORJ\
DXWRQRPRXVFDU+RZHYHUDWHFKQLFDOVWDIILVVWLOOZDWFKLQJLQ VXSSRUWV HPEHGGHG 3& ZLWK PRUH DQG PRUH SRZHU EXW VWLOO
WKH FDU IRU IDLOXUH DQG PDNH DFWLRQ LI UHTXLUHG 0DLQO\ OLPLWHG ,QGHHG UHVHDUFKHU VKDOO GHDO ZLWK DW OHDVW WZR
DXWRQRPRXV GULYH GHSHQGV RQ ZKDW NLQG LQIRUPDWLRQ EHLQJ FRQVWUDLQWV UHDOWLPH FRPSXWDWLRQ DQG OLPLWHG FRPSXWLQJ
XVHG $OVR GHSHQGV RQ KRZ LW IXVHV LQIRUPDWLRQ RQ PXOWLSOH SRZHU,QZKLFKURDGWUDFNLQJPXVWEHIDVWHQRXJK+RZHYHU
UHVRXUFHV IURP VHQVRU RU SULRU NQRZOHGJH $GYDQFHG V\VWHP LW KDV EHHQ ZLGHO\ NQRZQ WKDW LPDJH SURFHVVLQJ WDNH WLPH
XVHV %D\HVLDQ Simultaneous Localization And Mapping ORQJHUWKDQRWKHUVHQVRUV0RUHRYHUFRPSXWDWLRQRQHPEHGGHG
6/$0WKDWIXVHPXOWLSOHVHQVRUDQGRIIOLQHPDSVDORQJZLWK 3&PD\WDNHWLPHPRUHWKDQWHQWLPHVFRPSDUHGWRSRZHUIXO
GHWHFWLRQ DQG WUDFNLQJ RI RWKHU PRYLQJ REMHFW 1LLMLPD HWDO 3&
REWDLQHG URDG FHQWHU E\ JHQHUDWLQJ ' PDS ZLWK ' Laser
Imaging Detection and Ranging /,'$5 >@ :DQJ HWDO %DVHGRQWKHDERYHIDFWVWKLVSDSHUSURSRVHVDVLPSOHURDG
VXFFHVVIXOO\LQWHJUDWHG6/$0ZLWKPRYLQJREMHFWWUDFNLQJ>@ VLGH GHWHFWLRQ DQG WUDFNLQJ WKDW LV VXLWDEOH IRU ORZ FRVW
)XUWKHU ZRUN E\ %UHVVRQ HWDO REVHUYHG FXUUHQW WUHQG RI HPEHGGHG 3& 7KH LGHD FRPHV IURP WKH ZD\ KXPDQ H\H
6/$0 IRU DXWRQRPRXV GULYLQJ >@ 8QIRUWXQDWHO\ WKHVH GLIIHUHQWLDWH URDG DUHD DQG URDG VLGH EDVHG RQ DSSHDUDQFH
DSSURDFKHVUHTXLUHVSRZHUIXOFRPSXWLQJXQLWDORQJZLWKKLJK 5RDGWH[WXUHXVXDOO\ORRNXQLIRUPXSWRWKHYDQLVKLQJSRLQWRU
HQG VHQVRUV +RZHYHU DXWRQRPRXV GULYLQJ LV QRW OLPLWHG WR URDG VLGH +HUH KXPDQ H\H XVXDOO\ XVHV FHQWHU VLJKW DV
DGYDQFHGDSSURDFK UHIHUHQFHDQGFKHFNVLWVVXUURXQGLQJWRWKHOHIWDQGULJKWXQWLO

l-))) 
WKHWH[WXUHFKDQJHG7KHWDUJHWREMHFWVDUHURDGDUHDDQGURDG
VLGH ,I DQ REMHFW KDV SDWWHUQ RU VSHFLILF VW\OH LW FDQ EH
UHFRJQL]HGLQVLPSOHZD\3UHYLRXVZRUNRQSDWWHUQILQGLQJE\
ORJLFDODSSURDFKZDVDEOHWRSURYLGHORZFRPSXWDWLRQFRVWIRU
UHDOWLPH YLVXDO FRQWURO >@ 7KH DOJRULWKP ZDV GRQH LQ SL[HO
EDVHG ZLWK HYDOXDWLRQ IXQFWLRQ ,W UHGXFHV FRPSXWDWLRQ FRVW
VLJQLILFDQWO\ IURP WUDGLWLRQDO DSSURDFK VXFK DV HGJH ILOWHULQJ
%RUJKJUDHI HWDO DOVR SURRIHG SL[HOEDVHG RXWSHUIRUPHG WR
FRPSOH[ PHWKRG >@  %XW WKLV SL[HOEDVHG DSSURDFK FDQQRW 
EHXVHGDVDVWDQGDORQHWHFKQLTXH )LJ &DOLEUDWLRQLPDJH
,Q WKLV SDSHU DQ DOJRULWKP LV GHYHORSHG E\ VHDUFKLQJ WKH
FKDQJLQJWH[WXUHIURPWKHFHQWHUWRWKHURDGVLGH$WOHDVWURDG 
ª   º
 
H[LVWHQFHPaPDKHDGLVREVHUYHGJUDGXDOO\ZLWKOLQHDUO\ «    »»
«
VSDFHG GLVWDQFH 7KH GLVWDQFH LV GHULYHG IURP KDOI SRUWLRQ RI ¬«    »¼
URDG DSSHDUDQFH RQ LPDJH 1H[W WKH DOJRULWKP ILQGV WKH
SURMHFWHG FRUUHVSRQGLQJ GLVWDQFH RQ LPDJH SODQH )RU HDFK 2QFHWKHFDPHUDLQWULQVLFSDUDPHWHUVREWDLQHGWKH5HJLRQ
SURMHFWLRQFKDQJLQJWH[WXUHVWRWKHOHIWDQGULJKWDUHREVHUYHG RI,QWHUHVW52,VKDOOEHGHILQHG7KH52,RIWKLVZRUNLVWKH
$W OHDVW WKUHH FRQVHFXWLYH KRUL]RQWDO OLQHV DUH XVHG IRU WKH RQH KDV URDG DSSHDUDQFH +DYLQJ WKLV 52, FDQ UHGXFH
REVHUYDWLRQWRUHGXFHIDLOXUH FRPSXWDWLRQ WLPH $V VKRZQ LQ )LJ WKH URDG DSSHDUDQFH LV
7KH QH[W FKDSWHU GLVFXVVHV RQ JHQHUDOO\ XVHG LPDJH QRWPRUHWKDQKDOILPDJH7KLVSDSHUFRQVLGHUVWKHKDOIERWWRP
KDQGOLQJ UHODWHG WR WKLV ZRUN )ROORZHG E\ WKH SURSRVHG URDG SDUWRIURDGDSSHDUDQFHDVWKH52,7KHXSSHUSDUWLVLJQRUHG
GHWHFWLRQ DSSURDFK LQ FKDSWHU  $IWHU VRPH GLVFXVVLRQ RQ GXHWRWKHSHUVSHFWLYHPDSSLQJWRUHDOZRUOGLVWRRIDU
H[SHULPHQWDO UHVXOW LQ FKDSWHU  WKLV SDSHU LV FRQFOXGHG LQ
FKDSWHU

,, ,0$*(+$1'/,1*
(YHU\ FDPHUD KDV LWV RZQ FKDUDFWHULVWLF GXH WR OHQV DQG
IDFWRU\GHIHFW,QGHHGWKHFDPHUD¶VLQWULQVLFSDUDPHWHUVVKRXOG
EH REWDLQHG 7KH LQWULQVLF SDUDPHWHUV  PDSV WKH ZRUOG
FRRUGLQDWHWRLPDJHSODQHDVLOOXVWUDWHGLQ)LJ7KHu,vDUHWKH
FRRUGLQDWH LQ LPDJH SODQH IRU YHUWLFDO DQG KRUL]RQWDO D[LV
:KLOH x,y,z DUH WKH ZRUOG FRRUGLQDWH D[LV 7KH u0, v0 DUH WKH
FHQWHU SRLWV NQRZQ DV SULQFLSDO SRLQWV 7KH f u  f v  DUH WKH
IRFDO OHQJWK NQRZQ DV VFDOH IDFWRU RI KRUL]RQWDO D[LV DQG
YHUWLFDO D[LV UHVSHFWLYHO\ $QG γ  GHQRWHV WKH VNHZQHVV RI
YHUWLFDOD[LVDQGKRUL]RQWDOD[LV
D

a
M 
LJ &ƌŽŶƚŝŵĂŐĞƉůĂŶĞ
v )LJ 5RDGDSSHDUDQFHDQGUHJLRQRILQWHUHVW52,
ĐĂŵĞƌĂ
dž u ŵ
Ĩ
Ĩ
K&
nj z
y
$IWHU HYDOXDWLQJ WKH 52, WKH QH[W LPSRUWDQW WKLQJ LV WKH
KZ
Ĩ
K Ĩ 
Kt
inverse perspective mapping ,30 7KLV JHRPHWU\
ǁŽƌůĚ
ŵ
u  WUDQVIRUPDWLRQ FDQ EH XVHG WR UHGXFH SHUVSHFWLYH HIIHFW IURP
v Ĩ
FDPHUD 7KLV ,30 WHFKQLTXH QHHG DFFXUDWH LQWULQVLF DQG
 H[WULQVLF FDPHUD 7KLV WHFKQLTXH LV VXLWDEOH IRU IL[ FDPHUD
ZĞĂůŝŵĂŐĞƉůĂŶĞ

:KLOHIRUWKLVZRUNPD\KDYHSRVLWLRQFKDQJHVLQFHWKHFDPHUD
; ƚ ƚͿ
)LJ 3HUVSHFWLYHSURMHFWLRQ
LV PRXQWHGRQGDVKERDUG,QZKLFKUHFDOLEUDWLRQLVUHTXLUHG
ª xº 7KLV WHFKQLTXH LV GRQH ZLWK WZR VWHS WUDQVIRUPDWLRQ LPDJH
 ªu º ª f u γ u º « »   VSDFHWRVXUIDFHVSDFHWRJHWREMHFWRQUHDOVSDFHDQGWKHQEDFN
y
s «« v »» = ««  fv v »» « » WUDQVIRUPHG IURP VXUIDFH VSDFH WR LPDJH VSDFH ZLWK QR
«z»
¬« ¼» ¬«    ¼» « » SHUVSHFWLYH 7KLV LQYHUVH SHUVSHFWLYH LV UHTXLUHG WR GHFLGH WKH
¬ ¼ IXUWKHUURDGSRVHHVWLPDWLRQ
%\ XVLQJ FKHVVERDUG LPDJH DV VKRZQ LQ )LJ IRU 5RDG VLGH GHWHFWLRQ PDLQO\ VLPLODU WR HGJH GHWHFWLRQ RI
FDOLEUDWLRQ WKH LQWULQVLF SDUDPHWHUV IRU WKH XWLOL]HG & URDG VXUIDFH 7KHUH KDYH EHHQ PDQ\ ' ILOWHU IRU HGJH
FDPHUDLVVKRZQLQ GHWHFWLRQ VXFK DV &DQQ\ 'LIIHUHQFH RI *DXVVLDQ DQG 6REHO
7KHVH PHWKRG FRXQWV RQ QHLJKERU SL[HO LQWHQVLW\ ZLWK
WKUHVKROG7KHRQHZLWKVLJQLILFDQWGLIIHUHQWIURPWKHWKUHVKROG


LVWUHDWHGDVDQHGJH)RUURDGGHWHFWLRQWKHUHVXOWLVIROORZHG
E\ ILQGLQJ URDG VLGH +HUH +RXJK WUDQVIRUP FDQ EH XVHG WR
ILQG VLPLODU OLQH WR WKH VDPH GLUHFWLRQ +RZHYHU WKLV SURFHVV
WDNHVPRUHWLPHDVLWGHSHQGVRQFDOFXODWLRQZLWKLWVQHLJKERU
$QRWKHU URDG VLGH GHWHFWLRQ FDQ EH GRQH ZLWK SDWWHUQ RU
VLPLODU FRORU GHWHFWLRQ 7KLV PHWKRG XVXDOO\ XVHV GHVFULSWRU
WKDW FROOHFWV OLJKW LQWHQVLW\ FRORU DQG WH[WXUH +HUH URDG
WH[WXUHFDQEHGHILQHGDVDQREMHFWZLWKVSHFLILFVWUXFWXUHDQG
UHSHDWHG WR IRUP D SDWWHUQ 7KLV WHFKQLTXH XVXDOO\ RXW
SHUIRUPHGWKDQSUHYLRXVURDGGHWHFWLRQVLQFHLWFDQEHXVHGRQ
URDGZLWKRXWFOHDUPDUN

,,, 52$'6,'('(7(&7,21
/RZ FRVW HPEHGGHG KDUGZDUH LV FRQVLGHUHG LQ WKLV SDSHU 
7KH FDPHUD LV PRXQWHG RQ GDVKERDUG FHQWHU DV VKRZQ LQ OHIW )LJ 3HUVSHFWLYHYLHZIURPUHDOGLVWDQFHWRLPDJHSODQH
SDUW RI )LJ ,Q ZKLFK WKH VLJKW YLHZ RI FDPHUD FDQ EH
LOOXVWUDWHGLQULJKWSDUWRI)LJ
B. Texture Filter
7KLV SDSHU XVHV QHDUHVWQHLJKERU LQWHUSRODWLRQ IRU WH[WXUH
ILOWHULQJ 7KLV ILOWHU LV DSSOLHG RQ KRUL]RQWDO OLQH RI SURMHFWHG
VSHFLILHG GLVWDQFH DV VKRZQ LQ )LJ ,Q ZKLFK WKH ILOWHULQJ
PHWKRG HYDOXDWH HDFK SL[HO EDVHG RQ GLIIHUHQW PD[LPXP DQG
PLQLPXP JUD\VFDOH YDOXH RI WKH DGMDFHQW SL[HOV KRUL]RQWDOO\
 (DFK UHVXOWLQJ SL[HO ZLWK ODUJH YDOXH DIWHU WH[WXUH ILOWHULQJ
)LJ 0RXQWHGFDPHUDRQGDVKERDUGOHIWDQGLPDJHYLHZIURPVLGHULJKW SURFHVVLQGLFDWHWH[WXUHGLVSDULW\ZKLFKXVXDOO\PDUNWKHHGJH
EHWZHHQ URDGDQG URDGVLGHDUHD 7KLV PHWKRG FDQ EHXVHG WR
7KLV SDSHU SURSRVHV URDG VLGH GHWHFWLRQ EDVHG RQ URDG GLVWLQJXLVKURDGDUHDZLWKRXWDFOHDUPDUNLQJ
WH[WXUH RQ LPDJH $W ILUVW WKH LQWHUHVW UHJLRQ 52, PXVW EH
GHILQHGIROORZHGE\WH[WXUHILOWHUZLWKORJLFDODSSURDFK+HUH
WKUHHVWHSVIRUGHWHFWLRQDUHGHILQHGDV)LJ


)LJ 'HWHFWLRQVWHSV

A. Define ROI
,QRUGHUWRJHWOHIWULJKWURDGVLGHYLVLEOHLQLPDJHSODQHWKLV
SDSHUFRQVLGHUVPPPPDQGPGLVWDQFHIURP
FDPHUDDVWKH5HJLRQRI,QWHUHVW52,7KLVGLVWDQFHVDUHWKH 
KDOI ERWWRP SDUW RI URDG DSSHDUDQFH DV LOOXVWUDWHG LQ )LJ )LJ 2ULJLQDOLPDJHZLWKKRUL]RQWDOOLQHRISURMHFWHGGLVWDQFH
)XUWKHUGLVWDQFHLVQRWFRQVLGHUHGWRUHGXFHFRPSXWDWLRQWLPH
7KH SURMHFWLRQ SRLQWV EDVHG RQ WKRVH GLVWDQFH DUH FDOFXODWHG 2QFHWKHKRUL]RQWDOOLQHGHILQHGWH[WXUHILOWHULVDSSOLHG$W
EDVHGRQ)LJ7KHVSHFLILHGGLVWDQFHVZLOOEHWUDQVODWHGLQWR ILUVWWKHLPDJHLVWKUHVKROGE\FHUWDLQYDOXHJRWIURPWXQLQJRQ
SL[HOFRRUGLQDWHVLQLPDJHSODQHE\XVLQJ VDPSOHLPDJH1H[WDVVXPHWKHURDGDUHDDQGWKHURDGVLGHDUH
fx X f yY YLVLEOHRQLPDJH7KHQWKHUHPXVWEHVRPHSDUWRQWKHOHIWDQG
 xi = + u and yi = + v   ULJKW ZKLFK LV QRW D SDUW RI WKH URDG DQG VKRXOG EH UHPRYHG
Z Z 0DLQO\ WKHUH DUH VPDOO JDSV IURP WKH OHIW DQG WKH ULJKW IURP
7KH FRRUGLQDWH V\VWHP RI URDG DQG LPDJH SODQH DUH ILOWHULQJSURFHVV7KHZLGWKRIJDSVDUHFRPSDUHGDQGORJLFDOO\
LOOXVWUDWHG LQ )LJ +HUH WKH FDPHUD KHLJKW LV DVVXPHG EHLQJ GHWHUPLQHGWKHODUJHVWDQGWKHVHFRQGODUJHVWJDSWREHWKHURDG
FRQVWDQW DUHDDQGXQLWHDOOWKHRWKHUJDSV$WODVWWKHPLGGOHJDSGXHWR
ODQHPDUNHUFDQEHMRLQHGWRJHWKHUDVURDGDUHD7KHLOOXVWUDWLRQ
IRUWKHZKROHILOWHULQJSURFHVVDUHVKRZQLQ)LJ
%DVHGRQ)LJKXPDQH\HFDQHDVLO\GLIIHUHQWLDWHWKHWZR
SDUWV RQ PLGGOH DUH WKH URDG +HUH LI WKHUH LV ELJ UHJLRQQHDU
FHQWHUSRLQWWKHUHVWELJUHJLRQVKDOOEHUHPRYHG


 ,9 (;3(5,0(17$/5(68/7


)LJ2ULJLQDOLPDJHZLWKKRUL]RQWDOOLQHRISURMHFWHGGLVWDQFH

7KHKDUGZDUHZDVVHWXSRQWKHFHQWHURIGDVKERDUGFDUDV
VHHQ LQ )LJ $ UDVSEHUU\ 3, ZLWK PLQLELDQ NHUQHO DV
HPEHGGHG3&LVXVHGWRGHWHFWURDGDKHDG7KHPLQLELDQNHUQHO
LV HPSOR\HG WR PDNH VXUH WKH ERDUG ZLOO QRW EXV\ ZLWK RWKHU
WDVNV$/RJLWHFKFDPHUD&LVXVHGDVDYLVLRQVHQVRU7KLV
FDPHUD KDV input-output control ,2&7/ IXQFWLRQ ,Q ZKLFK
WKH WUDQVPLWWHG LPDJH LV WKH RQH UHTXHVWHG ZLWK VSHFLILHG
KHLJKZLGWK
 7KHH[SHULPHQWDOUHVXOWVRIWZRFRQVHFXWLYHIUDPHVFDQEH
)LJ 5RDGVLGHGHWHFWLRQRQPGLVWDQFHSURMHFWLRQ VHHQ RQ )LJ ,Q ZKLFK WKH YDQLVKLQJ SRLQWV ZHUH
VXFFHVVIXOO\ GHWHFWHG +HUH WKH URDG VLGH GHWHFWLRQ LV
FDOFXODWHG EDVHG RQ YDQLVKLQJ SRLQWV RI WKRVH ILYH KRUL]RQWDO
C. Road Side Detection OLQHV )LJ VKRZV VXFFHVVIXOO\ VORSH GHWHFWLRQ ZKLOH )LJ
5RDG VLGH GHWHFWLRQ FDQ EH HVWLPDWHG EDVHG RQ WKH VKRZV IDLO VORSH GHWHFWLRQ GXH WR RQH KRUL]RQWDO OLQH LV RYHU
YDQLVKLQJ SRLQWV RI WKRVH SURMHFWHG GLVWDQFHV 7KH YDQLVKLQJ WKDQRWKHUV
SRLQWVDFWXDOO\IRUPDSHUVSHFWLYHLPDJHDVLOOXVWUDWHGLQ)LJ 7KH DFFXUDF\RI WKHSURSRVHG PHWKRG FDQEH HYDOXDWHG DV
7KH VORSH FDOFXODWLRQ RI WKRVH YDQLVKLQJ SRLQWV LV GHILQHG E\ WKHVXFFHVVIXOO\GHWHFWHGFRPSDUHGZLWKWRWDOIUDPHV+HUH
XVLQJOLQHDUUHJUHVVLRQ6LQFHWKH52,LVFORVHHQRXJKWKHQ WKH LPDJH UHVROXWLRQ LV [ 7KH LPDJH LV WDNHQ ZLWKLQ
WKH VORSH RQ OHIW VLGH  XVXDOO\ SRVLWLYH QXPEHU ZKLOH ULJKW ISV$QGWKHHYDOXDWLRQLVFRQVLGHUHGRQWKHILUVWIUDPHV
VORSH  QHJDWLYH QXPEHU ,I WKLV FRQGLWLRQ LV QRW DFKLHYHG IURPWKHVWDUWLQJWLPHRQPRYLQJFDU7KHVWDUWLQJWLPHLVWKH
WKHQWKHURDGGHWHFWLRQRQFXUUHQWIUDPHLVIDLO+RZHYHUWKLV WLPH ZKHQ WKH XVHU WULJJHU WKH V\VWHP WR VWDUW 7R REVHUYH
FRQGLWLRQ DSSOLHG RQO\ RQ QHDUO\ VWUDLJKW URDG ,W PD\ IDLO RQ UHOLDELOLW\ IRXU WULDOV ZLWK GLIIHUHQW ORFDWLRQV DUH FRQGXFWHG
WXUQLQJURDG 7KH H[SHULPHQWDO UHVXOWV DUH VKRZQ LQ 7DEOH  ,W LV FOHDUO\
VKRZQ WKDW WKH SURSRVHG PHWKRG FDQ SURYLGH VXIILFLHQW
UHTXLUHPHQWV WR EH XVHG IRU DXWRQRPRXV FRQWURO 7KH DYHUDJH
DFFXUDF\LVDERXW
7KH UHVXOW LV FRPSDUDEOH WR WKH ZD\ KXPDQ H\H WUDFN WKH
URDG +XPDQ H\H FDQ KDQGOHXS WRISV $OVR KXPDQ H\H LV
RIWHQ EOLQN ZKLFK LV PLVV VRPH IUDPHV :KLOH WKLV DSSURDFK
\LHOGV  DFFXUDF\ ZLWKLQ ISV 0RUHRYHU WKH REWDLQHG
 YDOXH FDQ EH LQWHUSRODWHG IURP WKH SUHYLRXV VXFFHVV IUDPHV
)XUWKHUPRUH DOWKRXJK XVLQJ ORZ FRVW 5DVSEHUU\ 3, DV
)LJ 3HUVSHFWLYHLPDJHRIYDQLVKLQJSRLQWRQURDGVLGH
HPEHGGHG3&WKHUHTXLUHGWLPHIRUURDGVLGHGHWHFWLRQLVOHVV
WKDQPV
 
success frame
(4) accuracy = ⋅   
total frame



 LV JUHDWO\ IDVW ZKLFK LV OHVV WKDQ PV 0RUHRYHU WKLV ZDV
GRQHRQORZFRVW5DVSEHUU\3,DVHPEHGGHG3&:KHUHDVWKH
DFFXUDF\LVFRPSDUDEOHWRKXPDQH\H 3UDFWLFDOO\ LW FDQ
EHLPSURYHGZLWKLQWHUSRODWLRQRISUHYLRXVVXFFHVVIUDPHV

$&.12:/('*0(17
7KLVZRUNUHVLGHVZLWKLQWKHIUDPHZRUNRIWKH5&$9HSURMHFW
 JURXS)DFXOW\RI(QJLQHHULQJ8QLYHUVLWDV,QGRQHVLD
)LJ5RDGVLGHGHWHFWLRQUHVXOWRQGLIIHUHQWVWDUWLQJIUDPH 
5()(5(1&(6

>@ 6 1LLMLPD - 1LWWD < 6DVDNL DQG + 0L]RJXFKL ³*HQHUDWLQJ '
IXQGDPHQWDO PDS E\ ODUJHVFDOH 6/$0 DQG JUDSKEDVHG RSWLPL]DWLRQ
IRFXVHGRQURDGFHQWHUOLQH´3URFRI,QW6\PSRVLXPRQ520$1SS

 >@ && :DQJ & 7KRUSH 0 +HEHUW 6 7KUXQ + 'XUUDQW:K\WH
³6LPXOWDQHRXV /RFDOL]DWLRQ 0DSSLQJ DQG 0RYLQJ 2EMHFW 7UDFNLQJ´
)LJ6XFFHVVIXOO\VORSHGHWHFWLRQ ,QW-RXUQDORI5RERWLFV5HVHDUFK,-559RO,VVXHSS±

>@ *%UHVVRQ = $OVD\HG/<X 6 *ODVHU³6LPXOWDQHRXV/RFDOL]DWLRQ
DQG 0DSSLQJ $ 6XUYH\ RI &XUUHQW 7UHQGV LQ $XWRQRPRXV 'ULYLQJ´ 
((7UDQVDFWLRQVRQ,QWHOOLJHQW9HKLFOHV9RO,VVXHSS±

>@ %6 .KDQ 0 +DQDIL DQG 6 0DVKRKRU ³$XWRPDWHG 5RDG 0DUNLQJ
'HWHFWLRQ 6\VWHP IRU $XWRQRPRXV &DU´ ,((( 6WXGHQW &RQIHUHQFH RQ
5HVHDUFKDQG'HYHORSPHQW6&25H'SS±
 >@ / ;LDR % 'DL 7 +X DQG 7 :X  ³)DVW XQVWUXFWXUHG URDG GHWHFWLRQ
)LJ)DLOVORSHGHWHFWLRQ DQGWUDFNLQJIURPPRQRFXODUYLGHR´3URFRI,QW&RQIRQ&&'&SS
±
>@ 3&KDQGUDQ0-RKQ6DQWKRVK.60LWKLOHVK165³5RDGWUDFNLQJ
7$%/(,6800$5<2)(;3(5,0(17$/5(68/76 XVLQJSDUWLFOHILOWHUVIRU$GYDQFHG'ULYHU$VVLVWDQFH6\VWHPV´3URFRI
,(((,QW&RQIRQ,QWHOOLJHQW7UDQVSRUWDWLRQ6\VWHPVSS±
6XFFHV 7LPH Zebra- 
2WKHU
 5DWH HDFKIUDPH %UDQFK Cross >@ 05HYLOORXG'*UX\HU(3ROODUG³$QLPSURYHGDSSURDFKIRUUREXVW
YHKLFOH
 PV URDG PDUNLQJ GHWHFWLRQ DQG WUDFNLQJ DSSOLHG WR PXOWLODQH HVWLPDWLRQ´
7ULDO      3URF RI ,((( ,QW &RQI RQ ,QWHOOLHQW 9HKLFOHV 6\PSRVLXP SS  ±
7ULDO      
7ULDO      >@ 0 %DKJDW ³$ 6LPSOH ,PSOHPHQWDWLRQ IRU 8QPDUNHG 5RDG 7UDFNLQJ´
7ULDO      3URF RI ,((( 0HGLWHUUDQHDQ (OHFWURWHFKQLFDO &RQIHUHQFH SS  ±
$YHUDJH      
 >@ $ 0XLV . 2KQLVKL ³(\HWRKDQG DSSURDFK RQ H\HLQKDQG
FRQILJXUDWLRQ ZLWKLQ UHDOWLPH YLVXDO VHUYRLQJ´ ,((( 7UDQV RQ
0HFKDWURQLFV9RO,VVXHSS±
9 &21&/86,21 >@ $ %RUJKJUDHI 2 %DUQLFK ) /DSLHUUH 0 9 'URRJHQEURHFN :
7KHSURSRVHGDOJRULWKPKDVEHHQYDOLGDWHGE\H[SHULPHQWDO 3KLOLSV DQG 0 $FKHUR\ ³$Q (YDOXDWLRQ RI 3L[HO%DVHG 0HWKRGV IRU
WKH 'HWHFWLRQ RI )ORDWLQJ 2EMHFWV RQ WKH 6HD 6XUIDFH´ (85$6,3
UHVXOWV 7KH URDGVLGH FDQ EH GHWHFWHG EDVHG RQ  KRUL]RQWDO -RXUQDORQ$GYDQFHVLQ6LJQDO3URFHVVLQJ
OLQHVRISURMHFWHGGLVWDQFH7KHWLPHFRQVXPHGIRUHDFKIUDPH