Paper 11-Image Based Individual Cow Recognition
Paper 11-Image Based Individual Cow Recognition
Abstract—The existence of illumination variation, non-rigid acceptance rate of the methods among the cow breeders. The
object, occlusion, non-linear motion, and real-time classical methods of animal identification are not reliable; they
implementation requirement has made tracking in computer are prone to fraudulent activities such as swapping,
vision a challenging task. In order to recognize individual cow duplication and forgery of the so called unique identification
and to mitigate all the challenging tasks, an image processing numbers tagged on the animal’s body [7], [8], and therefore
system is proposed using the body pattern images of the cow. cannot meet the required level expected from them for the
This system accepts an input image, performs processing monitoring and identification of animal [9].
operation on the image, and output results in form of
classification under certain categories. Technically, convolutional Many automatic systems have been proposed recently for
neural network is modeled for the training and testing of each the monitoring and identification of cow however, most of
pattern image of 1000 acquired images of 10 species of cow which these devices are sensor based and sometimes become burden
will pass it through a series of convolution layers with filters, and injurious when worn on the body of the animal [10].
pooling, fully connected layers and softmax function for the There is need for automatic cow monitoring system in
pattern images classification with probabilistic values between 0 livestock farm to be developed as there is uprising in the
and 1. The performance evaluation of the proposed system for number of cow year in year out in almost every part of the
both training and testing data was carried out for each cow’s world and there is great task involved in monitoring cow
identification and 92.59% and 89.95% accuracies were achieved
manually. Lu et al. [11] proposed cow traceability system that
respectively.
was based on the iris analysis for the enhancement of cow
Keywords—Cow; body patterns; convolutional neural network; management. The image quality assessment of the captured
image; recognition iris sequences was firstly made before the clear iris was
selected. By using segmentation that was based on edge
I. INTRODUCTION detection, the inner and outer boundaries of the iris of the cow
were fitted as ellipse form. The iris image was normalized
Cows in the past were classically monitored with the sole
using geometric method and both the local and the global
aim of aiding tracking, health information, performance
features of the iris of the cow were extracted using 2D
recording, prevention against manipulation and swapping, and
complex wavelet transform. However, in an unconstrained
verification of false insurance claims. There are basically two
environment where there is greater possibility of getting poor
recognition techniques employed for the identification of the
quality image of cow’s iris, this method may not be
animal. One recognition technique leaves a permanent mark
appropriate for a reliable traceability.
on the animal for identification while the other recognition
technique leaves a temporary mark. Examples of the By using video data, there is every possibility that the
recognition technique that leaves a permanent mark are found problems attributed to the classical methods can be mitigated
in [1], [2], [3], [4], [5] with their drawbacks. The tattooing of using the visual based automatic cow recognizing system. The
ears, tagging of ears, microchips implant and branding are recognition of individual cow in the automatic cow monitoring
popular invasive identification techniques that leave a implementation process enables behavior monitoring of
permanent mark on the animal’s body with so many individual cow at long run for body condition score which
challenges such as animal infections, mild sepsis, and plays important role in the health condition of individual cow.
hemorrhaging [2], [3]. The system proposed in this paper is image-based individual
cow recognition using body patterns. The rest of the paper is
Examples of the recognition technique that leaves a
organized as follow. Presented in Section 2 are the literature
temporary mark on the body of the animal for identification
review, followed by the material and method in Section 3, the
purposes are found in the work of Barron et al. [6] with their
results and discussion are in Section 4. The conclusion is in
drawbacks. Among the classical methods of animal
Section 5.
identification are drawing, tagging, tattooing, branding,
notching, and Radio Frequency Identification (RFID). II. LITERATURE REVIEW
However, classical methods of animal identification have
notable adoption problems which have contributed to the low The conventional constructs of identifying animal can be
categorized into: (1) permanent recognition construct (PRC);
92 | P a g e
www.ijacsa.thesai.org
(IJACSA) International Journal of Advanced Computer Science and Applications,
Vol. 11, No. 3, 2020
(2) semi-permanent recognition construct (SRC); and binary pattern (LBP) based model for recognition of cattle
(3) temporary recognition construct (TRC); [12], [13]. The using the texture features of cattle facial representation.
tattooing of ear and body, tagging of ear, microchip implants Proposed in [28] is an approach for cattle recognition based on
and branding are referred to as PRC recognition methods [14] Speeded Up Robust Feature (SURF) descriptor. The approach
but with several limitations [15] such as: (1) lack of large was an enhancement of Petersen’s method for cattle
scale production of various metal clips and plastic tags that identification. The results of experiment was reported based
can be enough for the identification of large-scale animal; on the image datasets of 4 cattle breeds used which were
(2) easy lost of the available ear tags due to ear tearing; captured on A-5 paper with blue inked for the purpose of
(3) infections of animals such as cattle and other ruminant cattle recognition. Proposed in [20] is a matching refinement
animals due to notches [16], [17], [18], moreover, more than technique in scale invariant feature transform (SIFT)
half percentage of the animals are infected from the injury descriptor for cattle recognition using database of 160 muzzle
sustained on their ear due to the implanted plastic ear-tags, print images. By the application of matching refinement
reason being that, the ear-tags cause various health challenges technique in SIFT approach, the matching scores of the key-
such as local inflammation, thickening of the flesh, presence points of muzzle print images were computed. Nevertheless,
of pus-forming bacteria, and loss of blood through the notch the performance of the matching refinement approach and the
[17], [13]. Cattle recognition using methods such as pattern original SIFT approach were compared, and the value of EER
sketching and collar is SRC method. Furthermore, the use of equal to 0.0167 was achieved.
dye or paint and radio frequency identification (RFID) based
recognition are referred to as TRC for the recognition of Proposed in Awad et al. [29] is a framework for
animal [12], [19]. recognizing cattle using SIFT descriptor approach. The
approach is used for localizing and detecting the beads and
According to [20], the sketching pattern is applied for the ridges’ key points in the images of muzzle print for the cattle
recognition of cattle such as Holsteins and Guernsey with identification. The RANdom SAmple Consensus (RANSAC)
broken color. High drawing skills of an individual for technique incorporated in the SIFT algorithm is used for the
sketching is needed which should be comparable to standard palliation of the outliers in muzzle image for an improved,
image quality and positively affect the cattle identification robust, and reliable cattle identification. Database of 90
process. However, this method cannot be used for the muzzle images was used for the experiment where 15 muzzle
identification of solid collared breeds such as Red Poll and images were captured from each cattle of 6 in number.
Brown Swiss breed as some artificial marking methods such Proposed in Tharwat et al. [23] is an approach of cattle
as ear tagging and tattooing that are discrimination based are recognition that was based on muzzle image using the
needed. However, the method of ear tagging damages the technique of local texture descriptor. The technique works in
cattle’s ear at the long run. As iterated in Petersen’s work [21], such a way that the texture extraction algorithm that was based
muzzle print-based cattle recognition method using blue ink on local binary pattern used the local texture features
and A-5 paper [22] was the first attempt to get permanent extraction from the images of muzzle point. The involvement
recognition method for cattle. In the method, skills are of more processing time in the cattle recognition process is a
required to acquire the muzzle pattern’s print image, by major limitation of the technique.
holding firm the cattle.
Object recognition method that is based on CNN was
Lately, the research community has shifted attention to proposed in [30]. The proposed architecture which combines
advancing cattle recognition using image of muzzle print as a RGB image and its corresponding depth image for object
new paradigm for cattle identification [22], [20]. According to recognition is made up of two unconnected CNN processing
[23], print image of muzzle pattern is made up of beads and streams, which are sequentially integrated with a late fusion
ridges patterns. Muzzle dermatoglyphics such as granola, network. ImageNet [31] is employed for the training of the
ridges, and vibrissae from various breeds are not the same CNNs in which the depth image is encoded as a rendered
[16]. Similarly, proposed in Mishra et al. [24] is method of RGB image, making the information that is contained in the
cattle breeds recognition using the beads and ridges features of depth data to go round over all the three RGB channels, and
muzzle print images. Similar to the work of Mishra et al. [14] subsequently, a standard and pre-trained CNN is employed for
is Minagawa et al. [22], they proposed a cattle identification the recognition. Due to limited availability of large scale depth
method using muzzle print, the performance evaluation was datasets that are labeled, CNNs that are pre-trained on
made using filtering techniques for muzzle image analysis and ImageNet [32] are employed. Proposed in [33], is another
morphological approaches. Equal Error Rate (EER) of 0.419 object recognition method, which employs deep CNN. The
was reported by them. proposed method also uses CNN, which is pre-trained for
image classification and provides a robust, semantically
Contrary to Minagawa et al. [22] is a framework proposed meaningful feature set. The depth information is integrated by
by Barry et al. [25]. The framework is a cattle recognition
rendering objects from a canonical perspective and getting the
using muzzle print images. They reported the 241 false non- depth channel colorized according to distance from the object
match rates (FNMR) over 560 genuine acceptance rate (GAR) center.
and 5197 false matches over 12,160 impostors matching
closely with the same value of EER of 0.429, respectively. In Jingqui et al. [34] proposed the method of object
their cattle identification effort, Kim et al. [26] proposed a recognition based on image entropy; this was aimed at
method that could recognize the Japanese black cattle using identifying the behavior of cow object that is on the motion
the cattle face’s pixel intensity [26]. Proposed in [27] is a local against a complicated background. They used the minimum
93 | P a g e
www.ijacsa.thesai.org
(IJACSA) International Journal of Advanced Computer Science and Applications,
Vol. 11, No. 3, 2020
94 | P a g e
www.ijacsa.thesai.org
(IJACSA) International Journal of Advanced Computer Science and Applications,
Vol. 11, No. 3, 2020
95 | P a g e
www.ijacsa.thesai.org
(IJACSA) International Journal of Advanced Computer Science and Applications,
Vol. 11, No. 3, 2020
96 | P a g e
www.ijacsa.thesai.org
(IJACSA) International Journal of Advanced Computer Science and Applications,
Vol. 11, No. 3, 2020
97 | P a g e
www.ijacsa.thesai.org
(IJACSA) International Journal of Advanced Computer Science and Applications,
Vol. 11, No. 3, 2020
[4] R. W. Bello, and O. M Moradeyo, “Monitoring Cattle Grazing Behavior of Advanced Machine Learning Technologies and Applications, pp.
and Intrusion Using Global Positioning System and Virtual Fencing,”, 236–247, 2014.
Asian Journal of Mathematical Sciences, vol. 3, issue 4, pp. 4-14, 2019. [24] S. Mishra, O. S. Tomer, and E. Kalm, “Muzzle dermatoglyphics: a new
[5] R. W. Bello, “An overview of animal behavioral adaptive frightening method to identify bovines”, Asian Livestock, pp. 91–96, 1995.
system,” International Journal of Mathematics and Physical Sciences [25] B. Barry, U. Gonzales-Barron, K. McDonnell, F. Butler, and S. Ward,
Research, vol. 6, issue 1, pp. 126-133, 2018. “Using muzzle pattern recognition as a biometric approach for cattle
[6] U. G. Barron, F. Butler, K. McDonnell, and S. Ward, “The end of the identification, Trans ASABE, vol. 50, no. 3,pp. 1073–1080, 2007.
identity crisis? Advances in biometric markers for animal [26] H. T. Kim, Y. Ikeda, and H. L. Choi, “The identification of Japanese
identification”, Irish Veterinary J., vol. 62, no. 3, pp. 204–208, 2009. black cattle by their faces”, Asian Australasian Journal of Animal
[7] M. Shen, L. Liu, L. Yan, M. Lu, W. Yao, and X. Yang, “Review of Sciences, vol. 18, no. 6, pp. 868–872, 2005.
monitoring technology for animal individual in animal husbandry”, [27] C. Cai, and J. Li, “Cattle face recognition using local binary pattern
Nongye Jixie Xuebao = Transactions of the Chinese Society for descriptor”, Proceedings of 2013 Asia-Pacific Signal and Information
Agricultural Machinery, vol. 45, no. 10, pp. 245-251, 2014. Processing Association Annual Summit and Conference (APSIPA), 1–4,
[8] R. W. Bello, and S. Abubakar, “Development of a Software Package for 2013.
Cattle Identification in Nigeria,” Journal of Applied Sciences and [28] A. Noviyanto, and A. M. Arymurthy, “Automatic cattle identification
Environmental Management, vol. 23, no. 10, pp. 1825-1828, 2019. DOI: based on muzzle photo using speed-up robust features approach”,
https://dx.doi.org/10.4314/jasem.v23i10.9. Proceedings of the 3rd European Conference of Computer Science,
[9] R. W. Bello, A. Z. H. Talib, and A. S. A. B. Mohamed, “A Framework ECCS, vol. 110, pp. 114, 2012.
for Real-time Cattle Monitoring using Multimedia Networks”, [29] A. I. Awad, H. M. Zawbaa, H. A. Mahmoud, E. H. H. A. Nabi, R. H.
International Journal of Recent Technology and Engineering, vol. 8, Fayed, and A. E. Hassanien, “A robust cattle identification scheme using
issue 5, 2020. muzzle print images”, Proceedings of 2013 Federated Conference on
[10] D. Grooms, “Radio Frequency Identification (RFID) Technology for Computer Science and Information Systems (FedCSIS), pp. 529–534,
Cattle”, Extension Bulletin E-2970, Michigan State University, Jan. 2013.
2007. [30] A. Eitel, J. T. Springenberg, L. Spinello, M. Riedmiller, and W.
[11] Y. Lu, X. He, Y. Wen, and P. S. Wang, “A new cow identification Burgard, “Multimodal deep learning for robust RGB-D object
system based on iris analysis and recognition”, In International Journal recognition”, In 2015 IEEE/RSJ International Conference on Intelligent
of Biometrics, vol.6, no.1, pp.18-32, 2014. Robots and Systems (IROS), pp. 681-687, 2015.
[12] S. Kumar, S. Tiwari, and S. K. Singh, “Face recognition of cattle: can it [31] O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, ..., and
be done?”, Proceedings of the National Academy of Sciences, India A. C. Berg, “Imagenet large scale visual recognition challenge”,
Section A: Physical Sciences, vol. 86, no. 2, pp. 137–148, 2016. International journal of computer vision, vol. 115, no. 3, pp. 211-252,
[13] S. Kumar, S. Tiwari, and S. K. Singh, “Face recognition for cattle. Third 2015.
IEEE International Conference on Image Information Processing [32] A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification
(ICIIP), pp. 65–72, 2015. with deep convolutional neural networks”, In Advances in neural
[14] J. Marchant, “Secure animal identification and source verification. JM information processing systems, pp. 1097-1105, 2012.
Communications, UK, pp. 1-28, 2002. [33] M. Schwarz, H. Schulz, and S. Behnke, “RGB-D object recognition and
[15] A. Allen, B. Golden, M. Taylor, D. Patterson, D. Henriksen, and R. pose estimation based on pre-trained convolutional neural network
Skuce, “Evaluation of retinal imaging technology for the biometric features”, In 2015 IEEE international conference on robotics and
identification of bovine animals in northern Ireland”, Livest Sci., vol. automation (ICRA), pp. 1329-1335, 2015.
116, no. 1, pp. 42–52, 2008. [34] G. Jingqiu, W. Zhihai, G. Ronghua, and W. Huarui, “Cow behavior
[16] A. Baranov, R. Graml, F. Pirchner, and D. Schmid, “Breed differences recognition based on image analysis and activities”, International
and intra-breed genetic variability of dermatoglyphic pattern of cattle”, J Journal of Agricultural and Biological Engineering, vol. 10, no. 3, pp.
Anim Breed Genet., vol. 110, no. 1–6, pp. 385–392, 1993. 165-174, 2017.
[17] A. Johnston, and D. Edwards, “Welfare implications of identification of [35] W. Andrew, C. Greatwood, and T. Burghardt, “Visual localisation and
cattle by ear tags”, The Veterinary Record, vol. 138, no. 25, pp. 612– individual identification of Holstein friesian cattle via deep learning”,
614,1996. Proceedings of the IEEE International Conference on Computer Vision,
pp. 2850-2859, 2017.
[18] D. D. Wardrope, “Problems with the use of ear tags in cattle”, The
Veterinary record, vol. 137, no. 26, pp. 675-675, 1995. [36] S. Kumar, A. Pandey, K. S. R. Satwik, S. Kumar, S. K. Singh, A. K.
Singh, and A. Mohan, “Deep learning framework for recognition of
[19] Z. Wang, Z. Fu, W. Chen, and J. Hu, “A RFID-based traceability system
cattle using muzzle point image pattern”, Measurement, vol. 116, pp. 1-
for cattle breeding in china”, Proceedings of 2010 International 17, 2018.
Conference on Computer Application and System Modeling (ICCASM
2010), vol. 2, pp. V2–567, 2010. [37] K. P. Risha, K. A. Chempak, and C. S. Sindhu, “Difference of Gaussian
on Frame Differenced Image,” International Journal of Innovative
[20] A. Noviyanto, and A. M. Arymurthy, “Beef cattle identification based Research in Electrical, Electronics, Instrumentation and Control
on muzzle pattern using a matching refinement technique in the sift Engineering, vol. 3, special issue 1, pp. 92-95, 2016.
method”, Comput Electron Agric., vo. 99, pp. 77–84, 2013.
[38] M. S. Norouzzadeh, A. Nguyen, M. Kosmala, A. Swanson, M. S. Palmer,
[21] W. E. Petersen, “The identification of the bovine by means of nose- C. Packer, and J. Clune, “Automatically identifying, counting, and
prints”, Journal of dairy science, vol. 5, no. 3, pp. 249-258, 1922.
describing wild animals in camera-trap images with deep learning,”, In
[22] H. Minagawa, T. Fujimura, M. Ichiyanagi, K. Tanaka, and M. Proceedings of the National Academy of Sciences, vol. 115, no. 25, pp.
Fangquan, “Identification of beef cattle by analyzing images of their E5716-E5725, 2018.
muzzle patterns lifted on paper”, Proceedings of the 3rd Asian [39] P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P. A. Manzagol,
Conference for Information Technology in Asian agricultural “Stacked denoising auto-encoders: learning useful representations in a
information technology & management. Publications of the Japanese deep network with a local denoising criterion”, Journal of Machine
Society of Agricultural Informatics, vol. 8, pp. 596–600, 2002. Learning Research, vol. 11, pp. 3371–3408, 2010.
[23] A. Tharwat, T. Gaber, and A. E. Hassanien, “Cattle identification based [40] P. Kamencay, T. Trnovszky, M. Benco, R. Hudec, P. Sykora, and A.
on muzzle images using gabor features and svm classifier”, Proceedings Satnik, “Accurate wild animal recognition using PCA, LDA and
LBPH”, In 2016 ELEKTRO, pp. 62-67, 2016.
98 | P a g e
www.ijacsa.thesai.org