Re-identification in video surveillance systems considering appearance changes

Document Type : Article

Authors

1 Faculty of Computer Engineering, shahrood University of Technology, Shahrood, Iran

2 Institut Galilee, Universite Sorbonne Paris Nord, Villetaneuse, France

Abstract

Human behavior analysis and visual anomaly detection are important applications in fields such as video surveillance, security systems, intelligent houses, and elderly care. People re-identification is one of the main steps in a surveillance system that directly affects system performance; and variations in appearance, pose and scene illumination may be challenging issues for such system. Previous re-identification approaches faced limitations while considering appearance changes in their tracking task. This paper proposes a new approach for people re-identification using a descriptor which is robust to appearance changes. In our proposed method the enhanced Gaussian of Gaussian (GOG) and the Hierarchical Gaussian Descriptors (HGDs) are employed to extract feature vectors from images. Experimental results on a number of commonly used people re-identification databases imply the superiority of the proposed approach in people re-identification compared to other existing approaches.

Keywords

Main Subjects

References

References:
1. Matsukawa, T., Okabe, T., Suzuki, E., et al. "Hierarchical gaussian descriptor for person re-identification", In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1363-1372 (2016).
2. Matsukawa, T., Okabe, T., Suzuki, E., et al. "Hierarchical gaussian descriptors with application to person re-identification", IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1-14 (2019).
3. Liao, S., Hu, Y., Zhu, X., et al. "Person reidenti fication by local maximal occurrence representation and metric learning", In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2197-2206 (2015).
4. Liao, S., Zhao, G., Kellokumpu, V., et al. "Modeling pixel process with scale invariant local patterns for background subtraction in complex scenes", In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1301-1306 (2010).
5. Ullah, M., Ahmed, M., Cheikh, F.A., et al. "A hierarchical feature model for multi-target tracking", In IEEE International Conference on Image Processing (ICIP), pp. 2612-2616 (2017).
6. Mallat, S.G. and Zhang, Z. "Matching pursuits with time-frequency dictionaries", IEEE Transactions on Signal Processing, 41(12), pp. 3397-3415 (1993).
7. Kong, J., Teng, Z., Jiang, M., et al. "Video-based person re-identification with parallel spatial-temporal attention module", Journal of Electronic Imaging, 29(1), pp. 1-17 (2020).
8. Wu, A., Zheng, W.S., and Lai, J.H. "Robust depthbased person re-identification", IEEE Transactions on Image Processing, 26(6), pp. 2588-2603 (2017).
9. Vishwakarma, D.K. and Upadhyay, S. "A deep structure of person re-identification using multi-level gaussian models", IEEE Transactions on Multi-Scale Computing Systems, 4(4), pp. 513-521 (2018).
10. Prates, R. and Schwartz, W.R. "Kernel cross-view collaborative representation based classification for person re-identification", Journal of Visual Communication and Image Representation, 58, pp. 304-315 (2019).
11. Zhou, Q., Fan, H., Zheng, S., et al. "Graph correspondence transfer for person re-identification", In Proceedings of the AAAI Conference on Artificial Intelligence, 32(1), pp. 7599-7606 (2018).
12. Cao, Z., Simon, T., Wei, S., et al. "Realtime multiperson 2D pose estimation using part affinity fields", In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017).
13. Zhou, Q., Fan, H., Yang, H., et al. "Robust and efficient graph correspondence transfer for person reidentification", IEEE Transactions on Image Processing, 30, pp. 1623-1638 (2019).
14. Fang, J., Zhang, R.F., and Jiang, F. "Sample  specific multi-kernel metric learning for person reidentification", In 2nd IEEE International Conference on Electrical and Electronic Engineering, Atlantis Press (2019).
15. Zhao, R., Ouyang, W., and Wang, X. "Unsupervised salience learning for person re-identification", In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3586-3593 (2013).
16. An, L., Kafai, M., Yang, S., et al. "Reference-based person re-identification", In AVSS, pp. 244-249 (2013).
17. Yang, Y., Yang, J., Yan, J., et al. "Salient color names for person re-identification", In 13th European Conference on Computer Vision (ECCV), pp. 536-551 (2014).
18. Ahmed, E., Jones, M., and Marks, T.K. "An improved deep learning architecture for person re-identification", In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2015).
19. Jia, J., Ruan, Q., Jin, Y., et al. "View-specific subspace learning and re-ranking for semi-supervised person re-identification", Pattern Recognition, 108, 107568 (2020).
20. Zhao, C., Wang, X., Zuo, W., et al. "Similarity learning with joint transfer constraints for person re-identification", Pattern Recognition, 97, 107014 (2020).
21. Xu, Y., Fang, X., Wu, J., et al. "Discriminative transfer subspace learning via low-rank and sparse representation", IEEE Trans. Image Process, 25(2), pp. 850-863 (2016).
22. Sun, Y., Zheng, L., Deng, W., et al. "Svdnet for pedestrian retrieval", In Proceedings of the IEEE International Conference on Computer Vision, pp. 3800- 3808 (2017).
23. Zheng, Z., Zheng, L., and Yang Y. "Person alignment network for large-scale person re-identification", IEEE Transactions on Circuits and Systems for Video Technology, 29(10), pp. 3037-3045 (2018).
24. Yu, Y., Liang, C., Ruan, W., et al. "Crowdsourcingbased ranking aggregation for person reidentification", In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1933-1937 (2020).
25. Sun, Y., Zheng, L., Yang, Y., et al. "Beyond part models: person retrieval with refined part pooling (and a strong convolutional baseline)", In Proceedings of the European Conference on Computer Vision (ECCV), pp. 480-496 (2018).
26. He, K., Zhang, X., Ren, S., et al. "Deep residual learning for image recognition", In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770-778 (2016).
27. Wu, S. and Gao, L. "Multi-level joint feature learning for person re-identification", Algorithms, 13(5), pp. 111-129 (2020).
28. Leng, Q. "Co-metric learning for person reidentification", Advances in Multimedia (2018).
29. Bromley, J., Bentz, J.W., Bottou, L., et al. "Signature verification using a "siamese" time delay neural network", International Journal of Pattern Recognition and Artificial Intelligence, 7(4), pp. 669-688 (1993).
30. Chu, H., Qi, M., Liu, H., et al. "Local region partition for person re-identification", Multimedia Tools and Applications, 78, pp. 27067-27083 (2019).
31. Ren, Q.Q., Tian, W.D., and Zhao, Z.Q. "Person reidentification based on feature fusion", In International Conference on Intelligent Computing, pp. 65-73 (2019).
32. Layne, R., Hospedales, T.M., and Gong, S. "Towards person identification and re-identification with attributes", In European Conference on Computer Vision, pp. 402-412 (2012).
33. Zhao, R., Ouyang, W., and Wang, X. "Unsupervised salience learning for person re-identification", In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3586-3593 (2013).
34. Zhao, R., Oyang, W., and Wang, X. "Person reidentification by saliency learning", IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(2), pp. 356-370 (2016).
35. Heller, K., Svore, K., Keromytis, A.D., et al. "One class support vector machines for detecting anomalous windows registry accesses", ICDM Workshop on Data Mining for Computer Security (2003).
36. Martinel, N., Micheloni, C., and Foresti, G.L. "Kernelized saliency-based person re-identification through multiple metric learning", IEEE Transactions on Image Processing, 24(12), pp. 5645-5658 (2015).
37. Harel, J., Koch, C., and Perona, P. "Graph-based visual saliency", In Advances in Neural Information Processing Systems, pp. 545-552 (2007).
38. Li, W., Zhu, X., and Gong, S. "Harmonious attention network for person re-identification", In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2285-2294 (2018).
39. Li, T., Sun, L., Han, C., et al. "Salient region-based least-squares log-density gradient clustering for imageto- video person re-identification", IEEE Access, 6, pp. 8638-8648 (2018).
40. Susan, S. and Kumar, A. "Auto-segmentation using mean-shift and entropy analysis", In 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom), pp. 292-296 (2016).
41. Ashizawa, M., Sasaki, H., Sakai, T., et al. "Leastsquares log-density gradient clustering for riemannian manifolds", In Artificial Intelligence and Statistics, pp. 537-546 (2017).
42. Cheng, M.M., Mitra, N.J., Huang, X., et al. "Global contrast based salient region detection", IEEE Transactions on Pattern Analysis and Machine Intelligence, 37(3), pp. 569-582 (2015).
43. Amari, S. and Nagaoka, H. "Methods of information geometry", Translations of Mathematical Monographs, American Mathematical Society, 191, pp. 269-342 (2007).
44. Li, P., Wang, Q., and Zhang, L. "A novel earth mover's distance methodology for image matching with gaussian mixture models", In IEEE International Conference on Computer Vision (ICCV), pp. 1689- 1696 (2013).
45. Arsigny, V., Fillard, P., Pennec, X., et al. "Geometric means in a novel vector space structure on symmetric positive-definite matrices", SIAM Journal on Matrix Analysis and Applications, 29(1), pp. 328-347 (2007).
46. Lovric, M., Min-Oo, M., and Ruh, E.A. "Multivariate normal distributions parametrized as a riemannian symmetric space", Journal of Multivariate Analysis, 74(1), pp. 36-48 (2000).
47. Moghaddam, B., Jebara, T., and Pentland, A. "Bayesian face recognition",Pattern Recognition, 33(11), pp. 1771-1782 (2000).
48. Koestinger, M., Hirzer, M., Wohlhart, P., et al. "Large scale metric learning from equivalence constraints", In IEEE Conference on Computer Vision and Pattern Recognition, pp. 2288-2295 (2012).
49. Alipanahi, B., Biggs, M., and Ghodsi, A. "Distance metric learning vs. fisher discriminant analysis", In Proceedings of the 23rd National Conference on Artificial Intelligence, 2, pp. 598-603 (2008).
50. Septiarini, A., Hamdani, H., Hatta, H.R., et al. "Automatic image segmentation of oil palm fruits by applying the contour-based approach", Scientia Horticulturae, 261, 108939 (2020).
51. Luong, Q.T. "Color in computer vision", In Handbook of Pattern Recognition and Computer Vision, World Scientific Publishing Co., Inc., pp. 311-368 (1993).
52. Le, K.N. "A mathematical approach to edge detection in hyperbolic-distributed and gaussian-distributed pixel-intensity images using hyperbolic and gaussian masks", Digital Signal Processing, 21(1), pp. 162-181 (2011).
53. Baltieri, D., Vezzani, R., and Cucchiara, R. "3DPeS: 3D people dataset for surveillance and forensics". In Proceedings of the 2011 Joint ACM Workshop on Human Gesture and Behavior Understanding, pp. 59- 64 (2011).
54. Swearingen, T. and Ross, A. "Lookalike disambiguation: improving face identification performance at top ranks". In 2020 25th International Conference on Pattern Recognition (ICPR), pp. 10508-10515 (2021).
55. Mortezaie, Z. and Hassanpour, H. "A survey on age invariant face recognition methods", Jordanian Journal of Computers and Information Technology, 5(2), pp. 87-96 (2019).
56. Li, W., Zhao, R., Xiao, T., et al. "Deepreid: deep filter pairing neural network for person re-identification", In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 152-159 (2014).
57. Gray, D. and Tao, H. "Viewpoint invariant pedestrian recognition with an ensemble of localized features",  In European Conference on Computer Vision, Berlin, Heidelberg, pp. 262-275 (2008).
58. Li, W., Zhao, R., and Wang, X. "Human reidentification with transferred metric learning", In Asian Conference on Computer Vision, pp. 31-44 (2012).
59. Roth, P.M., Hirzer, M., Kvstinger, M., et al. "Mahalanobis distance learning for person re-identification", In Person Re-Identification, pp. 247-267 (2014).
60. Loy, C.C., Xiang, T., and Gong, S. "Time-delayed correlation analysis for multi-camera activity understanding", International Journal of Computer Vision, 90(1), pp. 106-129 (2010).
Scientia Iranica
Volume 31, Issue 2 - Serial Number 2
Transactions on Computer Science & Engineering and Electrical Engineering (D)
January and February 2024
Pages 103-117

Files

History

  • Receive Date: 24 January 2021
  • Revise Date: 29 May 2022
  • Accept Date: 10 September 2023

Share

How to cite

Statistics