A Review on Automatic Visual Inspection for Railway Overhead Contact Line Systems
DOI:
https://doi.org/10.37367/jpi.v8i2.346Keywords:
Railway, Overhead Catenary System, inspection method, Automatic inspection, Computer vision, Image processing, Artificial IntelligenceAbstract
Inspections of overhead catenary systems include checks on the geometry of contact wire, the interaction between contact wire and pantograph, defects in components, worn components, and clearance are necessary to ensure the reliability, availability, maintainability, and safety of railways infrastructure and operation. An automatic visual inspection technology of overhead catenary systems can improve conventional inspection methods' efficiency, cost-effectiveness, and precision. This paper provides an overview and contributions of the research made by scholars in this field, as well as the application and advancement of automated visual inspection technology for railway overhead catenary systems. The projection of the future research direction for automatic inspection in overhead catenary system inspection activities was also provided.
Downloads
References
L. Liudvinavičius and S. Dailydka, “The Aspects of Catenary Maintenance of Direct Current (DC) and Alternating Current (AC),” Procedia Eng., vol. 134, no. Dc, pp. 268–275, 2016, doi: 10.1016/j.proeng.2016.01.007.
A. Oya, K. Nishi, M. Shimizu, T. Mandai, and M. Tago, “Application of overhead rigid conductor line to mountain tunnel of conventional lines,” Proc. IEEE Int. Conf. Ind. Technol., vol. 2005, pp. 170–174, 2005, doi: 10.1109/ICIT.2005.1600630.
J. Wu, “Chapter 1 - Introduction,” in High-Speed Railway, J. B. T.-P. and C. L. S. Wu, Ed. Academic Press, 2018, pp. 1–26. doi: https://doi.org/10.1016/B978-0-12-812886-2.00001-X.
L. Yu, S. Gao, D. Zhang, G. Kang, D. Zhan, and C. Roberts, “A Survey on Automatic Inspections of Overhead Contact Lines by Computer Vision,” IEEE Trans. Intell. Transp. Syst., vol. 23, no. 8, pp. 10104–10125, Aug. 2022, doi: 10.1109/TITS.2021.3119023.
A. Collina, F. Fossati, M. Papi, and F. Resta, “Impact of overhead line irregularity on current collection and diagnostics based on the measurement of pantograph dynamics,” Proc. Inst. Mech. Eng. Part F J. Rail Rapid Transit, vol. 221, no. 4, pp. 547–559, 2007, doi: 10.1243/09544097F02105.
S. Östlund, A. Gustafsson, L. Buhrkall, and M. Skoglund, “Condition monitoring of pantograph contact strip,” IET Semin. Dig., vol. 2008, no. 12216, 2008, doi: 10.1049/ic:20080343.
M. Elia et al., “Condition monitoring of the railway line and overhead equipment through onboard train measurement - An Italian experience,” IET Semin. Dig., vol. 2006, no. 11575, pp. 102–107, 2006, doi: 10.1049/ic:20060052.
Y. Wang et al., “Automatic Visual Inspection and Condition-Based Maintenance for Catenary,” Maint. Manag., pp. 0–16, 2020, doi: 10.5772/intechopen.82149.
T. Usuda, “Prediction of Contact Wire Wear on High-speed Railways Influential Factors on Adhesion between Wheel and Rail under Wet Conditions,” no. 36, p. 2011, 2011.
M. Swift, G. Aurisicchio, and P. Pace, “New practices for railway condition monitoring and predictive analysis,” IET Conf. Publ., vol. 2011, no. 581 CP, 2011, doi: 10.1049/cp.2011.0578.
A. Takahashi, T. Kishi, and H. Yamamoto, “Overhead Contact Line Monitoring and Prediction of Contact Wire Localized Wear Points,” JR East Tech. Rev., vol. 29, no. 29, pp. 22–25, 2014, [Online]. Available: http://trid.trb.org/view/2014/C/1350994
S. Liu, Q. Wang, and Y. Luo, “A review of applications of visual inspection technology based on image processing in the railway industry,” Transp. Saf. Environ., vol. 1, no. 3, pp. 185–204, 2019, doi: 10.1093/tse/tdz007.
S. B. Gao, Z. G. Liu, and L. Yu, “Detection and monitoring system of the pantograph-catenary in high-speed railway (6C),” 2017 7th Int. Conf. Power Electron. Syst. Appl. - Smart Mobility, Power Transf. Secur. PESA 2017, vol. 2018-Janua, pp. 1–7, 2018, doi: 10.1109/PESA.2017.8277746.
S. Gao, “Automatic Detection and Monitoring System of Pantograph-Catenary in China’s High-Speed Railways,” IEEE Trans. Instrum. Meas., vol. 70, 2021, doi: 10.1109/TIM.2020.3022487.
D. Risti, M. Franke, and K. Michels, “A Review of Vision-Based On-Board Obstacle Detection and,” 2021.
Z. Liu, Y. Song, Y. Han, H. Wang, J. Zhang, and Z. Han, “Advances of research on high-speed railway catenary,” J. Mod. Transp., vol. 26, no. 1, pp. 1–23, 2018, doi: 10.1007/s40534-017-0148-4.
Dr Saeed Fararooy, Clemens Mair, “Review of Railway Overhead Wire Geometry Measurement systems,” pp. 16–19, 1998.
P. M. Keen, “Monitoring overhead line equipment,” IEE Colloq., no. 509, pp. 2–4, 1998, doi: 10.1049/ic:19981002.
I. Aydin, M. Karaköse, and E. Akin, “A robust anomaly detection in pantograph-catenary system based on mean-shift tracking and foreground detection,” Proc. - 2013 IEEE Int. Conf. Syst. Man, Cybern. SMC 2013, pp. 4444–4449, 2013, doi: 10.1109/SMC.2013.757.
Z. Liu, W. Liu, and Z. Han, “A high-precision detection approach for catenary geometry parameters of electrical railway,” IEEE Trans. Instrum. Meas., vol. 66, no. 7, pp. 1798–1808, 2017, doi: 10.1109/TIM.2017.2666358.
Japanese National Railways, “Overhead Contact System,” in Railway Electrification, 2nd ed., 1988, p. 81.
S. Midya, D. Bormann, T. Schütte, and R. Thottappillil, “Pantograph arcing in electrified railways-mechanism and influence of various parameters - Part II: With AC traction power supply,” IEEE Trans. Power Deliv., vol. 24, no. 4, pp. 1940–1950, 2009, doi: 10.1109/TPWRD.2009.2021036.
Y. Bai, J. Zhang, W. Liu, and X. Liu, “Study on influence of contact wire design parameters on contact characteristics of Pantograph-Catenary,” IEEE ICIRT 2013 - Proc. IEEE Int. Conf. Intell. Rail Transp., pp. 268–273, 2013, doi: 10.1109/ICIRT.2013.6696306.
Menteri Perhubungan, “Persyaratan Teknis Jalur Kereta Api,” PM. No. 60 Tahun 2012, pp. 1–57, 2012.
G. Jing, X. Qin, H. Wang, and C. Deng, “Developments, challenges, and perspectives of railway inspection robots,” Autom. Constr., vol. 138, no. January, p. 104242, 2022, doi: 10.1016/j.autcon.2022.104242.
M. A. Abdullah, Y. Michitsuji, and M. Nagai, “System identification of railway trains pantograph for active pantograph simulation,” MOVIC 2010 - 10th Int. Conf. Motion Vib. Control. Proc., no. June 2014, 2010, doi: 10.1299/jsmemovic.2010._2c31-1_.
C. O’Donnell, R. Palacin, and J. Rosinski, Pantograph Damage and Wear Monitoring System. 2006. doi: 10.1049/ic:20060065.
P. Boffi et al., “Optical fiber sensors to measure collector performance in the pantograph-catenary interaction,” IEEE Sens. J., vol. 9, no. 6, pp. 635–640, 2009, doi: 10.1109/JSEN.2009.2020244.
M. Bocciolone, G. Bucca, A. Collina, and L. Comolli, “Pantograph-catenary monitoring by means of fibre Bragg grating sensors: Results from tests in an underground line,” Mech. Syst. Signal Process., vol. 41, no. 1–2, pp. 226–238, 2013, doi: 10.1016/j.ymssp.2013.06.030.
S. Sung, “A study on the measurement of contact force of pantograph on high speed train,” KSME Int. J., vol. 20, no. 10, p. 1548~1556, 2006.
J. Peng et al., “Dynamic detection for the contact line gradient in electrified railway,” High-Power Diode Laser Technol. Appl. VII, vol. 7198, p. 71981P, 2009, doi: 10.1117/12.808602.
R. Puschmann and D. Wehrhahr, “Ultrasonic measurement of contact wire position,” Eb-Elektriche Bahnen, vol. 109, no. 7, pp. 323–324, 2011.
S. Wang, L. Niu, and N. Li, “Research on Image Recognition of Insulators Based on YOLO Algorithm,” 2018 Int. Conf. Power Syst. Technol., no. 201805150000003, pp. 3871–3874, 2018.
R. Ge, Y. Zhu, Y. Xiao, and Z. Chen, “The subway pantograph detection using modified faster R-CNN,” Commun. Comput. Inf. Sci., vol. 685, pp. 197–204, 2017, doi: 10.1007/978-981-10-4211-9_20.
L. De Donato et al., “A Survey on Audio-Video Based Defect Detection Through Deep Learning in Railway Maintenance,” IEEE Access, vol. 10, pp. 65376–65400, 2022, doi: 10.1109/ACCESS.2022.3183102.
M. Di Summa et al., “A Review on Deep Learning Techniques for Railway Infrastructure Monitoring,” IEEE Access, vol. 11, no. July, pp. 114638–114661, 2023, doi: 10.1109/ACCESS.2023.3309814.
M. Elgendy, Deep Learning for Vision Systems. Manning Publications, 2020. [Online]. Available: https://books.google.co.id/books?id=6gkLzAEACAAJ
F. V. Sncf, “Contribution of Terrestrial Laser Scanning for monitoring and inspection of railway infrastructure,” no. November, 2013.
British Standards Institution, “British Standards Institution (2012) BS EN 50317: Railway applications. Current collection systems. Requirements for and validation of measurements of the dynamic interaction between pantograph and overhead contact line between pantograph and overhead con,” p. 20, 2012.
I. Aydin, M. Karakose, and E. Akin, “Anomaly detection using a modified kernel-based tracking in the pantograph-catenary system,” Expert Syst. Appl., vol. 42, no. 2, pp. 938–948, 2015, doi: 10.1016/j.eswa.2014.08.026.
C. J. Cho and H. Ko, “Video-based dynamic stagger measurement of railway overhead power lines using rotation-invariant feature matching,” IEEE Trans. Intell. Transp. Syst., vol. 16, no. 3, pp. 1294–1304, 2015, doi: 10.1109/TITS.2014.2361647.
P. Catenary et al., “LabVIEW application for motion tracking using USB camera LabVIEW application for motion tracking using USB camera,” 2017, doi: 10.1088/1757-899X/200/1/012008.
S. R. Anghel, M. Panoiu, and C. Abrudean, “Intelligent Application for Monitoring the Pantograph-Catenary Contact in Electric Railway Transportation,” 2018 3rd Int. Conf. Smart Sustain. Technol. Split. 2018, no. Lc, pp. 1–6, 2018.
D. Zhan, D. Jing, M. Wu, D. Zhang, L. Yu, and T. Chen, “An Accurate and Efficient Vision Measurement Approach for Railway Catenary Geometry Parameters,” IEEE Trans. Instrum. Meas., vol. 67, no. 12, pp. 2841–2853, 2018, doi: 10.1109/TIM.2018.2830862.
Z. Huang, L. Chen, Y. Zhang, Z. Yu, H. Fang, and T. Zhang, “Robust contact-point detection from pantograph-catenary infrared images by employing horizontal-vertical enhancement operator,” Infrared Phys. Technol., vol. 101, no. June, pp. 146–155, 2019, doi: 10.1016/j.infrared.2019.06.015.
D. Zhang, S. Gao, L. Yu, G. Kang, D. Zhan, and X. Wei, “A Robust Pantograph-Catenary Interaction Condition Monitoring Method Based on Deep Convolutional Network,” IEEE Trans. Instrum. Meas., vol. 69, no. 5, pp. 1920–1929, 2020, doi: 10.1109/TIM.2019.2920721.
Y. G. Wang et al., “Construction of Visual Inspection Database for Catenary on High-speed Railways,” MATEC Web Conf., vol. 124, pp. 1–5, 2017, doi: 10.1051/matecconf/201712401006.
J. Chen, Z. Liu, H. Wang, A. Nunez, and Z. Han, “Automatic defect detection of fasteners on the catenary support device using deep convolutional neural network,” IEEE Trans. Instrum. Meas., vol. 67, no. 2, pp. 257–269, 2018, doi: 10.1109/TIM.2017.2775345.
Y. Liu et al., “A Coarse-to-Fine Detection Method of Pantograph-Catenary Contact Points Using DCNNs,” IFAC-PapersOnLine, vol. 52, no. 24, pp. 71–75, 2019, doi: 10.1016/j.ifacol.2019.12.383.
G. Kang, S. Gao, L. Yu, and D. Zhang, “Deep Architecture for High-Speed Railway Insulator Surface Defect Detection: Denoising Autoencoder with Multitask Learning,” IEEE Trans. Instrum. Meas., vol. 68, no. 8, pp. 2679–2690, 2019, doi: 10.1109/TIM.2018.2868490.
P. Tan et al., “Mask R-CNN and multifeature clustering model for catenary insulator recognition and defect detection,” J. Zhejiang Univ. Sci. A, vol. 23, no. 9, pp. 745–756, 2022, doi: 10.1631/jzus.A2100494.
A. Landi, L. Menconi, and L. Sani, “Hough transform and thermo-vision for monitoring pantograph-catenary system,” Proc. Inst. Mech. Eng. Part F J. Rail Rapid Transit, vol. 220, no. 4, pp. 435–447, 2006, doi: 10.1243/0954409JRRT41.
I. Aydin, M. Karakose, and E. Akin, “A new contactless fault diagnosis approach for pantograph-catenary system,” Proc. 15th Int. Conf. Mechatronics, MECHATRONIKA 2012, 2012.
T. Koyama, M. Ikeda, K. Nakamura, S. Tabayashi, and M. Niwakawa, “Measuring the contact force of a pantograph by image processing technology,” WIT Trans. Built Environ., vol. 127, pp. 189–198, 2012, doi: 10.2495/CR120171.
I. Aydin, E. Karakose, M. Karakose, M. T. Gencoglu, and E. Akin, “A new computer vision approach for active pantograph control,” 2013 IEEE Int. Symp. Innov. Intell. Syst. Appl. IEEE INISTA 2013, 2013, doi: 10.1109/INISTA.2013.6577665.
I. Aydin, “A new approach based on firefly algorithm for vision-based railway overhead inspection system,” MEASUREMENT, vol. 74, pp. 43–55, 2015, doi: 10.1016/j.measurement.2015.07.022.
M. R. Arthington, P. T. Barnes, and S. R. Duncan, “Non-contact force measurement for current collection in a 25kV overhead line electrified railway,” IET Conf. Publ., vol. 2016, no. CP701, pp. 1–6, 2016, doi: 10.1049/cp.2016.1206.
G. Karaduman, M. Karakose, and E. Akin, “Deep Learning Based Arc Detection in Pantograph-Catenary Systems,” pp. 904–908, 2017.
H. Möller, B. Hulin, W. Krötz, and B. Sarnes, “Video based obstacle detection in catenaries of railways,” Proceeding 6th Int. Conf. Pattern Recognit. Inf. Process., vol. 1, no. 7, pp. 275–287, 2001.
X. Wu, P. Yuan, Q. Peng, C. W. Ngo, and J. Y. He, “Detection of bird nests in overhead catenary system images for high-speed rail,” Pattern Recognit., vol. 51, pp. 242–254, 2016, doi: 10.1016/j.patcog.2015.09.010.
R. Tian, H. Shi, B. Guo, and L. Zhu, “Multi-scale object detection for high-speed railway clearance intrusion,” Appl. Intell., vol. 52, no. 4, pp. 3511–3526, 2022, doi: 10.1007/s10489-021-02534-9.
S. Kovalskyi and V. Koval, “Comparison of image processing techniques for defect detection,” 2024.
T. Lei and A. K. Nandi, Image Segmentation. Wiley, 2022. doi: 10.1002/9781119859048.
H. Feng, Z. Jiang, F. Xie, P. Yang, J. Shi, and L. Chen, “Automatic fastener classification and defect detection in vision-based railway inspection systems,” IEEE Trans. Instrum. Meas., vol. 63, no. 4, pp. 877–888, 2014, doi: 10.1109/TIM.2013.2283741.
P. Somwang and E. Muangklang, “Image Processing for Quality Control in Manufacturing Process,” in 2019 16th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON), Jul. 2019, pp. 782–785. doi: 10.1109/ECTI-CON47248.2019.8955421.
HCL technologies, “Decoding the dichotomy: Traditional Image Processing vs. Deep Learning Whitepaper,” Imaging Mach. Vis. Eur., pp. 1–6, 2020, [Online]. Available: https://www.imveurope.com/sites/default/files/content/white-paper/pdfs/HCL_IMVE_WP-ImageProcessing_vs_DL.pdf
J. Yang, S. Li, Z. Wang, H. Dong, J. Wang, and S. Tang, “Using deep learning to detect defects in manufacturing: A comprehensive survey and current challenges,” Materials (Basel)., vol. 13, no. 24, pp. 1–23, 2020, doi: 10.3390/ma13245755.
I. Aydin, O. Yaman, M. Karaköse, and S. B. Çelebi, “Particle swarm based arc detection on time series in pantograph-catenary system,” INISTA 2014 - IEEE Int. Symp. Innov. Intell. Syst. Appl. Proc., pp. 344–349, 2014, doi: 10.1109/INISTA.2014.6873642.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Jurnal Perkeretaapian Indonesia (Indonesian Railway Journal)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
The Authors submitting a manuscript do so on the understanding that if accepted for publication, the copyright of the article shall be assigned to Jurnal Perkeretaapian Indonesia (Indonesian Railway Journal).
