Using Artificial Intelligence to Identify Damaged Goods by the External Appearance of the Package when Performing Logistics Operations

A proposed promising method for recognising damaged goods by external appearance of packaging using a learning neural network considers the predicted long-term growth in the volume of transported goods, the increasing influence of economic and territorial factors on transportation processes, the complexity of logistics services and the increase in requirements for their quality, the spread of information technology and the improvement of artificial intelligence tools.
The objective of the study is to describe the principles of using an artificial neural network to identify damaged goods by their external appearance. The relevance of the problem is confirmed by data on damage to goods during transportation. The methods used in the study help collecting and analysing data, describing and comparing existing and promising technologies, monitoring and modelling the process of cargo handling, and summarising the results. The analysis of common and promising methods of prevention and detection of cargo damage is backed by the results of research on detecting defects on various surfaces and recognising signs and colours in motion using intelligent technologies.
The problems of recognising damages on packaging in complex and unfavourable conditions for machine vision are solved with the help of a convolutional neural network. In accordance with the proposed algorithm, image capture is carried out using standard video surveillance cameras. From the image entered into the neural network, fragments with characteristic features are distinguished, which are further checked for compliance with damage patterns. Following damage contour analysis, the neural network recognises the cargo as damaged. The process of training the neural network and integrating the proposed tool throughout the supply chain ensures the recognition of actually damaged goods and elimination of errors associated with minor permissible damage and packaging features. The proposed concept does not require the installation of additional equipment and does not imply a significant cost of damaged cargo recognition services. The paper offers and describes processes of video recording of the cargo flow, loading an image into a neural network, and a model for recognising damaged cargo by the external appearance of the package.

1. Sezer, A. A., Fredriksson, A. Paving the Path towards Efficient Construction Logistics by Revealing the Current Practice and Issues. Logistics, 2021, Vol. 5, Iss. 3, p. 53. DOI: https://doi.org/10.3390/logistics5030053.

2. Roth, M., Klarmann, A., Franczyk, B. Future Logistics – Challenges, Requirements and Solutions for Logistics Networks. International Journal of Mechanical, Aerospace, Industrial, Mechatronic and Manufacturing Engineering, 2013, Vol. 7, Iss. 10, pp. 898–903. [Электронный ресурс]: https://www.researchgate.net/publication/260401798_Future_Logistics_-_Challenges_Requirements_and_Solutions_for_Logistics_Networks. Доступ 17.06.2022.

3. He, Yi; Sun, Changxin; Huang, Helai; Jiang, Liang; Ma, Ming; Wang, Pei; Wu, Chaozhong. Safety of micromobility: Riders’ psychological factors and risky behaviors of cargo TTWs in China. Transportation Research Part F: Traffic Psychology and Behaviour, 2021, Vol. 80, pp. 189–202. DOI:10.1016/j.trf.2021.04.001.

4. Kozorezova, O. N. Liability of the carrier for nonpreservation of the cargo under the contract of carriage by rail. Aktualnie nauchnie issledovaniya v sovremennom mire, 2021, Iss. 2–9, pp. 137–140. [Electronic resource]: https://elibrary.ru/item.asp?id=44878063. Last accessed 17.06.2022.

5. Gorborukov, V. Transport logistics. Professional Rules [Transportnaya logistika. Pravila professionalov]. Litres, 2022, 330 p. ISBN 978-5-4493-9452-1.

6. StrategyR Influencer Driven. Logistics Insurance World Market Report. Highlights & Report Index. [Electronic resource]: https://www.strategyr.com/market-reportlogistics-insurance-forecasts-global-industry-analysts-inc.asp. Last accessed 17.06.2022.

7. Busel, A. A. Object of insurance as an essential condition contract of transport insurance of giids. Vestnik of Polotsk State University. Part D. Economic and legal sciences, 2021, Vol. 1, Iss. 6, pp. 160–164. [Electronic resource]: https://vestnik-d.psu.by/jour/article/view/921. Last accessed 17.06.2022.

8. De Andres Gonzalez, O., Koivisto, H., Mustonen, J., Keinänen-Toivola, M. Digitalization in Just-In-Time Approach as a Sustainable Solution for Maritime Logistics in the Baltic Sea Region. Sustainability, 2021, Vol. 13 (3), pp. 1173. DOI: https://doi.org/10.3390/su13031173.

9. Zakharov, S. V. Theoretical and methodological approaches to formation of the methods and tools for analysis of the state policy of the transportation system development. Rostov-on-Don, LLC Forwarder, 2021, Iss. 22, pp. 62–69. DOI: https://doi.org/10.5281/zenodo.5115680.

10. Malyshev, M. I. Innovative tools for ensuring omnichannel in supply chain management [Innovatsionnie instrument obespecheniya omnikanalnosti v upravlenii tsepyami postavok]. Technologies of the information society: Proceedings of XVI International Branch Scientific and Technical Conference, Moscow, March 02–03, 2022. Moscow, LLC Publishing house Media publisher, 2022, pp. 256–258. [Electronic resource]: https://elibrary.ru/item.asp?id=48667738&pff=1. Last accessed 17.06.2022.

11. Holubčík, M., Koman, G., Soviar, J. Industry 4.0 in Logistics Operations. Transportation Research Procedia, 2021, Vol. 53, pp. 282–288. DOI: https://doi.org/10.1016/j.trpro.2021.02.040.

12. Singh, R., Sharma, R., Akram, S. V., Gehlot, A., Buddhi, D., Malik, P. K., Arya, R. Highway 4.0: Digitalization of highways for vulnerable road safety development with intelligent IoT sensors and machine learning. Safety Science, 2021, Vol. 143, pp. 105407. DOI: https://doi.org/10.1016/j.ssci.2021.105407.

13. He, Yunze; Deng, Baoyuan; Wang, Hongjin; Cheng, Liang; Zhou, Ke; Cai, Siyuan; Ciampa, F. Infrared machine vision and infrared thermography with deep learning: Areview. Infrared Physics & Technology, 2021, Vol. 116 (2), pp. 103754. DOI:10.1016/j.infrared.2021.103754.

14. Jiang, Hua Feng; Hao, Yuan; Yun, Qing Hu; Jun, Lin; Shi, Wang Liu; Xiao, Luo. Research on deep learning method for rail surface defect detection. IET Electrical Systems in Transportation, 2020, Vol. 10, No. 4, pp. 436–442. DOI: https://doi.org/10.1049/iet-est.2020.0041. [Electronic resource]: https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/iet-est.2020.0041. Last accessed 17.06.2022.

15. Kherraki, A., Ouazzani, R. E. Deep convolutional neural networks architecture for an efficient emergency vehicle classification in real-time traffic monitoring. IAES International Journal of Artificial Intelligence (IJ-AI), 2022, Vol. 11, Iss. 1. DOI: http://doi.org/10.11591/ijai.v11.i1. pp. 110–120.

16. Yépez, J., Castro-Zunti, R., Cho, Y., Seok-Bum, Ko [et al]. Real‐time CVSA decals recognition system using deep convolutional neural network architectures. IET Intelligent Transport Systems, 2021, Vol. 15, Iss. 11, pp. 1359–1371. DOI: https://doi.org/10.1049/itr2.12103.

17. Uspenskiy, I. A., Yukhin, I. A., Ryabchikov, D., Rembalovich, G. K. Development and testing of a conveyor for detecting various types of vehicles when transporting agricultural products from the field. IOP Conference Series: Materials Science and Engineering. IOP Publishing, 2020, Vol. 832, Iss. 1, pp. 012059. DOI:10.1088/1757-899X/832/1/012059.

18. Song, Weidong; Jia, Guohui; Zhu, Hong; Jia, Di; Gao, Lin. Automated Pavement Crack Damage Detection Using Deep Multiscale Convolutional Features. Journal of Advanced Transportation, 2020. DOI: https://doi.org/10.1155/2020/6412562.

19. Malyshev, M. I. Review of research in the field of improving the efficiency of multimodal transportation based on technological solutions [Obzor isssledovanii v oblasti povysheniya effektivnosti multimodalnykh perevozok na osnove tekhnologicheskikh reshenii]. Scientific Bulletin of Moscow State Technical University of Civil Aviation, 2020, Vol. 23, Iss. 4, pp. 58–71. DOI:10.26467/2079-0619-2020-23-4-58-71.

20. Raut, R., Krit, S., Chatterjee, P. Machine Vision for Industry 4.0: Applications and Case Studies. CRC Press, 2022, 322 p. ISBN 9780367637125.