An image-based deep learning network technique for structural health monitoring

When monitoring the structural integrity of a bridge using data collected through accelerometers, identifying the profile of the load exerted on the bridge from the vehicles passing over it becomes a crucial task. In this study, the speed and location of vehicles on the deck of a bridge is reconfigured using real-time video to implicitly associate the load applied to the bridge with the response from the bridge sensors to develop an image-based deep learning network model. Instead of directly measuring the load that a moving vehicle exerts on the bridge, the intention in the proposed method is to replace the correlation between the movement of vehicles from CCTV images and the corresponding response by the bridge with a neural network model. Given the framework of an input-output-based system identification, CCTV images secured from the bridge and the acceleration measurements from a cantilevered beam are combined during the process of training the neural network model. Since in reality, structural damage cannot be induced in a bridge, the focus of the study is on identifying local changes in parameters by adding mass to a cantilevered beam in the laboratory. The study successfully identified the change in the material parameters in the beam by using the deep-learning neural network model. Also, the method correctly predicted the acceleration response of the beam. The proposed approach can be extended to the structural health monitoring of actual bridges, and its sensitivity to damage can also be improved through optimization of the network training.