arXiv subjects

Shiyin Wei

Publications and source records attributed to Shiyin Wei.

4 recordsLinked to original sources

arXiv2025

SDIGLM: Leveraging Large Language Models and Multi-Modal Chain of Thought for Structural Damage Identification

Existing computer vision(CV)-based structural damage identification models demonstrate notable accuracy in categorizing and localizing damage. However, these models present several critical limitations that hinder their practical application in civil engineering(CE). Primarily, their ability to recognize damage types remains constrained, preventing comprehensive analysis of the highly varied and complex conditions encountered in real-world CE structures. Second, these models lack linguistic capabilities, rendering them unable to articulate structural damage characteristics through natural language descriptions. With the continuous advancement of artificial intelligence(AI), large multi-modal models(LMMs) have emerged as a transformative solution, enabling the unified encoding and alignment of textual and visual data. These models can autonomously generate detailed descriptive narratives of structural damage while demonstrating robust generalization across diverse scenarios and tasks. This study introduces SDIGLM, an innovative LMM for structural damage identification, developed based on the open-source VisualGLM-6B architecture. To address the challenge of adapting LMMs to the intricate and varied operating conditions in CE, this work integrates a U-Net-based semantic segmentation module to generate defect segmentation maps as visual Chain of Thought(CoT). Additionally, a multi-round dialogue fine-tuning dataset is constructed to enhance logical reasoning, complemented by a language CoT formed through prompt engineering. By leveraging this multi-modal CoT, SDIGLM surpasses general-purpose LMMs in structural damage identification, achieving an accuracy of 95.24% across various infrastructure types. Moreover, the model effectively describes damage characteristics such as hole size, crack direction, and corrosion severity.

cs.CV↗

arXiv2023

A robust deep learning-based damage identification approach for SHM considering missing data

Data-driven method for Structural Health Monitoring (SHM), that mine the hidden structural performance from the correlations among monitored time series data, has received widely concerns recently. However, missing data significantly impacts the conduction of this method. Missing data is a frequently encountered issue in time series data in SHM and many other real-world applications, that harms to the standardized data mining and downstream tasks, such as condition assessment. Imputation approaches based on spatiotemporal relations among monitoring data are developed to handle this issue, however, no additional information is added during imputation. This paper thus develops a robust method for damage identification that considers the missing data occasions, based on long-short term memory (LSTM) model and dropout mechanism in the autoencoder (AE) framework. Inputs channels are randomly dropped to simulate the missing data in training, and reconstruction errors are used as the loss function and the damage indicator. Quasi-static response (cable tension) of a cable-stayed bridge released in 1st IPC-SHM is employed to verify this proposed method, and results show that the missing data imputation and damage identification can be implemented together in a unified way.

cs.LG↗

arXiv2022

A change-point detection method for detecting and locating the abrupt changes in distributions of damage-sensitive features of SHM data, with application to structural condition assessment

Diagnosing the changes of structural behaviors using monitoring data is an important objective of structural health monitoring (SHM). The changes in structural behaviors are usually manifested as the feature changes in monitored structural responses; thus, developing effective methods for automatically detecting such changes is of considerable significance. Existing methods for change detection in SHM are mainly used for scalar or vector data, thus incapable of detecting the changes of the features represented by complex data, e.g., the probability density functions (PDFs). Detecting the abrupt changes occurred in the distributions (represented by PDFs) associated with the damage-sensitive features extracted from SHM data are usually of crucial interest for structural condition assessment; however, the SHM community still lacks effective diagnostic tools for detecting such changes. In this study, a change-point detection method is developed in the functional data-analytic framework for PDF-valued sequence, and it is leveraged to diagnose the distributional information break encountered in structural condition assessment. A major challenge in PDF-valued data modeling or analysis is that the PDFs are special functional data subjecting to nonlinear constraints. To tackle this issue, the PDFs are embedded into the Bayes space, and the associated change-point model is constructed by using the linear structure of the Bayes space; then, a hypothesis testing procedure is presented for distributional change-point detection based on the isomorphic mapping between the Bayes space and a functional linear space. Comprehensive simulation studies are conducted to validate the effectiveness of the proposed method as well as demonstrate its superiority over the competing method. Finally, an application to real SHM data illustrates its practical utility in structural condition assessment.

stat.ME↗

arXiv2018

General solutions for nonlinear differential equations: a rule-based self-learning approach using deep reinforcement learning

A universal rule-based self-learning approach using deep reinforcement learning (DRL) is proposed for the first time to solve nonlinear ordinary differential equations and partial differential equations. The solver consists of a deep neural network-structured actor that outputs candidate solutions, and a critic derived only from physical rules (governing equations and boundary and initial conditions). Solutions in discretized time are treated as multiple tasks sharing the same governing equation, and the current step parameters provide an ideal initialization for the next owing to the temporal continuity of the solutions, which shows a transfer learning characteristic and indicates that the DRL solver has captured the intrinsic nature of the equation. The approach is verified through solving the Schr\"odinger, Navier-Stokes, Burgers', Van der Pol, and Lorenz equations and an equation of motion. The results indicate that the approach gives solutions with high accuracy, and the solution process promises to get faster.

cs.LG↗