arXiv subjects

Renzhong Guo

Publications and source records attributed to Renzhong Guo.

3 recordsLinked to original sources

arXiv2024

Hybrid Machine Learning and Physics-based Modelling of Pedestrian Pushing Behaviours at Bottlenecks

In high-density crowds, close proximity between pedestrians makes the steady state highly vulnerable to disruption by pushing behaviours, potentially leading to serious accidents. However, the scarcity of experimental data has hindered systematic studies of its mechanisms and accurate modelling. Using behavioural data from bottleneck experiments, we investigate pedestrian heterogeneity in pushing tendencies, showing that pedestrians tend to push under high-motivation and in wider corridors. We introduce a spatial discretization method to encode neighbour states into feature vectors, serving together with pedestrian pushing tendencies as inputs to a random forest model for predicting pushing behaviours. Through comparing speed-headway relationships, we reveal that pushing behaviours correspond to an aggressive space-utilization movement strategy. Consequently, we propose a hybrid machine learning and physics-based model integrating pushing tendencies heterogeneity, pushing behaviours prediction, and dynamic movement strategies adjustment. Validations show that the hybrid model effectively reproduces experimental crowd dynamics and fits to incorporate additional behaviours.

physics.soc-ph↗

arXiv2024

AsymFormer: Asymmetrical Cross-Modal Representation Learning for Mobile Platform Real-Time RGB-D Semantic Segmentation

Understanding indoor scenes is crucial for urban studies. Considering the dynamic nature of indoor environments, effective semantic segmentation requires both real-time operation and high accuracy.To address this, we propose AsymFormer, a novel network that improves real-time semantic segmentation accuracy using RGB-D multi-modal information without substantially increasing network complexity. AsymFormer uses an asymmetrical backbone for multimodal feature extraction, reducing redundant parameters by optimizing computational resource distribution. To fuse asymmetric multimodal features, a Local Attention-Guided Feature Selection (LAFS) module is used to selectively fuse features from different modalities by leveraging their dependencies. Subsequently, a Cross-Modal Attention-Guided Feature Correlation Embedding (CMA) module is introduced to further extract cross-modal representations. The AsymFormer demonstrates competitive results with 54.1% mIoU on NYUv2 and 49.1% mIoU on SUNRGBD. Notably, AsymFormer achieves an inference speed of 65 FPS (79 FPS after implementing mixed precision quantization) on RTX3090, demonstrating that AsymFormer can strike a balance between high accuracy and efficiency.

cs.CV↗

arXiv2023

Tree-GPT: Modular Large Language Model Expert System for Forest Remote Sensing Image Understanding and Interactive Analysis

This paper introduces a novel framework, Tree-GPT, which incorporates Large Language Models (LLMs) into the forestry remote sensing data workflow, thereby enhancing the efficiency of data analysis. Currently, LLMs are unable to extract or comprehend information from images and may generate inaccurate text due to a lack of domain knowledge, limiting their use in forestry data analysis. To address this issue, we propose a modular LLM expert system, Tree-GPT, that integrates image understanding modules, domain knowledge bases, and toolchains. This empowers LLMs with the ability to comprehend images, acquire accurate knowledge, generate code, and perform data analysis in a local environment. Specifically, the image understanding module extracts structured information from forest remote sensing images by utilizing automatic or interactive generation of prompts to guide the Segment Anything Model (SAM) in generating and selecting optimal tree segmentation results. The system then calculates tree structural parameters based on these results and stores them in a database. Upon receiving a specific natural language instruction, the LLM generates code based on a thought chain to accomplish the analysis task. The code is then executed by an LLM agent in a local environment and . For ecological parameter calculations, the system retrieves the corresponding knowledge from the knowledge base and inputs it into the LLM to guide the generation of accurate code. We tested this system on several tasks, including Search, Visualization, and Machine Learning Analysis. The prototype system performed well, demonstrating the potential for dynamic usage of LLMs in forestry research and environmental sciences.

cs.CV↗