arXiv subjects

Der-Horng Lee

Publications and source records attributed to Der-Horng Lee.

7 recordsLinked to original sources

arXiv2025

CORE: Compact Object-centric REpresentations as a New Paradigm for Token Merging in LVLMs

Large Vision-Language Models (LVLMs) usually suffer from prohibitive computational and memory costs due to the quadratic growth of visual tokens with image resolution. Existing token compression methods, while varied, often lack a high-level semantic understanding, leading to suboptimal merges, information redundancy, or context loss. To address these limitations, we introduce CORE (Compact Object-centric REpresentations), a new paradigm for visual token compression. CORE leverages an efficient segmentation decoder to generate object masks, which serve as a high-level semantic prior to guide the merging of visual tokens into a compact set of object-centric representations. Furthermore, a novel centroid-guided sorting mechanism restores a coherent spatial order to the merged tokens, preserving vital positional information. Extensive experiments show that CORE not only establishes a new state-of-the-art on six authoritative benchmarks for fixed-rate compression, but also achieves dramatic efficiency gains in adaptive-rate settings. Even under extreme compression, after aggressively retaining with only 2.2% of all visual tokens, CORE still maintains 97.4% of baseline performance. Our work demonstrates the superiority of object-centric representations for efficient and effective LVLM processing.

cs.CV↗

arXiv2025

Adaptive Graph Pruning for Multi-Agent Communication

Large Language Model (LLM) based multi-agent systems have shown remarkable performance in various tasks, especially when enhanced through collaborative communication. However, current methods often rely on a fixed number of agents and static communication structures, limiting their ability to adapt to varying task complexities. In this paper, we propose Adaptive Graph Pruning (AGP), a novel task-adaptive multi-agent collaboration framework that jointly optimizes agent quantity (hard-pruning) and communication topology (soft-pruning). Specifically, our method employs a two-stage training strategy: firstly, independently training soft-pruning networks for different agent quantities to determine optimal agent-quantity-specific complete graphs and positional masks across specific tasks; and then jointly optimizing hard-pruning and soft-pruning within a maximum complete graph to dynamically configure the number of agents and their communication topologies per task. Extensive experiments demonstrate that our approach is: (1) High-performing, achieving state-of-the-art results across six benchmarks and consistently generalizes across multiple mainstream LLM architectures, with a increase in performance of $2.58\%\sim 9.84\%$; (2) Task-adaptive, dynamically constructing optimized communication topologies tailored to specific tasks, with an extremely high performance in all three task categories (general reasoning, mathematical reasoning, and code generation); (3) Token-economical, having fewer training steps and token consumption at the same time, with a decrease in token consumption of $90\%+$; and (4) Training-efficient, achieving high performance with very few training steps compared with other methods. The performance will surpass the existing baselines after about ten steps of training under six benchmarks.

cs.CL↗

arXiv2022

Exploring the relationship between built environment and bike-sharing demand: Does the trip length matter?

Bike-sharing has received considerable practice and research attention over the past decade. As a manpower-driven transportation mode, it seems more sensitive to trip length, since one could take a shared bike to a destinated place where is too far to walk, or choose it for simply replacing walking when going to a nearby place. However, little research has paid attention to it, i.e., the differentiated effects of built environment on the bike-sharing demand with trip lengths. To fill the gap, this paper identifies a threshold of bike-sharing trip lengths from bike-sharing trace data, and employs a semiparametric geographically weighted Poisson regression (SGWPR) model to investigate the relationship between built environment and bike-sharing demand with different lengths considering the heterogeneity in the relationship. The results show that built environment has heterogeneous effects on the bike-sharing demand in urban areas, and the effects differ across groups with trip lengths. The findings contribute to understanding the relationships between built environment and bike-sharing demand, and providing supports for the placements and dispatchment of shared bikes.

physics.soc-ph↗

arXiv2022

Assessing the dynamic vulnerability of an urban rail transit system and a case study of Beijing, China

Urban rail transit is the backbone of urban transportation, and thus it is significant to understand its vulnerability, i.e., whether the system can still maintain normal operations when facing operational disturbances with different magnitudes. To this end, this paper proposes a network vulnerability assessment method with the joint consideration of static network topology and dynamic travel demand. The method includes an accessibility-based identification of station importance with time-varying passenger demand and a new dynamic vulnerability evaluation index. An empirical analysis is carried out by taking the rail transit system of Beijing, China as an example. Results show that the distribution of high-importance stations varies with the time of day, affected by both static topology and hourly-changing passenger flow. Under the disturbance of operation delay, the impact of high-importance stations on the network vulnerability changes with the increase of delayed travel demand. It is also found that some stations that serve as bridges (i.e., reasonable paths link the origin station and destination) and are visited by large passenger flow have the greatest impact on network vulnerability. Network performance degradation is obviously segmented and stratified in the case of interval continuous failure. The disruption between different lines is the main reason for system performance degradation, and some important stations within the line will act as catalysts to accelerate the performance degradation. This method provides a reference for measuring dynamic passenger flow-related network vulnerability and supplies the field with a new vulnerability evaluation index.

math.DS↗

arXiv2014

Quantifying long-term evolution of intra-urban spatial interactions

Understanding the long-term impact that changes in a city's transportation infrastructure have on its spatial interactions remains a challenge. The difficulty arises from the fact that the real impact may not be revealed in static or aggregated mobility measures, as these are remarkably robust to perturbations. More generally, the lack of longitudinal, cross-sectional data demonstrating the evolution of spatial interactions at a meaningful urban scale also hinders us from evaluating the sensitivity of movement indicators, limiting our capacity to understand the evolution of urban mobility in depth. Using very large mobility records distributed over three years we quantify the impact of the completion of a metro line extension: the circle line (CCL) in Singapore. We find that the commonly used movement indicators are almost identical before and after the project was completed. However, in comparing the temporal community structure across years, we do observe significant differences in the spatial reorganization of the affected geographical areas. The completion of CCL enables travelers to re-identify their desired destinations collectively with lower transport cost, making the community structure more consistent. These changes in locality are dynamic, and characterized over short time-scales, offering us a different approach to identify and analyze the long-term impact of new infrastructures on cities and their evolution dynamics.

physics.soc-ph↗

arXiv2014

Efficient detection of contagious outbreaks in massive metropolitan encounter networks

Physical contact remains difficult to trace in large metropolitan networks, though it is a key vehicle for the transmission of contagious outbreaks. Co-presence encounters during daily transit use provide us with a city-scale time-resolved physical contact network, consisting of 1 billion contacts among 3 million transit users. Here, we study the advantage that knowledge of such co-presence structures may provide for early detection of contagious outbreaks. We first examine the "friend sensor" scheme --- a simple, but universal strategy requiring only local information --- and demonstrate that it provides significant early detection of simulated outbreaks. Taking advantage of the full network structure, we then identify advanced "global sensor sets", obtaining substantial early warning times savings over the friends sensor scheme. Individuals with highest number of encounters are the most efficient sensors, with performance comparable to individuals with the highest travel frequency, exploratory behavior and structural centrality. An efficiency balance emerges when testing the dependency on sensor size and evaluating sensor reliability; we find that substantial and reliable lead-time could be attained by monitoring only 0.01% of the population with the highest degree.

physics.soc-ph↗

arXiv2013

Understanding metropolitan patterns of daily encounters

Understanding of the mechanisms driving our daily face-to-face encounters is still limited; the field lacks large-scale datasets describing both individual behaviors and their collective interactions. However, here, with the help of travel smart card data, we uncover such encounter mechanisms and structures by constructing a time-resolved in-vehicle social encounter network on public buses in a city (about 5 million residents). This is the first time that such a large network of encounters has been identified and analyzed. Using a population scale dataset, we find physical encounters display reproducible temporal patterns, indicating that repeated encounters are regular and identical. On an individual scale, we find that collective regularities dominate distinct encounters' bounded nature. An individual's encounter capability is rooted in his/her daily behavioral regularity, explaining the emergence of "familiar strangers" in daily life. Strikingly, we find individuals with repeated encounters are not grouped into small communities, but become strongly connected over time, resulting in a large, but imperceptible, small-world contact network or "structure of co-presence" across the whole metropolitan area. Revealing the encounter pattern and identifying this large-scale contact network are crucial to understanding the dynamics in patterns of social acquaintances, collective human behaviors, and -- particularly -- disclosing the impact of human behavior on various diffusion/spreading processes.

physics.soc-ph↗