Searcharxiv⌕ Search

arXiv subjects

Ran Yan

Publications and source records attributed to Ran Yan.

At least 37 records · Page 2Linked to original sources

MSD-LLM: Predicting Ship Detention in Port State Control Inspections with Large Language Model

Maritime transportation is the backbone of global trade, making ship inspection essential for ensuring maritime safety and environmental protection. Port State Control (PSC), conducted by national ports, enforces compliance with safety regulations, with ship detention being the most severe consequence, impacting both ship schedules and company reputations. Traditional machine learning methods for ship detention prediction are limited by the capacity of representation learning and thus suffer from low accuracy. Meanwhile, autoencoder-based deep learning approaches face challenges due to the severe data imbalance in learning historical PSC detention records. To address these limitations, we propose Maritime Ship Detention with Large Language Models (MSD-LLM), integrating a dual robust subspace recovery (DSR) layer-based autoencoder with a progressive learning pipeline to handle imbalanced data and extract meaningful PSC representations. Then, a large language model groups and ranks features to identify likely detention cases, enabling dynamic thresholding for flexible detention predictions. Extensive evaluations on 31,707 PSC inspection records from the Asia-Pacific region show that MSD-LLM outperforms state-of-the-art methods more than 12\% on Area Under the Curve (AUC) for Singapore ports. Additionally, it demonstrates robustness to real-world challenges, making it adaptable to diverse maritime risk assessment scenarios.

cs.AI↗

Building floorspace and stock measurement: A review of global efforts, knowledge gaps, and research priorities

Despite a substantial body of research-evidenced by our analysis of 2,628 peer-reviewed papers-global building floorspace data remain fragmented, inconsistent, and methodologically diverse. The lack of high-quality and openly accessible datasets poses major challenges to accurately assessing building carbon neutrality. This review focuses on global building floorspace, especially its nexus with energy and emissions. The key research areas include energy modeling, emissions analysis, building retrofits, and life cycle assessments. Each measurement approach-top-down, bottom-up, and hybrid-has its own limitations: top-down methods provide broad estimates but low accuracy, whereas bottom-up approaches are more precise but data intensive. Our simulations reveal a surge in floorspace growth across emerging economies-most notably in India, Indonesia, and Africa-with India's per capita floorspace projected to triple by 2070. We emphasize the need for a high-resolution global floorspace imagery database to compare energy efficiency, track decarbonization progress, and assess renovation impacts while promoting building sufficiency and accelerating the transition to net-zero building systems.

physics.soc-ph↗

India's residential space cooling transition: Decarbonization ambitions since the turn of millennium

As an emerging emitter poised for significant growth in space cooling demand, India requires comprehensive insights into historical emission trends and decarbonization performance to shape future low-carbon cooling strategies. By integrating a bottom-up demand resource energy analysis model and a top-down decomposition method, this study is the first to conduct a state-level analysis of carbon emission trends and the corresponding decarbonization efforts for residential space cooling in urban and rural India from 2000 to 2022. The results indicate that (1) the carbon intensity of residential space cooling in India increased by 292.4% from 2000 to 2022, reaching 513.8 kilograms of carbon dioxide per household. The net state domestic product per capita, representing income, emerged as the primary positive contributor. (2) The increase in carbon emissions from space cooling can be primarily attributed to the use of fans. While fan-based space cooling has nearly saturated Indian urban households, it is anticipated to persist as the primary cooling method in rural households for decades. (3) States with higher decarbonization potential are concentrated in two categories: those with high household income and substantial cooling appliance ownership and those with pronounced unmet cooling demand but low household income and hot climates. Furthermore, it is believed that promoting energy-efficient building designs can be prioritized to achieve affordable space cooling. Overall, this study serves as an effective foundation for formulating and promoting India's future cooling action plan, addressing the country's rising residential cooling demands and striving toward its net-zero goal by 2070.

econ.GN↗

HexGen-2: Disaggregated Generative Inference of LLMs in Heterogeneous Environment

Disaggregating the prefill and decoding phases represents an effective new paradigm for generative inference of large language models (LLM), which eliminates prefill-decoding interference and optimizes resource allocation. However, it is still an open problem about how to deploy the disaggregated inference paradigm across a group of heterogeneous GPUs, which can be an economical alternative to deployment over homogeneous high-performance GPUs. Towards this end, we introduce HexGen-2, a distributed system for efficient and economical LLM serving on heterogeneous GPUs following the disaggregated paradigm. Built on top of HexGen, the core component of HexGen-2 is a scheduling algorithm that formalizes the allocation of disaggregated LLM inference computations and communications over heterogeneous GPUs and network connections as a constraint optimization problem. We leverage the graph partitioning and max-flow algorithms to co-optimize resource allocation, parallel strategies for distinct inference phases, and the efficiency of inter-phase key-value (KV) cache communications. We conduct extensive experiments to evaluate HexGen-2, i.e., on OPT (30B) and Llama-2 (70B) models in various real-world settings, the results reveal that HexGen-2 delivers up to a 2.0 times and on average a 1.3 times improvement in serving throughput, reduces the average inference latency by 1.5 times compared with state-of-the-art systems given the same price budget, and achieves comparable inference performance with a 30% lower price budget.

cs.DC↗

Provincial allocation of China's commercial building operational carbon towards carbon neutrality

National carbon peak track and optimized provincial carbon allocations are crucial for mitigating regional inequality within the commercial building sector during China's transition to carbon neutrality. This study proposes a top-down model to evaluate carbon trajectories in operational commercial buildings up to 2060. Through Monte Carlo simulation, scenario analysis is conducted to assess carbon peak values and the corresponding peaking year, thereby optimizing carbon allocation schemes both nationwide and provincially. The results reveal that (1) the nationwide carbon peak for commercial building operations is projected to reach 890 (+- 50) megatons of carbon dioxide (MtCO2) by 2028 (+- 3.7 years) in the case of the business-as-usual scenario, with a 7.87% probability of achieving the carbon peak under the decarbonization scenario. (2) Significant disparities will exist among provinces, with Shandong's carbon peak projected at 69.6 (+- 4.0) MtCO2 by 2029, approximately 11 times higher than Ningxia's peak of 6.0 (+- 0.3) MtCO2 by 2027. (3) Guided by the principle of maximizing the emission reduction potential, the optimal provincial allocation scheme reveals the top three provinces requiring the most significant reductions in the commercial sector: Xinjiang (5.6 MtCO2), Shandong (4.8 MtCO2), and Henan (4.7 MtCO2). Overall, this study offers optimized provincial carbon allocation strategies within the commercial building sector in China via dynamic scenario simulations, with the goal of hitting the carbon peak target and progressing toward a low-carbon future for the building sector.

econ.GN↗

Reducing Distraction in Long-Context Language Models by Focused Learning

Recent advancements in Large Language Models (LLMs) have significantly enhanced their capacity to process long contexts. However, effectively utilizing this long context remains a challenge due to the issue of distraction, where irrelevant information dominates lengthy contexts, causing LLMs to lose focus on the most relevant segments. To address this, we propose a novel training method that enhances LLMs' ability to discern relevant information through a unique combination of retrieval-based data augmentation and contrastive learning. Specifically, during fine-tuning with long contexts, we employ a retriever to extract the most relevant segments, serving as augmented inputs. We then introduce an auxiliary contrastive learning objective to explicitly ensure that outputs from the original context and the retrieved sub-context are closely aligned. Extensive experiments on long single-document and multi-document QA benchmarks demonstrate the effectiveness of our proposed method.

cs.CL↗

RFLPA: A Robust Federated Learning Framework against Poisoning Attacks with Secure Aggregation

Federated learning (FL) allows multiple devices to train a model collaboratively without sharing their data. Despite its benefits, FL is vulnerable to privacy leakage and poisoning attacks. To address the privacy concern, secure aggregation (SecAgg) is often used to obtain the aggregation of gradients on sever without inspecting individual user updates. Unfortunately, existing defense strategies against poisoning attacks rely on the analysis of local updates in plaintext, making them incompatible with SecAgg. To reconcile the conflicts, we propose a robust federated learning framework against poisoning attacks (RFLPA) based on SecAgg protocol. Our framework computes the cosine similarity between local updates and server updates to conduct robust aggregation. Furthermore, we leverage verifiable packed Shamir secret sharing to achieve reduced communication cost of $O(M+N)$ per user, and design a novel dot product aggregation algorithm to resolve the issue of increased information leakage. Our experimental results show that RFLPA significantly reduces communication and computation overhead by over $75\%$ compared to the state-of-the-art secret sharing method, BREA, while maintaining competitive accuracy.

cs.CR↗

Split-and-Denoise: Protect large language model inference with local differential privacy

Large Language Models (LLMs) excel in natural language understanding by capturing hidden semantics in vector space. This process enriches the value of text embeddings for various downstream tasks, thereby fostering the Embedding-as-a-Service (EaaS) business model. However, the risk of privacy leakage due to direct text transmission to servers remains a critical concern. To address this, we introduce Split-N-Denoise (SnD), an private inference framework that splits the model to execute the token embedding layer on the client side at minimal computational cost. This allows the client to introduce noise prior to transmitting the embeddings to the server, and subsequently receive and denoise the perturbed output embeddings for downstream tasks. Our approach is designed for the inference stage of LLMs and requires no modifications to the model parameters. Extensive experiments demonstrate SnD's effectiveness in optimizing the privacy-utility tradeoff across various LLM architectures and diverse downstream tasks. The results reveal an improvement in performance under the same privacy budget compared to the baselines by over 10\% on average, offering clients a privacy-preserving solution for local privacy protection.

cs.AI↗

China's plug-in hybrid electric vehicle transition: an operational carbon perspective

Assessing the emissions of plug-in hybrid electric vehicle (PHEV) operations is crucial for accelerating the carbon-neutral transition in the passenger car sector. This study is the first to adopt a bottom-up model to measure the real-world energy use and carbon dioxide emissions of China's top twenty selling PHEV models across different regions from 2020 to 2022. The results indicate that (1) the actual electricity intensity of the best-selling PHEV models (20.2-38.2 kWh/100 km) was 30-40% higher than the New European Driving Cycle values, and the actual gasoline intensity (4.7-23.5 L/100 km) was 3-6 times greater than the New European Driving Cycle values. (2) The overall energy use of the best-selling models varied among different regions, and the energy use from 2020 to 2022 in Southern China was double that Northern China and the Yangtze River Middle Reach. (3) The top-selling models emitted 4.7 megatons of carbon dioxide nationwide from 2020 to 2022, with 1.9 megatons released by electricity consumption and 2.8 megatons released by gasoline combustion. Furthermore, targeted policy implications for expediting the carbon-neutral transition within the passenger car sector are proposed. In essence, this study explores and compares benchmark data at both the national and regional levels, along with performance metrics associated with PHEV operations. The main objective is to aid nationwide decarbonization efforts, focusing on carbon reduction and promoting the rapid transition of road transportation toward a net-zero carbon future.

econ.GN↗

Estimation of Global Building Stocks by 2070: Unlocking Renovation Potential

Buildings produce one-third of carbon emissions globally, however, data absence regarding global floorspace poses challenges in advancing building carbon neutrality. We compile the measured building stocks for 14 major economies and apply our global building stock model, GLOBUS, to evaluate future trends in stock turnover. Based on a scenario not considering renovation, by 2070 the building stock in developed economies will be ~1.4 times that of 2020 (100 billion m2); in developing economies it is expected to be 2.2 times that of 2020 (313 billion m2). Based on a techno-economic potential scenario, however, stocks in developed economies will decline to approximately 0.8 times the 2020 level, while stocks in developing economies will increase to nearly twice the 2020 level due to their fewer buildings currently. Overall, GLOBUS provides a way of calculating the global building stock, helping scientists, engineers, and policymakers conduct a range of investigation across various future scenarios.

econ.GN↗

HexGen: Generative Inference of Large Language Model over Heterogeneous Environment

Serving generative inference of the large language model is a crucial component of contemporary AI applications. This paper focuses on deploying such services in a heterogeneous and cross-datacenter setting to mitigate the substantial inference costs typically associated with a single centralized datacenter. Towards this end, we propose HexGen, a flexible distributed inference engine that uniquely supports the asymmetric partition of generative inference computations over both tensor model parallelism and pipeline parallelism and allows for effective deployment across diverse GPUs interconnected by a fully heterogeneous network. We further propose a sophisticated scheduling algorithm grounded in constrained optimization that can adaptively assign asymmetric inference computation across the GPUs to fulfill inference requests while maintaining acceptable latency levels. We conduct an extensive evaluation to verify the efficiency of HexGen by serving the state-of-the-art Llama-2 (70B) model. The results suggest that HexGen can choose to achieve up to 2.3 times lower latency deadlines or tolerate up to 4 times more request rates compared with the homogeneous baseline given the same budget.

cs.DC↗

Decarbonization analysis on residential end uses in the emerging economies

This study explores the historical emission patterns and decarbonization efforts of China and India, the largest emerging emitters in residential building operations. Using a novel carbon intensity model and structural decomposition approach, it assesses the operational decarbonization progress over the past two decades. Results show significant decarbonization, with China and India collectively reducing 1498.3 and 399.7 MtCO2, respectively. Electrification notably contributed to decarbonizing space cooling and appliances in both countries.

econ.GN↗

Reinforcement Learning-assisted Evolutionary Algorithm: A Survey and Research Opportunities

Evolutionary algorithms (EA), a class of stochastic search methods based on the principles of natural evolution, have received widespread acclaim for their exceptional performance in various real-world optimization problems. While researchers worldwide have proposed a wide variety of EAs, certain limitations remain, such as slow convergence speed and poor generalization capabilities. Consequently, numerous scholars actively explore improvements to algorithmic structures, operators, search patterns, etc., to enhance their optimization performance. Reinforcement learning (RL) integrated as a component in the EA framework has demonstrated superior performance in recent years. This paper presents a comprehensive survey on integrating reinforcement learning into the evolutionary algorithm, referred to as reinforcement learning-assisted evolutionary algorithm (RL-EA). We begin with the conceptual outlines of reinforcement learning and the evolutionary algorithm. We then provide a taxonomy of RL-EA. Subsequently, we discuss the RL-EA integration method, the RL-assisted strategy adopted by RL-EA, and its applications according to the existing literature. The RL-assisted procedure is divided according to the implemented functions including solution generation, learnable objective function, algorithm/operator/sub-population selection, parameter adaptation, and other strategies. Additionally, different attribute settings of RL in RL-EA are discussed. In the applications of RL-EA section, we also demonstrate the excellent performance of RL-EA on several benchmarks and a range of public datasets to facilitate a quick comparative study. Finally, we analyze potential directions for future research.

cs.NE↗

Decarbonization patterns of residential building operations in China and India

As the two largest emerging emitters with the highest growth in operational carbon from residential buildings, the historical emission patterns and decarbonization efforts of China and India warrant further exploration. This study aims to be the first to present a carbon intensity model considering end-use performances, assessing the operational decarbonization progress of residential building in India and China over the past two decades using the improved decomposing structural decomposition approach. Results indicate (1) the overall operational carbon intensity increased by 1.4% and 2.5% in China and India, respectively, between 2000 and 2020. Household expenditure-related energy intensity and emission factors were crucial in decarbonizing residential buildings. (2) Building electrification played a significant role in decarbonizing space cooling (-87.7 in China and -130.2 kilograms of carbon dioxide (kgCO2) per household in India) and appliances (-169.7 in China and -43.4 kgCO2 per household in India). (3) China and India collectively decarbonized 1498.3 and 399.7 mega-tons of CO2 in residential building operations, respectively. In terms of decarbonization intensity, India (164.8 kgCO2 per household) nearly caught up with China (182.5 kgCO2 per household) in 2020 and is expected to surpass China in the upcoming years, given the country's robust annual growth rate of 7.3%. Overall, this study provides an effective data-driven tool for investigating the building decarbonization potential in China and India, and offers valuable insights for other emerging economies seeking to decarbonize residential buildings in the forthcoming COP28 age.

econ.GN↗

SuperGF: Unifying Local and Global Features for Visual Localization

Advanced visual localization techniques encompass image retrieval challenges and 6 Degree-of-Freedom (DoF) camera pose estimation, such as hierarchical localization. Thus, they must extract global and local features from input images. Previous methods have achieved this through resource-intensive or accuracy-reducing means, such as combinatorial pipelines or multi-task distillation. In this study, we present a novel method called SuperGF, which effectively unifies local and global features for visual localization, leading to a higher trade-off between localization accuracy and computational efficiency. Specifically, SuperGF is a transformer-based aggregation model that operates directly on image-matching-specific local features and generates global features for retrieval. We conduct experimental evaluations of our method in terms of both accuracy and efficiency, demonstrating its advantages over other methods. We also provide implementations of SuperGF using various types of local features, including dense and sparse learning-based or hand-crafted descriptors.

cs.CV↗

MegBA: A GPU-Based Distributed Library for Large-Scale Bundle Adjustment

Large-scale Bundle Adjustment (BA) requires massive memory and computation resources which are difficult to be fulfilled by existing BA libraries. In this paper, we propose MegBA, a GPU-based distributed BA library. MegBA can provide massive aggregated memory by automatically partitioning large BA problems, and assigning the solvers of sub-problems to parallel nodes. The parallel solvers adopt distributed Precondition Conjugate Gradient and distributed Schur Elimination, so that an effective solution, which can match the precision of those computed by a single node, can be efficiently computed. To accelerate BA computation, we implement end-to-end BA computation using high-performance primitives available on commodity GPUs. MegBA exposes easy-to-use APIs that are compatible with existing popular BA libraries. Experiments show that MegBA can significantly outperform state-of-the-art BA libraries: Ceres (41.45$\times$), RootBA (64.576$\times$) and DeepLM (6.769$\times$) in several large-scale BA benchmarks. The code of MegBA is available at https://github.com/MegviiRobot/MegBA.

cs.CV↗

MegLoc: A Robust and Accurate Visual Localization Pipeline

In this paper, we present a visual localization pipeline, namely MegLoc, for robust and accurate 6-DoF pose estimation under varying scenarios, including indoor and outdoor scenes, different time across a day, different seasons across a year, and even across years. MegLoc achieves state-of-the-art results on a range of challenging datasets, including winning the Outdoor and Indoor Visual Localization Challenge of ICCV 2021 Workshop on Long-term Visual Localization under Changing Conditions, as well as the Re-localization Challenge for Autonomous Driving of ICCV 2021 Workshop on Map-based Localization for Autonomous Driving.

cs.CV↗