SearcharxivSearch

arXiv subjects

Hanwen Hu

Publications and source records attributed to Hanwen Hu.

9 recordsLinked to original sources

Weighted Sum-Rate Enhancement for Flexible Intelligent Metasurface-Assisted Multicell Systems

Flexible intelligent metasurface (FIM) technology has emerged as a promising technology for enhancing wireless communication performance by dynamically reshaping the propagation environment. Compared with conventional rigid reconfigurable intelligent surfaces (RIS), an FIM is composed of multiple electromagnetic (EM) scattering units, each of which can flexibly modify its displacement in the direction normal to the surface, thereby cooperatively morphing the overall surface shape. This additional degree of freedom (DoF) enables improved beamforming and interference mitigation, particularly in complex multicell scenarios. In this paper, an optimization problem for maximizing the weighted sum-rate (WSR) in a multicell multi-user multiple-input single-output (MU-MISO) system assisted by an FIM deployed at the cell boundary is investigated. We jointly optimize the transmit beamforming at the base station (BS), the phase shift matrix, and the FIM surface shape, subject to constraints on the transmit power budget, unit-modulus reflection coefficients, and surface shape morphing range. Due to the non-convex objective function with highly coupled variables, solving the formulated optimization problem is challenging. To tackle this challenge, we propose an efficient alternating optimization framework that leverages the weighted minimum mean square error (WMMSE) method to reformulate the problem and the block coordinate descent (BCD) algorithm to iteratively update the variables. Specifically, the Riemannian conjugate gradient (RCG) algorithm is leveraged to optimize the phase shift matrix, while the projected gradient descent (PGD) method is adopted to optimize the surface shape of the FIM. Additionally, the optimal beamforming vectors are obtained in closed form.

cs.IT

PAST: A Primary-Auxiliary Spatio-Temporal Network for Traffic Time Series Imputation

Traffic time series imputation is crucial for the safety and reliability of intelligent transportation systems, while diverse types of missing data, including random, fiber, and block missing make the imputation task challenging. Existing models often focus on disentangling and separately modeling spatial and temporal patterns based on relationships between data points. However, these approaches struggle to adapt to the random missing positions, and fail to learn long-term and large-scale dependencies, which are essential in extensive missing conditions. In this paper, patterns are categorized into two types to handle various missing data conditions: primary patterns, which originate from internal relationships between data points, and auxiliary patterns, influenced by external factors like timestamps and node attributes. Accordingly, we propose the Primary-Auxiliary Spatio-Temporal network (PAST). It comprises a graph-integrated module (GIM) and a cross-gated module (CGM). GIM captures primary patterns via dynamic graphs with interval-aware dropout and multi-order convolutions, and CGM extracts auxiliary patterns through bidirectional gating on embedded external features. The two modules interact via shared hidden vectors and are trained under an ensemble self-supervised framework. Experiments on three datasets under 27 missing data conditions demonstrate that the imputation accuracy of PAST outperforms seven state-of-the-art baselines by up to 26.2% in RMSE and 31.6% in MAE.

cs.LG

EDGC: Entropy-driven Dynamic Gradient Compression for Efficient LLM Training

Training large language models (LLMs) poses significant challenges regarding computational resources and memory capacity. Although distributed training techniques help mitigate these issues, they still suffer from considerable communication overhead. Existing approaches primarily rely on static gradient compression to enhance communication efficiency; however, these methods neglect the dynamic nature of evolving gradients during training, leading to performance degradation. Accelerating LLM training via compression without sacrificing performance remains a challenge. In this paper, we propose an entropy-driven dynamic gradient compression framework called EDGC. The core concept is to adjust the compression rate during LLM training based on the evolving trends of gradient entropy, taking into account both compression efficiency and error. EDGC consists of three key components.First, it employs a down-sampling method to efficiently estimate gradient entropy, reducing computation overhead. Second, it establishes a theoretical model linking compression rate with gradient entropy, enabling more informed compression decisions. Lastly, a window-based adjustment mechanism dynamically adapts the compression rate across pipeline stages, improving communication efficiency and maintaining model performance. We implemented EDGC on a 32-NVIDIA-V100 cluster and a 64-NVIDIA-H100 cluster to train GPT2-2.5B and GPT2-12.1B, respectively. The results show that EDGC significantly reduces communication latency and training time by up to 46.45% and 16.13% while preserving LLM accuracy.

cs.LG

Flexible Intelligent Metasurface for Reconfiguring Radio Environments

Flexible intelligent metasurface (FIM) technology holds immense potential for increasing the spectral efficiency and energy efficiency of wireless networks. In contrast to traditional rigid reconfigurable intelligent surfaces (RIS), an FIM consists of an array of elements, each capable of independently tuning electromagnetic signals, while flexibly adjusting its position along the direction perpendicular to the surface. In contrast to traditional rigid metasurfaces, FIM is capable of morphing its surface shape to attain better channel conditions. In this paper, we investigate the single-input single-output (SISO) and multiple-input single-output (MISO) communication systems aided by a transmissive FIM. In the SISO scenario, we jointly optimize the FIM phase shift matrix and surface shape to maximize the end-to-end channel gain. First, we derive the optimal phase-shift matrix for each tentative FIM surface shape to decompose the high-dimensional non-convex optimization problem into multiple one-dimensional subproblems. Then, we utilize the particle swarm optimization (PSO) algorithm and the multi-interval gradient descent (MIGD) method for updating the FIM's surface shape to maximize the channel gain. In the MISO scenario, we jointly optimize the transmit beamforming, the FIM surface shape, and the phase shift matrix to maximize the channel gain. To tackle this complex problem with multiple highly coupled variables, an efficient alternating optimization algorithm is proposed. Simulation results demonstrate that FIM significantly improves channel gain compared to traditional RIS and exhibits good adaptability to multipath channels.

eess.SP

GFS: A Preemption-aware Scheduling Framework for GPU Clusters with Predictive Spot Instance Management

The surge in large language models (LLMs) has fundamentally reshaped the landscape of GPU usage patterns, creating an urgent need for more efficient management strategies. While cloud providers employ spot instances to reduce costs for low-priority (LP) tasks, existing schedulers still grapple with high eviction rates and lengthy queuing times. To address these limitations, we present GFS, a novel preemptive scheduling framework that enhances service-level objective (SLO) compliance for high-priority (HP) tasks while minimizing preemptions to LP tasks. Firstly, GFS utilizes a lightweight forecasting model that predicts GPU demand among different tenants, enabling proactive resource management. Secondly, GFS employs a dynamic allocation mechanism to adjust the spot quota for LP tasks with guaranteed durations. Lastly, GFS incorporates a preemptive scheduling policy that prioritizes HP tasks while minimizing the impact on LP tasks. We demonstrate the effectiveness of GFS through both real-world implementation and simulations. The results show that GFS reduces eviction rates by 33.0\%, and cuts queuing delays by 44.1\% for LP tasks. Furthermore, GFS enhances the GPU allocation rate by up to 22.8\% in real production clusters. In a production cluster of more than 10,000 GPUs, GFS yields roughly \$459,715 in monthly benefits.

cs.DC

Performance Analysis of RIS-Aided High-Mobility Wireless Systems

Reconfigurable intelligent surface (RIS) technology holds immense potential for increasing the performance of wireless networks. Therefore, RIS is also regarded as one of the solutions to address communication challenges in high-mobility scenarios, such as Doppler shift and fast fading. This paper investigates a high-speed train (HST) multiple-input single-output (MISO) communication system aided by a RIS. We propose a block coordinate descent (BCD) algorithm to jointly optimize the RIS phase shifts and the transmit beamforming vectors to maximize the channel gain. Numerical results are provided to demonstrate that the proposed algorithm significantly enhances the system performance, achieving an average channel gain improvement of 15 dB compared to traditional schemes. Additionally, the introduction of RIS eliminates outage probability and improves key performance metrics such as achievable rate, channel capacity, and bit error rate (BER). These findings highlight the critical role of RIS in enhancing HST communication systems.

eess.SP

MOPAR: A Model Partitioning Framework for Deep Learning Inference Services on Serverless Platforms

With its elastic power and a pay-as-you-go cost model, the deployment of deep learning inference services (DLISs) on serverless platforms is emerging as a prevalent trend. However, the varying resource requirements of different layers in DL models hinder resource utilization and increase costs, when DLISs are deployed as a single function on serverless platforms. To tackle this problem, we propose a model partitioning framework called MOPAR. This work is based on the two resource usage patterns of DLISs: global differences and local similarity, due to the presence of resource dominant (RD) operators and layer stacking. Considering these patterns, MOPAR adopts a hybrid approach that initially divides the DL model vertically into multiple slices composed of similar layers to improve resource efficiency. Slices containing RD operators are further partitioned into multiple sub-slices, enabling parallel optimization to reduce inference latency. Moreover, MOPAR comprehensively employs data compression and share-memory techniques to offset the additional time introduced by communication between slices. We implement a prototype of MOPAR and evaluate its efficacy using four categories of 12 DL models on OpenFaaS and AWS Lambda. The experiment results show that MOPAR can improve the resource efficiency of DLISs by 27.62\% on average, while reducing latency by about 5.52\%. Furthermore, based on Lambda's pricing, the cost of running DLISs is reduced by about 2.58 $\times$ using MOPAR.

cs.DC

EdgeStereo: An Effective Multi-Task Learning Network for Stereo Matching and Edge Detection

Recently, leveraging on the development of end-to-end convolutional neural networks (CNNs), deep stereo matching networks have achieved remarkable performance far exceeding traditional approaches. However, state-of-the-art stereo frameworks still have difficulties at finding correct correspondences in texture-less regions, detailed structures, small objects and near boundaries, which could be alleviated by geometric clues such as edge contours and corresponding constraints. To improve the quality of disparity estimates in these challenging areas, we propose an effective multi-task learning network, EdgeStereo, composed of a disparity estimation branch and an edge detection branch, which enables end-to-end predictions of both disparity map and edge map. To effectively incorporate edge cues, we propose the edge-aware smoothness loss and edge feature embedding for inter-task interactions. It is demonstrated that based on our unified model, edge detection task and stereo matching task can promote each other. In addition, we design a compact module called residual pyramid to replace the commonly-used multi-stage cascaded structures or 3-D convolution based regularization modules in current stereo matching networks. By the time of the paper submission, EdgeStereo achieves state-of-art performance on the FlyingThings3D dataset, KITTI 2012 and KITTI 2015 stereo benchmarks, outperforming other published stereo matching methods by a noteworthy margin. EdgeStereo also achieves comparable generalization performance for disparity estimation because of the incorporation of edge cues.

cs.CV

EdgeStereo: A Context Integrated Residual Pyramid Network for Stereo Matching

Recent convolutional neural networks, especially end-to-end disparity estimation models, achieve remarkable performance on stereo matching task. However, existed methods, even with the complicated cascade structure, may fail in the regions of non-textures, boundaries and tiny details. Focus on these problems, we propose a multi-task network EdgeStereo that is composed of a backbone disparity network and an edge sub-network. Given a binocular image pair, our model enables end-to-end prediction of both disparity map and edge map. Basically, we design a context pyramid to encode multi-scale context information in disparity branch, followed by a compact residual pyramid for cascaded refinement. To further preserve subtle details, our EdgeStereo model integrates edge cues by feature embedding and edge-aware smoothness loss regularization. Comparative results demonstrates that stereo matching and edge detection can help each other in the unified model. Furthermore, our method achieves state-of-art performance on both KITTI Stereo and Scene Flow benchmarks, which proves the effectiveness of our design.

cs.CV