SearcharxivSearch

arXiv subjects

Guo Wei

Publications and source records attributed to Guo Wei.

At least 19 recordsLinked to original sources

Deterministic algorithms for inhomogeneous Bernoulli trials: Shapley value of network devices

Suppose that $n$ computer devices are to be connected to a network via inhomogeneous Bernoulli trials. The Shapley value of a device quantifies how much the network's value increases due to the participation of that device. Characteristic functions of such games are naturally taken as the belief function (containment function) and Choquet capacity (hitting probability) of a random set (random network of devices). Traditionally, the Shapley value is either calculated as the expected marginal contribution over all possible coalitions (subnetworks), which results in exponential computational complexity, or approximated by the Monte Carlo sampling technique, where the performance is highly dependent on the stochastic sampling process. The purpose of this study is to design deterministic algorithms for games formulated via inhomogeneous Bernoulli trials that approximate the Shapley value in linear or quadratic time, with rigorous error analysis (Sections 3 and 4). Additionally, we provide a review of relevant literature on existing calculation methods in Remark 3.1 and Appendix I. A further goal is to supplement Shapley's original proof by deriving the Shapley value formula using a rigorous approach based on definite integrals and combinatorial analysis. This method explicitly highlights the roles of the Binomial Theorem and the Beta function in the proof, addressing a gap in Shapley's work (Appendix II).

cs.GT

AReaL: A Large-Scale Asynchronous Reinforcement Learning System for Language Reasoning

Reinforcement learning (RL) has become a dominant paradigm for training large language models (LLMs), particularly for reasoning tasks. Effective RL for LLMs requires massive parallelization and poses an urgent need for efficient training systems. Most existing large-scale RL systems for LLMs are synchronous, alternating generation and training in a batch setting where rollouts in each training batch are generated by the same model. This approach stabilizes RL training but suffers from severe system-level inefficiency: generation must wait until the longest output in the batch is completed before model updates, resulting in GPU underutilization. We present AReaL, a fully asynchronous RL system that completely decouples generation from training. Rollout workers in AReaL continuously generate new outputs without waiting, while training workers update the model whenever a batch of data is collected. AReaL also incorporates a collection of system-level optimizations, leading to substantially higher GPU utilization. To stabilize RL training, AReaL balances the workload of rollout and training workers to control data staleness, and adopts a staleness-enhanced PPO variant to better handle outdated training samples. Extensive experiments on math and code reasoning benchmarks show that AReaL achieves up to 2.77$\times$ training speedup compared to synchronous systems with the same number of GPUs and matched or improved final performance. The code of AReaL is available at https://github.com/inclusionAI/AReaL/.

cs.LG

Preference Disaggregation Analysis with Criteria Selection in a Regularization Framework

Limited by cognitive abilities, decision-makers (DMs) may struggle to evaluate decision alternatives based on all criteria in multiple criteria decision-making problems. This paper proposes an embedded criteria selection method derived from preference disaggregation technique and regularization theory. The method aims to infer the criteria and value functions used by the DM to evaluate decision alternatives. It measures the quality of criteria subsets by investigating both the empirical error (fitting ability of value functions to preference information) and generalization error (complexity of value functions). Unlike existing approaches that consider only the deviation from linearity as a measure of complexity, we argue that the number of marginal value functions also affects complexity. To address this, we use 0-1 variables to indicate whether a criterion is selected in the value function or not, and construct a criteria selection model with the trade-off between empirical and generalization errors as the objective function. If the criteria are sufficiently discriminative, we identify all supporting criteria sets that can restore preference information without unnecessary criteria. We further analyze the likelihood of criteria being selected by the DM. Finally, the effectiveness of the proposed method is demonstrated by applying it to an example of the green supplier selection problem.

math.OC

An Extensive Study on Text Serialization Formats and Methods

Text serialization is a fundamental concept in modern computing, enabling the conversion of complex data structures into a format that can be easily stored, transmitted, and reconstructed. This paper provides an extensive overview of text serialization, exploring its importance, prevalent formats, underlying methods, and comparative performance characteristics. We dive into the advantages and disadvantages of various text-based serialization formats, including JSON, XML, YAML, and CSV, examining their structure, readability, verbosity, and suitability for different applications. The paper also discusses the common methods involved in the serialization and deserialization processes, such as parsing techniques and the role of schemas. To illustrate the practical implications of choosing a serialization format, we present hypothetical performance results in the form of tables, comparing formats based on metrics like serialization deserialization speed and resulting data size. The discussion analyzes these results, highlighting the trade offs involved in selecting a text serialization format for specific use cases. This work aims to provide a comprehensive resource for understanding and applying text serialization in various computational domains.

cs.PL

Coexistence Designs of Radar and Communication Systems in a Multi-path Scenario

The focus of this study is on the spectrum sharing between multiple-input multiple-output (MIMO) communications and co-located MIMO radar systems in multi-path environments. The major challenge is to suppress the mutual interference between the two systems while combining the useful multi-path components received at each system. We tackle this challenge by jointly designing the communication precoder, radar transmit waveform and receive filter. Specifically, the signal-to-interference-plus-noise ratio (SINR) at the radar receiver is maximized subject to constraints on the radar waveform, communication rate and transmit power. The multi-path propagation complicates the expressions of the radar SINR and communication rate, leading to a non-convex problem. To solve it, a sub-optimal algorithm based on the alternating maximization is used to optimize the precoder, radar transmit waveform and receive filter iteratively. Simulation results are provided to demonstrate the effectiveness of the proposed design.

cs.IT

Cram\'er-Rao Bounds of Near-Field Positioning Based on Electromagnetic Propagation Model

The adoption of large-scale antenna arrays at high-frequency bands is widely envisioned in the beyond 5G wireless networks. This leads to the near-field regime where the wavefront is no longer planar but spherical, bringing new opportunities and challenges for communications and positioning. In this paper, we improve the near-field positioning technology from the classical spherical wavefront model (SWM) to the more accurate and true electromagnetic propagation model (EPM). A generic near-field positioning model with different observation capabilities for three electric field types (vector, scalar, and overall scalar electric field) is developed based on the complete EPM. For these three observed electric field types, the Cram\'er-Rao bound (CRB) is adopted to evaluate the achievable estimation accuracy. The expressions of the CRBs for different electric field observations are derived by combining electromagnetic propagation concepts with estimation theory. Closed-form expressions can be further obtained as the terminal is assumed to be on the central perpendicular line (CPL) of the receiving antenna surface. Moreover, the above discussions are extended to the system with multiple receiving antennas. In this case, the CRBs using various electric field types are derived, and the effect of different numbers of receiving antennas is deeply investigated. Numerical results are provided to quantify the CRBs and validate the analytical results. Also, the impact of different system parameters, including electric field type, wavelength, size of the receiving antenna, and number of antennas, is evaluated.

eess.SP

Blind Diagnosis for Millimeter-wave Large-scale Antenna Systems

Millimeter-wave (mmWave) communication systems rely on large-scale antenna arrays to combat large path-loss at mmWave band. Due to hardware characteristics and deployment environments, mmWave large-scale antenna systems are vulnerable to antenna element blockages and failures, which necessitate diagnostic techniques to locate faulty antenna elements for calibration purposes. Current diagnostic techniques require full or partial knowledge of channel state information (CSI), which can be challenging to acquire in the presence of antenna failures. In this letter, we propose a blind diagnostic technique to identify faulty antenna elements in mmWave large-scale antenna systems, which does not require any CSI knowledge. By jointly exploiting the sparsity of mmWave channel and failure pattern, we first formulate the diagnosis problem as a joint sparse recovery problem. Then, the atomic norm is introduced to induce the sparsity of mmWave channel over continuous Fourier dictionary. An efficient algorithm based on alternating direction method of multipliers (ADMM) is proposed to solve the formulated problem. Finally, the performance of the proposed technique is evaluated through numerical simulations.

eess.SY

Diagnosis of Intelligent Reflecting Surface in Millimeter-wave Communication Systems

Intelligent reflecting surface (IRS) is a promising technology for enhancing wireless communication systems. It adaptively configures massive passive reflecting elements to control wireless channel in a desirable way. Due to hardware characteristics and deploying environments, an IRS may be subject to reflecting element blockages and failures, and hence developing diagnostic techniques is of great significance to system monitoring and maintenance. In this paper, we develop diagnostic techniques for IRS systems to locate faulty reflecting elements and retrieve failure parameters. Three cases of channel state information (CSI) availability are considered. In the first case where full CSI is available, a compressed sensing based diagnostic technique is proposed, which significantly reduces the required number of measurements. In the second case where only partial CSI is available, we jointly exploit the sparsity of the millimeter-wave channel and the failure, and adopt compressed sparse and low-rank matrix recovery algorithm to decouple channel and failure. In the third case where no CSI is available, a novel atomic norm is introduced as the sparsity-inducing norm of the cascaded channel, and the diagnosis problem is formulated as a joint sparse recovery problem. Finally, the proposed diagnostic techniques are validated through numerical simulations.

eess.SY

Computing and Communicating Functions in Disorganized Wireless Networks

For future wireless networks, enormous numbers of interconnections are required, creating a disorganized topology and leading to a great challenge in data aggregation. Instead of collecting data individually, a more efficient technique, computation over multi-access channels (CoMAC), has emerged to compute functions by exploiting the signal-superposition property of wireless channels. However, the implementation of CoMAC in disorganized networks with multiple relays (hops) is still an open problem. In this paper, we combine CoMAC and orthogonal communication in the disorganized network to attain the computation of functions at the fusion center. First, to make the disorganized network more tractable, we reorganize the disorganized network into a hierarchical network with multiple layers that consists of subgroups and groups. In the hierarchical network, we propose multi-layer function computation where CoMAC is applied to each subgroup and orthogonal communication is adopted within each group. By computing and communicating subgroup and group functions over layers, the desired functions are reconstructed at the fusion center. The general computation rate is derived and the performance is further improved through time allocation and power control. The closed-form solutions to optimization are obtained, which suggest that existing CoMAC and orthogonal communication schemes can be generalized.

cs.IT

Computation Over NOMA: Improved Achievable Rate Through Sub-Function Superposition

Massive numbers of nodes will be connected in future wireless networks. This brings great difficulty to collect a large amount of data. Instead of collecting the data individually, computation over multi-access channel (CoMAC) provides an intelligent solution by computing a desired function over the air based on the signal-superposition property of wireless channel. To improve the spectrum efficiency in conventional CoMAC, we propose the use of non-orthogonal multiple access (NOMA) for functions in CoMAC. The desired functions are decomposed into several sub-functions, and multiple sub-functions are selected to be superposed over each resource block (RB). The corresponding achievable rate is derived based on sub-function superposition, which prevents a vanishing computation rate for large numbers of nodes. In order to gain more insights, we further study the limiting case when the number of nodes goes to infinity. An exact expression of the rate is derived which provides a lower bound on the computation rate. Compared with existing CoMAC, the NOMA-based CoMAC (NOMA-CoMAC) not only achieves a higher computation rate, but also provides an improved non-vanishing rate. Furthermore, the diversity order of the computation rate of NOMA-CoMAC is derived, and it shows that the system performance is dominated by the node with the worst channel gain among these sub-functions in each RB.

cs.IT

Computation over Wide-Band MAC: Improved Achievable Rate through Sub-Function Allocation

Future networks are expected to connect an enormous number of nodes wirelessly using wide-band transmission. This brings great challenges. To avoid collecting a large amount of data from the massive number of nodes, computation over multi-access channel (CoMAC) is proposed to compute a desired function over the air utilizing the signal-superposition property of MAC. Due to frequency selective fading, wide-band CoMAC is more challenging and has never been studied before. In this work, we propose the use of orthogonal frequency division multiplexing (OFDM) in wide-band CoMAC to transmit functions in a similar way to bit sequences through division, allocation and reconstruction of function. An achievable rate without any adaptive resource allocation is derived. To prevent a vanishing computation rate from the increase of the number of nodes, a novel sub-function allocation of sub-carriers is derived. Furthermore, we formulate an optimization problem considering power allocation. A sponge-squeezing algorithm adapted from the classical water-filling algorithm is proposed to solve the optimal power allocation problem. The improved computation rate of the proposed framework and the corresponding allocation has been verified through both theoretical analysis and simulation.

cs.IT

TCP Decoupling for Next Generation Communication System

In traditional networks, interfaces of network nodes are duplex. But, emerging communication technologies such as visible light communication, millimeter-wave communications, can only provide a unidirectional interface when cost is limited. It's urgent to find effective solutions to utilize such new unidirectional communication skills. Decoupling implies separating one single resource to two independent resources. This idea can be applied at physical layer, link layer, network layer, even transport layer. TCP decoupling is an end to end solution provided at transport layer. With decoupled TCP, two distinct unidirectional path can be created to meet the requirements of reliable information transfer. However, it is not an easy task to decouple a bidirectional logical path at transport layer. In this paper, we dwell on the idea of TCP decoupling. Advantages of decoupling at transport layer are analyzed also. In addition, an experiment is carried out to figure out how to implement a decouple TCP. Our results show decoupling at transport layer is possible and the modified protocol is available.

cs.NI

Joint Domain Based Massive Access for Small Packets Traffic of Uplink Wireless Channel

The fifth generation (5G) communication scenarios such as the cellular network and the emerging machine type communications will produce massive small packets. To support massive connectivity and avoid signaling overhead caused by the transmission of those small packets, this paper proposes a novel method to improve the transmission efficiency for massive connections of wireless uplink channel. The proposed method combines compressive sensing (CS) with power domain NOMA jointly, especially neither the scheduling nor the centralized power allocation is necessary in the method. Both the analysis and simulation show that the method can support up to two or three times overloading.

cs.IT

Maximizing Mobile Coverage via Optimal Deployment of Base Station and Relays

Deploying relays and/or mobile base stations is a major means of extending the coverage of a wireless network. This paper presents models, analytical results, and algorithms to answer two related questions: The first is where to deploy relays in order to extend the reach from a base station to the maximum; the second is where to deploy a mobile base station and how many relays are needed to reach any point in a given area. Simple time-division and frequency-division scheduling schemes as well as an end-to-end data rate requirement are assumed. An important use case of the results is in the Public Safety Broadband Network, in which deploying relays and mobile base stations is often crucial to provide coverage to an incident scene.

cs.IT

Co-compact entropy and its variational principle for non-compact spaces

The purpose of this paper is to generalize the variational principle, which states that the topological entropy is equal to the supremum of the measure theoretical entropies and also the minimum of the metric theoretical entropies, to non-compact dynamical systems by utilizing the co-compact entropy. The equivalence between positive co-compact entropy and the existence of p-horseshoes over the real line is also proved. This implies a system over real line with positive co-compact entropy contains a compact invariant subset.

math.DS

Monobit Digital Receivers for QPSK: Design, Analysis and Performance

Future communication system requires large bandwidth to achieve high data rate up to multigigabit/ sec, which makes analog-to-digital (ADC) become a key bottleneck for the implementation of digital receivers due to its high complexity and large power consumption. Therefore, monobit receivers for BPSK have been proposed to address this problem. In this work, QPSK modulation is considered for higher data rate. First, the optimal receiver based on monobit ADC with Nyquist sampling is derived, and its corresponding performance in the form of deflection ratio is calculated. Then a suboptimal but more practical monobit receiver is obtained, along with iterative demodulation and small sample removal. The effect of the imbalances between the In-phase (I) and Quadrature-phase (Q) branches, including the amplitude and phase imbalances, is carefully investigated too. To combat the performance loss caused by IQ imbalances, monobit receivers based on double training sequences are proposed. Numerical simulations show that the low-complexity suboptimal receiver suffers only 3dB signal to noise ratio (SNR) loss in AWGN channels and 1dB SNR loss in multipath static channels compared with the matched filter based monobit receiver with full channel state information (CSI). The impact of the phase difference between the transmitter and receiver is presented. It is observed that the performance degradation caused by the amplitude imbalance is negligible. Receivers based on double training sequences can efficiently compensate the performance loss in AWGN channel. Thanks to the diversity offered by the multipath, the effect of imbalances on monobit receivers in fading channels is slight. I

cs.IT

The entropy of co-compact open covers

Co-compact entropy is introduced as an invariant of topological conjugation for perfect mappings defined on any Hausdorff space(compactness and metrizability not necessarily required). This is achieved through the consideration of co-compact covers of the space. The advantages of co-compact entropy include: 1) it does not require the space to be compact, and thus generalizes Adler, Konheim and McAndrew's topological entropy of continuous mappings on compact dynamical systems, and 2) it is an invariant of topological conjugation, compared to Bowen's entropy that is metric-dependent. Other properties of co-compact entropy are investigated, e.g., the co-compact entropy of a subsystem does not exceed that of the whole system. For the linear system (R, f) defined by f(x) = 2x, the co-compact entropy is zero, while Bowen's entropy for this system is at least log 2. More general, it is found that co-compact entropy is a lower bound of Bowen's entropies, and the proof of this result generates the Lebesgue Covering Theorem to co-compact open covers of non-compact metric spaces, too.

math.DS

One-sided Precoder Designs on Manifolds for Interference Alignment

Interference alignment (IA) is a technique recently shown to achieve the maximum degrees of freedom (DoF) of $K$-user interference channel. In this paper, we focus on the precoder designs on manifolds for IA. By restricting the optimization only at the transmitters' side, it will alleviate the overhead induced by alternation between the forward and reverse links significantly. Firstly a classical steepest descent (SD) algorithm in multi-dimensional complex space is proposed to achieve feasible IA. Then we reform the optimization problem on Stiefel manifold, and propose a novel SD algorithm based on this manifold with lower dimensions. Moreover, aiming at further reducing the complexity, Grassmann manifold is introduced to derive corresponding algorithm for reaching the perfect IA. Numerical simulations show that the proposed algorithms on manifolds have better convergence performance and higher system capacity than previous methods, also achieve the maximum DoF.

cs.IT