SearcharxivSearch

arXiv subjects

Hamdi Joudeh

Publications and source records attributed to Hamdi Joudeh.

At least 19 recordsLinked to original sources

A Superposition Signaling Scheme for Integrated Sensing and Communication

We investigate the capacity of an integrated sensing and communication system operating with orthogonal frequency division multiplexing, where the integrated sidelobe level of the transmit signal is adopted as an input cost. The problem is reduced to the capacity of a complex additive white Gaussian noise channel under power and kurtosis constraints. The sensing-optimal and communication-optimal operating points are characterized by circularly symmetric constant-modulus and complex Gaussian inputs, respectively, while the capacity-achieving input in between has discrete amplitude support with a concentric multi-ring geometry. We propose the superposition of the two extremal inputs as a simple and tunable signaling strategy, whose rate admits an exact expression via successive decoding. Numerical results show that the proposed strategy attains a worst-case gap of approximately 0.043 bits to the capacity.

cs.IT

Soft Guessing Under Logarithmic Loss Allowing Errors and Variable-Length Source Coding

This paper considers the problem of soft guessing under a logarithmic loss distortion measure while allowing errors. We find an optimal guessing strategy, and derive single-shot upper and lower bounds for the minimal guessing moments as well as an asymptotic expansion for i.i.d. sources. These results are extended to the case where side information is available to the guesser. Furthermore, a connection between soft guessing allowing errors and variable-length lossy source coding under logarithmic loss is demonstrated. The R\'enyi entropy, the smooth R\'enyi entropy, and their conditional versions play an important role.

cs.IT

Exponential Error Bounds for Information Bottleneck Source Coding Problems

We study the information bottleneck (IB) source coding problem, also known as remote lossy source coding under logarithmic loss. Based on a rate-limited description of noisy observations, the receiver produces a soft estimate for the remote source, i.e., a probability distribution, evaluated under the logarithmic loss. We focus on the excess distortion probability of IB source coding and investigate how fast it converges to 0 or 1, depending on whether the rate is above or below the rate-distortion function. The latter case is also known as the exponential strong converse. We establish both the exact error exponent and the exact strong converse exponent for IB source coding by deriving matching upper and lower exponential bounds. The obtained exponents involve optimizations over auxiliary random variables. The matching converse bounds are derived through non-trivial extensions of existing sphere packing and single-letterization techniques, which we adapt to incorporate auxiliary random variables. In the second part of this paper, we establish a code-level connection between IB source coding and source coding with a helper, also known as the Wyner-Ahlswede-K\"orner (WAK) problem. We show that every code for the WAK problem is a code for IB source coding. This requires noticing that IB source coding, under the excess distortion criterion, is equivalent to source coding with a helper available at both the transmitter and the receiver; the latter in turn relates to the WAK problem. Through this connection, we re-derive the best known sphere packing exponent of the WAK problem, and provide it with an operational interpretation.

cs.IT

Joint Communication and Parameter Estimation in MIMO Channels

We study a joint communication and sensing setting comprising a transmitter, a receiver, and a sensor, all equipped with multiple antennas. The transmitter sends an encoded signal over the channel with the dual purpose of communicating an information message to the receiver, and enabling the sensor to estimate a target parameter vector by generating back-scattered signals. We assume that the transmitter and sensor are co-located, or fully connected, giving the latter access to the transmitted signal. The target parameter vector is randomly drawn from a continuous distribution, yet remains fixed throughout the transmission block. We establish the fundamental performance trade-off between the communication and sensing tasks, captured in terms of a capacity-MSE function. In doing so, we identify optimal coding schemes for this multi-antenna joint communication and sensing setting. Moreover, we particularize our result to two practically-inspired scenarios where we showcase optimal schemes and trade-offs.

cs.IT

Dual Domain Expurgated Error Exponents for Source Coding with Side Information

We introduce an expurgation method for source coding with side information that enables direct dual-domain derivations of expurgated error exponents. Dual-domain methods yield optimization problems over few parameters, with any sub-optimal choice resulting in an achievable exponent, as opposed to primal-domain optimization over distributions. In addition, dual-domain methods naturally allow for general alphabets and/or memory. We derive two such expurgated error exponents for different random-coding ensembles in the case where the decoder is possibly mismatched with respect to the source and side information joint distribution. We show the better of the exponents coincides with the Csisz\'ar-K\"orner exponent obtained via a graph decomposition lemma. We show some numerical examples that illustrate the differences between the two exponents and show that in the case of source coding without side information, the expurgated exponent coincides with the error exponent of the source optimal code.

cs.IT

Out-of-Distribution Detection in Medical Imaging via Diffusion Trajectories

In medical imaging, unsupervised out-of-distribution (OOD) detection offers an attractive approach for identifying pathological cases with extremely low incidence rates. In contrast to supervised methods, OOD-based approaches function without labels and are inherently robust to data imbalances. Current generative approaches often rely on likelihood estimation or reconstruction error, but these methods can be computationally expensive, unreliable, and require retraining if the inlier data changes. These limitations hinder their ability to distinguish nominal from anomalous inputs efficiently, consistently, and robustly. We propose a reconstruction-free OOD detection method that leverages the forward diffusion trajectories of a Stein score-based denoising diffusion model (SBDDM). By capturing trajectory curvature via the estimated Stein score, our approach enables accurate anomaly scoring with only five diffusion steps. A single SBDDM pre-trained on a large, semantically aligned medical dataset generalizes effectively across multiple Near-OOD and Far-OOD benchmarks, achieving state-of-the-art performance while drastically reducing computational cost during inference. Compared to existing methods, SBDDM achieves a relative improvement of up to 10.43% and 18.10% for Near-OOD and Far-OOD detection, making it a practical building block for real-time, reliable computer-aided diagnosis.

cs.CV

Dynamic Estimation Loss Control in Variational Quantum Sensing via Online Conformal Inference

Quantum sensing exploits non-classical effects to overcome limitations of classical sensors, with applications ranging from gravitational-wave detection to nanoscale imaging. However, practical quantum sensors built on noisy intermediate-scale quantum (NISQ) devices face significant noise and sampling constraints, and current variational quantum sensing (VQS) methods lack rigorous performance guarantees. This paper proposes an online control framework for VQS that dynamically updates the variational parameters while providing deterministic error bars on the estimates. By leveraging online conformal inference techniques, the approach produces sequential estimation sets with a guaranteed long-term risk level. Experiments on a quantum magnetometry task confirm that the proposed dynamic VQS approach maintains the required reliability over time, while still yielding precise estimates. The results demonstrate the practical benefits of combining variational quantum algorithms with online conformal inference to achieve reliable quantum sensing on NISQ devices.

quant-ph

Error Exponents for Oblivious Relaying and Connections to Source Coding with a Helper

The information bottleneck channel, also known as oblivious relaying, is a two-hop channel where a transmitter sends messages to a remote receiver via an intermediate relay node. A codeword sent by the transmitter passes through a discrete memoryless channel to reach the relay, which then processes the noisy channel output and forwards it to the receiver through a noiseless rate-limited link. The relay is oblivious, in the sense that it has no knowledge of the channel codebook used in transmission. Previous works on oblivious relaying focus on characterizing achievable rates. In this work, we study error exponents and explore connections to lossless source coding with a helper, also known as the Wyner-Ahlswede-K\"orner (WAK) problem. We first establish an achievable error exponent for oblivious relaying under constant compositions codes. A key feature of our analysis is the use of the type covering lemma to design the relay's compress-forward scheme. We then show that employing constant composition code ensembles does not improve the rates achieved with their IID counterparts. We also derive a sphere packing upper bound for the error exponent. In the second part of this paper, we establish a connection between the information bottleneck channel and the WAK problem. We show that good codes for the latter can be produced through permuting codes designed for the former. This is accomplished by revisiting Ahlswede's covering lemma, and extending it to achieve simultaneous covering of a type class by several distinct sets using the same sequence of permutations. We then apply our approach to attain the best known achievable error exponent for the WAK problem, previously established by Kelly and Wagner. As a byproduct of our derivations, we also establish error exponents and achievable rates under mismatched decoding rules.

cs.IT

Ensemble-Tight Second-Order Asymptotics and Exponents for Guessing-Based Decoding with Abandonment

This paper considers guessing-based decoders with abandonment for discrete memoryless channels in which all codewords have the same composition. This class of decoders rank-orders all input sequences in the codebook's composition class from ``closest'' to ``farthest'' from the channel output and then queries them sequentially in that order for codebook membership. Decoding terminates when a codeword is encountered or when a predetermined number of guesses is reached, and decoding is abandoned. We derive ensemble-tight first-order asymptotics for the code rate and abandonment rate, which shows that guessing-based decoding is more efficient than conventional testing-based decoding whenever the capacity of the channel exceeds half the entropy of the capacity-achieving input distribution. The main focus of this paper is on refined asymptotics, specifically, second-order asymptotics, error exponents, and strong converse exponents. The optimal second-order region is characterized in terms of the minimum of the second-order code and abandonment rates. The error (resp.\ strong converse) exponent is characterized in terms of the minimum (resp.\ maximum) of the usual channel coding exponent and an abandonment exponent, which turns out to be a special case of the exponent of conditional almost-lossless source coding.

cs.IT

Strong Converse Exponent for Remote Lossy Source Coding

Past works on remote lossy source coding studied the rate under average distortion and the error exponent of excess distortion probability. In this work, we look into how fast the excess distortion probability converges to 1 at small rates, also known as exponential strong converse. We characterize its exponent by establishing matched upper and lower bounds. From the exponent, we also recover two previous results on lossy source coding and biometric authentication.

cs.IT

On the Capacity of Correlated Phase-Noise Channels: An Electro-Optic Frequency Comb Example

The capacity of a discrete-time channel with correlated phase noises is investigated. In particular, the electro-optic frequency comb system is considered, where the phase noise of each subchannel is a combination of two independent Wiener phase-noise sources. Capacity upper and lower bounds are derived for this channel and are compared with lower bounds obtained by numerically evaluating the achievable information rates using quadrature amplitude modulation constellations. Capacity upper and lower bounds are provided for the high signal-to-noise ratio (SNR) regime. The multiplexing gain (pre-log) is shown to be $M-1$, where $M$ represents the number of subchannels. A constant gap between the asymptotic upper and lower bounds is observed, which depends on the number of subchannels $M$. For the specific case of $M=2$, capacity is characterized up to a term that vanishes as the SNR grows large.

cs.IT

Joint Communication and Channel Discrimination

We consider a basic joint communication and sensing setup comprising a transmitter, a receiver and a sensor. The transmitter sends a codeword to the receiver through a discrete memoryless channel, and the receiver is interested in decoding the transmitted codeword. At the same time, the sensor picks up a noisy version of the transmitted codeword through one of two possible discrete memoryless channels. The sensor knows the codeword and wishes to discriminate between the two possible channels, i.e. to identify the channel that has generated the output given the input. We study the trade-off between communication and sensing in the asymptotic regime, captured in terms of the channel coding rate against the two types of discrimination error exponents. We characterize the optimal trade-off between the rate and the exponents for general discrete memoryless channels with an input cost constraint.

cs.IT

On Joint Communication and Channel Discrimination

We consider a basic communication and sensing setup comprising a transmitter, a receiver and a sensor. The transmitter sends an encoded sequence to the receiver through a discrete memoryless channel, and the receiver is interested in decoding the sequence. On the other hand, the sensor picks up a noisy version of the transmitted sequence through one of two possible discrete memoryless channels. The sensor knows the transmitted sequence and wishes to discriminate between the two possible channels, i.e. to identify the channel that has generated the output given the input. We study the trade-off between communication and sensing in the asymptotic regime, captured in terms of the coding rate to the receiver against the discrimination error exponent at the sensor. We characterize the optimal rate-exponent trade-off for general discrete memoryless channels with an input cost constraint.

cs.IT

Cellular Networks With Finite Precision CSIT: GDoF Optimality of Multi-Cell TIN and Extremal Gains of Multi-Cell Cooperation

We study the generalized degrees-of-freedom (GDoF) of cellular networks under finite precision channel state information at the transmitters (CSIT). We consider downlink settings modeled by the interfering broadcast channel (IBC) under no multi-cell cooperation, and the overloaded multiple-input-single-output broadcast channel (MISO-BC) under full multi-cell cooperation. We focus on three regimes of interest: the mc-TIN regime, where a scheme based on treating inter-cell interference as noise (mc-TIN) was shown to be GDoF optimal for the IBC; the mc-CTIN regime, where the GDoF region achievable by mc-TIN is convex without the need for time-sharing; and the mc-SLS regime which extends a previously identified regime, where a simple layered superposition (SLS) scheme is optimal for the 3-transmitter-3-user MISO-BC, to overloaded cellular-type networks with more users than transmitters. We first show that the optimality of mc-TIN for the IBC extends to the entire mc-CTIN regime when CSIT is limited to finite precision. The converse proof of this result relies on a new application of aligned images bounds. We then extend the IBC converse proof to the counterpart overloaded MISO-BC, obtained by enabling full transmitter cooperation. This, in turn, is utilized to show that a multi-cell variant of the SLS scheme is optimal in the mc-SLS regime under full multi-cell cooperation, albeit only for 2-cell networks. The overwhelming combinatorial complexity of the GDoF region stands in the way of extending this result to larger networks. Alternatively, we appeal to extremal network analysis, recently introduced by Chan et al., and study the GDoF gain of multi-cell cooperation over mc-TIN in the three regimes of interest. We show that this extremal GDoF gain is bounded by small constants in the mc-TIN and mc-CTIN regimes, yet scales logarithmically with the number of cells in the mc-SLS regime.

cs.IT

Fundamental Limits of Wireless Caching Under Mixed Cacheable and Uncacheable Traffic

We consider cache-aided wireless communication scenarios where each user requests both a file from an a-priori generated cacheable library (referred to as 'content'), and an uncacheable 'non-content' message generated at the start of the wireless transmission session. This scenario is easily found in real-world wireless networks, where the two types of traffic coexist and share limited radio resources. We focus on single-transmitter, single-antenna wireless networks with cache-aided receivers, where the wireless channel is modelled by a degraded Gaussian broadcast channel (GBC). For this setting, we study the delay-rate trade-off, which characterizes the content delivery time and non-content communication rates that can be achieved simultaneously. We propose a scheme based on the separation principle, which isolates the coded caching and multicasting problem from the physical layer transmission problem. We show that this separation-based scheme is sufficient for achieving an information-theoretically order optimal performance, up to a multiplicative factor of 2.01 for the content delivery time, when working in the generalized degrees of freedom (GDoF) limit. We further show that the achievable performance is near-optimal after relaxing the GDoF limit, up to an additional additive factor of 2 bits per dimension for the non-content rates. A key insight emerging from our scheme is that in some scenarios considerable amounts of non-content traffic can be communicated while maintaining the minimum content delivery time, achieved in the absence of non-content messages; compliments of 'topological holes' arising from asymmetries in wireless channel gains.

cs.IT

Optimality of Treating Inter-Cell Interference as Noise Under Finite Precision CSIT

In this work, we study the generalized degrees-of-freedom (GDoF) of downlink and uplink cellular networks, modeled as Gaussian interfering broadcast channels (IBC) and Gaussian interfering multiple access channels (IMAC), respectively. We focus on regimes of low inter-cell interference, where single-cell transmission with power control and treating inter-cell interference as noise (mc-TIN) is GDoF optimal. Recent works have identified two relevant regimes in this context: one in which the GDoF region achieved through mc-TIN for both the IBC and IMAC is a convex polyhedron without the need for time-sharing (mc-CTIN regime), and a smaller (sub)regime where mc-TIN is GDoF optimal for both the IBC and IMAC (mc-TIN regime). In this work, we extend the mc-TIN framework to cellular scenarios where channel state information at the transmitters (CSIT) is limited to finite precision. We show that in this case, the GDoF optimality of mc-TIN extends to the entire mc-CTIN regime, where GDoF benefits due to interference alignment (IA) are lost. Our result constitutes yet another successful application of robust outer bounds based on the aligned images (AI) approach.

cs.IT

On the Separability of Parallel MISO Broadcast Channels Under Partial CSIT: A Degrees of Freedom Region Perspective

We study the $K$-user, $M$-subchannel parallel multiple-input-single-output (MISO) broadcast channel (BC) under arbitrary levels of partial channel state information at the transmitter (CSIT). We show that the parallel subchannels constituting this setting are separable from a degrees-of-freedom (DoF) region perspective if and only if the partial CSIT pattern is totally ordered. This total order condition corresponds to users abiding by the same order, with respect to their CSIT quality levels, in each of the parallel subchannels. For instance, let $α_{k}^{[l]}$ and $α_{j}^{[l]}$ be the CSIT quality parameters for users $k$ and $j$ over subchannel $l$. Under total order, having $α_{k}^{[l]} \geq α_{j}^{[l]}$ implies that $α_{k}^{[m]} \geq α_{j}^{[m]}$ holds for every subchannel $m$. In this case, the entire DoF region is achievable using simple separate coding, where a single-subchannel-type transmission scheme is employed in each subchannel. To show this separability result, we first derive an outer bound for the DoF region by extending the aligned image sets approach of Davoodi and Jafar to the considered setting. We then show that this outer bound coincides with the inner bound achieved through separate coding, given by the Minkowski sum of $M$ single-subchannel DoF regions, under the total order condition, hence settling the if part of the main theorem. To prove the only if part of the theorem, we identify a set of DoF tuples achievable through joint coding across subchannels, yet not achievable through separate coding whenever the total order condition is violated. Moreover, we also highlight the implications of our main result on the design of CSIT feedback schemes for multi-carrier multi-antenna wireless networks.

cs.IT

On the Optimality of Treating Inter-Cell Interference as Noise: Downlink Cellular Networks and Uplink-Downlink Duality

We consider the information-theoretic optimality of treating inter-cell interference as noise (multi-cell TIN) in downlink cellular networks. We focus on scenarios modeled by the Gaussian interfering broadcast channel (IBC), comprising $K$ mutually interfering Gaussian broadcast channels (BCs), each formed by a base station communicating independent messages to an arbitrary number of users. We establish a new power allocation duality between the IBC and its dual interfering multiple access channel (IMAC), which entails that the corresponding generalized degrees-of-freedom regions achieved through multi-cell TIN and power control (TINA regions) for both networks are identical. As by-products of this duality, we obtain an explicit characterization of the IBC TINA region from a previously established characterization of the IMAC TINA region; and identify a multi-cell convex-TIN regime in which the IBC TINA region is a polyhedron (hence convex) without the need for time-sharing. We then identify a smaller multi-cell TIN regime in which the IBC TINA region is optimal and multi-cell TIN achieves the entire capacity region of the IBC, up to a constant gap. This is accomplished by deriving a new genie-aided outer bound for the IBC, that reveals a novel BC-type order that holds amongst users in each constituent BC (or cell) under inter-cell interference, which in turn is not implied by previously known BC-type orders (i.e. degraded, less noisy and more capable orders). The multi-cell TIN regime that we identify for the IBC coincides with a corresponding multi-cell TIN regime previously identified for the IMAC, hence establishing a comprehensive uplink-downlink duality of multi-cell TIN in the GDoF (and approximate capacity) sense.

cs.IT