SearcharxivSearch

arXiv subjects

Morteza Varasteh

Publications and source records attributed to Morteza Varasteh.

17 recordsLinked to original sources

Differentially Private Consistent Release of Counting Queries

We study the problem of releasing counting-query outputs through a stochastic mechanism that is both consistent and \((\epsilon,\delta)\)-differentially private. Consistency requires the released value to lie within the feasible range of the query, while utility is measured by the worst-case probability of error. We first derive a closed-form expression for the minimum achievable error probability and obtain an explicit optimal mechanism. By exploiting the active differential privacy constraints satisfied by this mechanism, we then characterize the entire class of optimal mechanisms via a propagation argument, identifying the structural properties shared by all optimizers. We next extend the framework to the setting in which the privacy mechanism is cascaded with an arbitrary fixed stochastic transformation representing a predetermined portion of the communication medium between the source and the destination. We first establish necessary and sufficient conditions under which this partial fixation of the medium incurs no loss in utility. We then derive upper and lower bounds on the optimal achievable performance based on convex mixing and spectral perturbation. Finally, we apply the theory to (M)-ary phase-shift keying (PSK) transmission over an additive white Gaussian noise (AWGN) channel and show that uncoded transmission is effectively optimal in the high-privacy regime.

cs.IT

Differential Privacy over Hamming Codes

We consider the transmission of the outputs of counting queries over a binary symmetric channel (BSC), where Hamming codes are employed as the channel encoder. Since the channel is inherently noisy, this transmission already provides a degree of privacy protection ``for free'', albeit at the cost of reduced utility in the form of decoding errors. A natural question is whether this privacy can be further improved (i) without any additional real-time obfuscation of the data, such as injecting artificial noise prior to transmission, and (ii) without increasing the end-to-end error probability. In this work, we answer this question in the affirmative by deriving an optimal codeword arrangement that strictly improves differential privacy guarantees while incurring no real-time computational overhead and no degradation in utility.

cs.IT

Privacy via Modulation Rotation and Inter-Symbol Interference

Two physical-layer mechanisms for achieving user-side differential privacy in communication systems are proposed. Focusing on binary phase-shift keying (BPSK) modulation, differential privacy (DP) is first studied under a deterministic phase rotation applied on the BPSK modulation at the transmitter, while the receiver is assumed to be unaware of the rotation angle. In this setting, privacy is achieved through an effective reduction in the decision distance, resulting in a controlled increase in the bit error rate (BER) without explicit noise injection. Next, a BPSK transmission scheme with intentionally induced inter-symbol interference (ISI) is studied, where the receiver is likewise unaware of the deterministic timing offset that generates the ISI. Unlike the rotated BPSK scheme, the DP obtained via ISI is shown to depend explicitly on the input data distribution. In particular, numerical results demonstrate that, for a fixed ISI parameter, the privacy loss is maximized when the binary input symbols are equiprobable. While conventional DP mechanisms rely on artificially added noise, often incurring additional energy or communication costs, it is shown that structured modifications, such as modulation rotation or induced ISI inherent to realistic communication channels can itself provide DP guarantees. While the analysis focuses on deterministic transmitter modifications unknown to the receiver, it is noted that real-world devices naturally introduce unintentional rotations or ISI due to hardware nonidealities and implementation errors. These effects can therefore provide a level of privacy without requiring explicit noise injection. Hence, it is possible to avoid deliberately perturbing the data, instead leveraging inherent device imperfections to achieve privacy guarantees with no additional privacy cost.

cs.IT

Channel Coding meets Sequence Design via Machine Learning for Integrated Sensing and Communications

For integrated sensing and communications, an intriguing question is whether information-bearing channel-coded signals can be reused for sensing - specifically ranging. This question forces the hitherto non-overlapping fields of channel coding (communications) and sequence design (sensing) to intersect by motivating the design of error-correcting codes that have good autocorrelation properties. In this letter, we demonstrate how machine learning (ML) is well-suited for designing such codes, especially for short block lengths. As an example, for rate 1/2 and block length 32, we show that even an unsophisticated ML code has a bit-error rate performance similar to a Polar code with the same parameters, but with autocorrelation sidelobes 24dB lower. While a length-32 Zadoff-Chu (ZC) sequence has zero autocorrelation sidelobes, there are only 16 such sequences and hence, a 1/2 code rate cannot be realized by using ZC sequences as codewords. Hence, ML bridges channel coding and sequence design by trading off an ideal autocorrelation function for a large (i.e., rate-dependent) codebook size.

eess.SP

Privacy Against Agnostic Inference Attacks in Vertical Federated Learning

A novel form of inference attack in vertical federated learning (VFL) is proposed, where two parties collaborate in training a machine learning (ML) model. Logistic regression is considered for the VFL model. One party, referred to as the active party, possesses the ground truth labels of the samples in the training phase, while the other, referred to as the passive party, only shares a separate set of features corresponding to these samples. It is shown that the active party can carry out inference attacks on both training and prediction phase samples by acquiring an ML model independently trained on the training samples available to them. This type of inference attack does not require the active party to be aware of the score of a specific sample, hence it is referred to as an agnostic inference attack. It is shown that utilizing the observed confidence scores during the prediction phase, before the time of the attack, can improve the performance of the active party's autonomous ML model, and thus improve the quality of the agnostic inference attack. As a countermeasure, privacy-preserving schemes (PPSs) are proposed. While the proposed schemes preserve the utility of the VFL model, they systematically distort the VFL parameters corresponding to the passive party's features. The level of the distortion imposed on the passive party's parameters is adjustable, giving rise to a trade-off between privacy of the passive party and interpretabiliy of the VFL outcomes by the active party. The distortion level of the passive party's parameters could be chosen carefully according to the privacy and interpretabiliy concerns of the passive and active parties, respectively, with the hope of keeping both parties (partially) satisfied. Finally, experimental results demonstrate the effectiveness of the proposed attack and the PPSs.

cs.CR

Privacy Against Inference Attacks in Vertical Federated Learning

Vertical federated learning is considered, where an active party, having access to true class labels, wishes to build a classification model by utilizing more features from a passive party, which has no access to the labels, to improve the model accuracy. In the prediction phase, with logistic regression as the classification model, several inference attack techniques are proposed that the adversary, i.e., the active party, can employ to reconstruct the passive party's features, regarded as sensitive information. These attacks, which are mainly based on a classical notion of the center of a set, i.e., the Chebyshev center, are shown to be superior to those proposed in the literature. Moreover, several theoretical performance guarantees are provided for the aforementioned attacks. Subsequently, we consider the minimum amount of information that the adversary needs to fully reconstruct the passive party's features. In particular, it is shown that when the passive party holds one feature, and the adversary is only aware of the signs of the parameters involved, it can perfectly reconstruct that feature when the number of predictions is large enough. Next, as a defense mechanism, a privacy-preserving scheme is proposed that worsen the adversary's reconstruction attacks, while preserving the full benefits that VFL brings to the active party. Finally, experimental results demonstrate the effectiveness of the proposed attacks and the privacy-preserving scheme.

cs.LG

On Capacity-Achieving Distributions for Complex AWGN Channels Under Nonlinear Power Constraints and their Applications to SWIPT

The capacity of a complex and discrete-time memoryless additive white Gaussian noise (AWGN) channel under three constraints, namely, input average power, input amplitude and output delivered power is studied. The output delivered power constraint is modelled as the average of linear combination of even moments of the channel input being larger than a threshold. It is shown that the capacity of an AWGN channel under transmit average power and receiver delivered power constraints is the same as the capacity of an AWGN channel under an average power constraint. However, depending on the two constraints, the capacity can be either achieved by a Gaussian distribution or arbitrarily approached by using time-sharing between a Gaussian distribution and On-Off Keying. As an application, a simultaneous wireless information and power transfer (SWIPT) problem is studied, where an experimentally-validated nonlinear model of the harvester is used. It is shown that the delivered power depends on higher order moments of the channel input. Two inner bounds, one based on complex Gaussian inputs and the other based on further restricting the delivered power are obtained for the Rate-Power (RP) region. For Gaussian inputs, the optimal inputs are zero mean and a tradeoff between transmitted information and delivered power is recognized by considering asymmetric power allocations between inphase and quadrature subchannels. Through numerical algorithms, it is observed that input distributions (obtained by restricting the delivered power) attain larger RP region compared to Gaussian input counterparts.

cs.IT

Zero-Delay Source-Channel Coding with a One-Bit ADC Front End and Correlated Side Information at the Receiver

Zero-delay transmission of a Gaussian source over an additive white Gaussian noise (AWGN) channel is considered with a one-bit analog-to-digital converter (ADC) front end and a correlated side information at the receiver. The design of the optimal encoder and decoder is studied for two performance criteria, namely, the mean squared error (MSE) distortion and the distortion outage probability (DOP), under an average power constraint on the channel input. For both criteria, necessary optimality conditions for the encoder and the decoder are derived. Using these conditions, it is observed that the numerically optimized encoder (NOE) under the MSE distortion criterion is periodic, and its period increases with the correlation between the source and the receiver side information. For the DOP, it is instead seen that the NOE mappings periodically acquire positive and negative values, which decay to zero with increasing source magnitude, and the interval over which the mapping takes non-zero values, becomes wider with the correlation between the source and the side information.

cs.IT

Learning to Communicate and Energize: Modulation, Coding and Multiple Access Designs for Wireless Information-Power Transmission

The explosion of the number of low-power devices in the next decades calls for a re-thinking of wireless network design, namely, unifying wireless transmission of information and power so as to make the best use of the RF spectrum, radiation, and infrastructure for the dual purpose of communicating and energizing. This paper provides a novel learning-based approach towards such wireless network design. To that end, a parametric model of a practical energy harvester, accounting for various sources of nonlinearities, is proposed using a nonlinear regression algorithm applied over collected real data. Relying on the proposed model, the learning problem of modulation design for Simultaneous Wireless Information-Power Transmission (SWIPT) over a point-to-point link is studied. Joint optimization of the transmitter and the receiver is implemented using Neural Network (NN)-based autoencoders. The results reveal that by increasing the receiver power demand, the baseband transmit modulation constellation converges to an On-Off keying signalling. Utilizing the observations obtained via learning, an algorithmic SWIPT modulation design is proposed. It is observed via numerical results that the performance loss of the proposed modulations are negligible compared to the ones obtained from learning. Extension of the studied problem to learning modulation design for multi-user SWIPT scenarios and coded modulation design for point-to-point SWIPT are considered. The major conclusion of this work is to utilize learning-based results to design non learning-based algorithms, which perform as well. In particular, inspired by the results obtained via learning, an algorithmic approach for coded modulation design is proposed, which performs very close to its learning counterparts, and is significantly superior due to its high real-time adaptability to new system design parameters.

cs.IT

Learning Modulation Design for SWIPT with Nonlinear Energy Harvester: Large and Small Signal Power Regimes

Nonlinear energy harvesters (EH) behave differently depending on the range of their input power. In the literature, different models have been proposed mainly for relatively small and large input power regimes of an EH. Due to the complexity of the proposed nonlinear models, obtaining analytical optimal or well performing signal designs have been extremely challenging. Relying on the proposed models in the literature, the learning problem of modulation design for simultaneous wireless information-power transfer (SWIPT) over a point-to-point link is studied. Joint optimization of the transmitter and the receiver is implemented using neural network (NN)-based autoencoders. The results reveal that for relatively small channel input powers, as the power demand increases at the receiver, one of the symbols is shot away from the origin while the remaining symbols approach zero amplitude. In the very extreme case of merely receiver power demand, the modulations are in the form of On-Off keying signalling with a low probability of the On signal. On the other side, for relatively large channel input powers, it is observed that as the receiver power demand increases, a number of symbols approach zero amplitude, whereas the others (more than one symbol) get equally high amplitudes but with different phases. In the extreme scenario of merely receiver power demand, the modulation resembles multiple On-Off keying signalling with different phases.

cs.IT

SWIPT Signalling over Frequency-Selective Channels with a Nonlinear Energy Harvester: Non-Zero Mean and Asymmetric Inputs

Simultaneous Wireless Information and Power Transfer (SWIPT) over a point-to-point frequency-selective Additive White Gaussian Noise (AWGN) channel is studied. Considering an approximation of the nonlinearity of the harvester, a general form of delivered power in terms of system baseband parameters is derived, which demonstrates the dependency of the delivered power on higher order moment of the baseband channel input distribution. The optimization problem of maximizing Rate-Power (RP) region is studied. Assuming that the Channel State Information (CSI) is available at both the receiver and the transmitter, and constraining to non-zero mean Gaussian input distributions, an optimization algorithm for power allocation among different subchannels is studied. As a special case, optimality conditions for zero mean Gaussian inputs are derived. Results obtained from numerical optimization demonstrate the superiority of non-zero mean Gaussian inputs (with asymmetric power allocation in each complex subchannel) in yielding a larger RP region compared to their zero mean and non-zero mean (with symmetric power allocation in each complex subchannel) counterparts. This severely contrasts with SWIPT design under linear energy harvesting, for which circularly symmetric Gaussian inputs are optimal.

cs.IT

A Learning Approach To Wireless Information and Power Transfer Signal and System Design

The end-to-end learning of Simultaneous Wireless Information and Power Transfer (SWIPT) over a noisy channel is studied. Adopting a nonlinear model for the energy harvester (EH) at the receiver, a joint optimization of the transmitter and the receiver is implemented using Deep Neural Network (DNN)-based autoencoders. Modulation constellations for different levels of "power" and "information rate" demand at the receiver are obtained. The numerically optimized signal constellations are inline with the previous theoretical results. In particular, it is observed that as the receiver energy demand increases, all but one of the modulation symbols are concentrated around the origin and the other symbol is shot away from the origin along either the real or imaginary subchannel.

cs.IT

SWIPT Signalling over Complex AWGN Channels with Two Nonlinear Energy Harvester Models

Simultaneous Wireless Information and Power Transfer (SWIPT) is subject to nonlinearity at the energy harvester that leads to significant changes to transmit signal designs compared to conventional wireless communications. In this paper, the capacity of a discrete time, memoryless and complex Additive White Gaussian Noise (AWGN) channel in the presence of a nonlinear energy harvester at the receiver is studied. Considering the two common nonlinear energy harvester models introduced in the literature, two sets of constraints are considered. First the capacity is studied under average power (AP), peak amplitude (PA) and receiver delivery power (RDP) constraints. The RDP constraint is modelled as a linear combination of even-moment statistics of the channel input being larger than a threshold. It is shown that the capacity of an AWGN channel under AP and RDP constraints is the same as the capacity of an AWGN channel under an AP constraint, however, depending on the two constraints, it can be either achieved or arbitrarily approached. It is also shown that under AP, PA and RDP constraints, the amplitude of the optimal inputs is discrete with a finite number of mass points. Next, the capacity is studied under AP, PA and output outage probability (OOP) constraints. OOP is modelled as satisfying a certain probability inequality for the amplitude of the received signal being outside of a given interval. Similarly, it is shown that the amplitude of the optimal input is discrete with a finite number of mass points.

cs.IT

Gaussian Multiple Access Channels with One-Bit Quantizer at the Receiver

The capacity region of a two-transmitter Gaussian multiple access channel (MAC) under average input power constraints is studied, when the receiver employs a zero-threshold one-bit analog-to-digital converter (ADC). It is proved that the input distributions of the two transmitters that achieve the boundary points of the capacity region are discrete. Based on the position of a boundary point, upper bounds on the number of the mass points of the corresponding distributions are derived.

cs.IT

Joint Source-Channel Coding with One-Bit ADC Front End

Motivated by the practical constraints arising in emerging sensor network and Internet-of-Things (IoT) applications, the zero-delay transmission of a Gaussian measurement over a real single-input multiple-output (SIMO) additive white Gaussian noise (AWGN) channel is studied with a low-resolution analog-to-digital converter (ADC) front end. Joint optimization of the encoder and the decoder mapping is tackled under both the mean squared error (MSE) distortion and the distortion outage probability (DOP) criteria, with an average power constraint on the channel input. Optimal encoder and decoder mappings are identified for a one-bit ADC front end under both criteria. For the MSE distortion, the optimal encoder mapping is shown to be non-linear in general, while it tends to a linear encoder in the low signal-to-noise ratio (SNR) regime, and to an antipodal digital encoder in the high SNR regime. This is in contrast to the optimality of linear encoding at all SNR values in the presence of a full-precision front end. For the DOP criterion, it is shown that the optimal encoder mapping is piecewise constant and can take only two opposite values when it is non-zero. For both the MSE distortion and the DOP criteria, necessary optimality conditions are then derived for $K$-level ADC front ends as well as front ends with multiple one-bit ADCs. These conditions are used to obtain numerically optimized solutions. Extensive numerical results are also provided in order to gain insights into the structure of the optimal encoding and decoding mappings.

cs.IT

Wireless Information and Power Transfer over an AWGN channel: Nonlinearity and Asymmetric Gaussian Signaling

Simultaneous transmission of information and power over a point-to-point flat-fading complex Additive White Gaussian Noise (AWGN) channel is studied. In contrast with the literature that relies on an inaccurate linear model of the energy harvester, an experimentally-validated nonlinear model is considered. A general form of the delivered Direct Current (DC) power in terms of system baseband parameters is derived, which demonstrates the dependency of the delivered DC power on higher order statistics of the channel input distribution. The optimization problem of maximizing Rate-Power (R-P) region is studied. Assuming that the Channel gain is available at both the receiver and the transmitter, and constraining to independent and identically distributed (i.i.d.) channel inputs determined only by their first and second moment statistics, an inner bound for the general problem is obtained. Notably, as a consequence of the harvester nonlinearity, the studied inner bound exhibits a tradeoff between the delivered power and the rate of received information. It is shown that the tradeoff-characterizing input distribution is with mean zero and with asymmetric power allocations to the real and imaginary dimensions.

cs.IT

Zero-Delay Joint Source-Channel Coding in the Presence of Interference Known at the Encoder

Zero-delay transmission of a Gaussian source over an additive white Gaussian noise (AWGN) channel is considered in the presence of an additive Gaussian interference signal. The mean squared error (MSE) distortion is minimized under an average power constraint assuming that the interference signal is known at the transmitter. Optimality of simple linear transmission does not hold in this setting due to the presence of the known interference signal. While the optimal encoder-decoder pair remains an open problem, various non-linear transmission schemes are proposed in this paper. In particular, interference concentration (ICO) and one-dimensional lattice (1DL) strategies, using both uniform and non-uniform quantization of the interference signal, are studied. It is shown that, in contrast to typical scalar quantization of Gaussian sources, a non-uniform quantizer, whose quantization intervals become smaller as we go further from zero, improves the performance. Given that the optimal decoder is the minimum MSE (MMSE) estimator, a necessary condition for the optimality of the encoder is derived, and the numerically optimized encoder (NOE) satisfying this condition is obtained. Based on the numerical results, it is shown that 1DL with non-uniform quantization performs closer (compared to the other schemes) to the numerically optimized encoder while requiring significantly lower complexity.

cs.IT