Searcharxiv⌕ Search

arXiv subjects

Frans M. J. Willems

Publications and source records attributed to Frans M. J. Willems.

At least 19 recordsLinked to original sources
arXiv2022

Band-ESS: Streaming Enumerative Coding with Applications to Probabilistic Shaping

Probabilistic amplitude shaping (PAS) is on track to become the de facto coded modulation standard for communication systems aiming to operate close to channel capacity at high transmission rates. The essential component of PAS that breeds this widespread interest is the amplitude shaping block, through which the channel input distribution is controlled. This block is responsible for converting bit strings into amplitude sequences with certain properties, e.g., fixed composition, limited energy, limited energy variation, etc. Recently, band-trellis enumerative sphere shaping (B-ESS) was introduced as an amplitude shaping technique that achieves limited energy variations which is useful in optical communication scenarios. B-ESS operates based on a trellis diagram in which sequences with high energy variations are pruned. In this work, we study the implementation of B-ESS. We first show that thanks to the trellis structure obtained by this pruning, B-ESS can be implemented with very low storage complexity. The trellis computation is shown to be reduced to a set of recursive multiplications with a scalar factor. Then we show that this scalar factor can be adjusted such that the trellis computation is further simplified and realized with only binary shifts. This shift-based B-ESS (1) can be implemented for arbitrarily long blocklengths without incurring an increase in complexity, and (2) can operate in a streaming mode similar to convolutional coding.

cs.IT↗
arXiv2022

Log-CCDM: Distribution Matching via Multiplication-free Arithmetic Coding

Recent years have seen renewed attention to arithmetic coding (AC). This is thanks to the use of AC for distribution matching (DM) to control the channel input distribution in probabilistic amplitude shaping. There are two main problems inherent to AC: (1) its required arithmetic precision grows linearly with the input length, and (2) high-precision multiplications and divisions are required. Here, we introduce a multiplication-free AC-based DM technique via three lookup tables (LUTs) which solves both problems above. These LUTs are used to approximate the high-precision multiplications and divisions by additions and subtractions. The required precision of our approach is shown to grow logarithmically with the input length. We prove that this approximate technique maintains the invertibility of DM. At an input length of 1024 symbols, the proposed technique achieves negligible rate loss ($<0.01$ bit/sym) against the full-precision DM, while requiring less than 4 kilobytes of storage.

cs.IT↗
arXiv2021

Kurtosis-limited Sphere Shaping for Nonlinear Interference Noise Reduction in Optical Channels

Nonlinear interference (NLI) generated during the propagation of an optical waveform through the fiber depends on the fourth order standardized moment of the channel input distribution, also known as kurtosis. Probabilistically-shaped inputs optimized for the linear Gaussian channel have a Gaussian-like distribution with high kurtosis. For optical channels, this leads to an increase in NLI power and consequently, a decrease in effective signal-to-noise ratio (SNR). In this work, we propose kurtosis-limited enumerative sphere shaping (K-ESS) as an algorithm to generate low-kurtosis shaped inputs. Numerical simulations at a shaping blocklength of 108 amplitudes demonstrate that with K-ESS, it is possible to increase the effective SNRs by 0.4 dB in a single-span single-channel scenario at 400 Gbit/s. K-ESS offers also a twofold decrease in frame error rate with respect to Gaussian-channel-optimal sphere shaping.

eess.SP↗
arXiv2021

List-encoding CCDM: A Nonlinearity-tolerant Shaper Aided by Energy Dispersion Index

Recently, a metric called energy dispersion index (EDI) was proposed to indicate the nonlinear interference (NLI) induced by correlated symbols during optical transmission. In this paper, we propose a new shaper architecture to decrease the EDI of transmitted symbols and thus, increase the signal-to-noise ratio (SNR). We call this shaper the list-encoding constant-composition distribution matcher (L-CCDM). L-CCDM consists of an additional EDI selecting module, which is compatible with standard probabilistic amplitude shaping (PAS) architecture. Numerical results obtained from a multi-span multi-channel system show that when compared to standard CCDM with 256-ary quadrature amplitude modulation (256QAM), the proposed architecture offers an effective SNR gain of 0.35 dB, an achievable information rate gain of 0.22 bit/4D-symbol, or equivalently an 8% reach extension.

eess.SP↗
arXiv2021

Orthogonal Time Frequency Space Modulation: A Discrete Zak Transform Approach

In orthogonal time frequency space (OTFS) modulation, information-carrying symbols reside in the delay-Doppler (DD) domain. By operating in the DD domain, an appealing property for communication arises: time-frequency (TF) dispersive channels encountered in high mobility environments become time-invariant. The time-invariance of the channel in the DD domain enables efficient equalizers for time-frequency dispersive channels. In this paper, we propose an OTFS system based on the discrete Zak transform. The presented formulation not only allows an efficient implementation of OTFS but also simplifies the derivation and analysis of the input-output relation of TF dispersive channel in the DD domain.

eess.SP↗
arXiv2021

Temporal Energy Analysis of Symbol Sequences for Fiber Nonlinear Interference Modelling via Energy Dispersion Index

The stationary statistical properties of independent, identically distributed (i.i.d.) input symbols provide insights on the induced nonlinear interference (NLI) during fiber transmission. For example, kurtosis is known to predict the modulation format-dependent NLI. These statistical properties can be used in the design of probabilistic amplitude shaping (PAS), which is a popular scheme that relies on an amplitude shaper for increasing spectral efficiencies of fiber-optic systems. One property of certain shapers used in PAS -- including constant-composition distribution matchers -- that is often overlooked is that a time-dependency between amplitudes is introduced. This dependency results in symbols that are non-i.i.d., which have time-varying statistical properties. Somewhat surprisingly, the effective signal-to-noise ratio (SNR) in PAS has been shown to increase when the shaping blocklength decreases. This blocklength dependency of SNR has been attributed to time-varying statistical properties of the symbol sequences, in particular, to variation of the symbol energies. In this paper, we investigate the temporal energy behavior of symbol sequences, and introduce a new metric called energy dispersion index (EDI). EDI captures the time-varying statistical properties of symbol energies. Numerical results show strong correlations between EDI and effective SNR, with absolute correlation coefficients above 99% for different transmission distances.

cs.IT↗
arXiv2020

Achievable Information Rates for Probabilistic Amplitude Shaping: An Alternative Approach via Random Sign-Coding Arguments

Probabilistic amplitude shaping (PAS) is a coded modulation strategy in which constellation shaping and channel coding are combined. PAS has attracted considerable attention in both wireless and optical communications. Achievable information rates (AIRs) of PAS have been investigated in the literature using Gallager's error exponent approach. In particular, it has been shown that PAS achieves the capacity of the additive white Gaussian noise channel (Böcherer, 2018). In this work, we revisit the capacity-achieving property of PAS and derive AIRs using weak typicality. Our objective is to provide alternative proofs based on random sign-coding arguments that are as constructive as possible. Accordingly, in our proofs, only some signs of the channel inputs are drawn from a random code, while the remaining signs and amplitudes are produced constructively. We consider both symbol-metric and bit-metric decoding.

cs.IT↗
arXiv2019

Partial Enumerative Sphere Shaping

The dependency between the Gaussianity of the input distribution for the additive white Gaussian noise (AWGN) channel and the gap-to-capacity is discussed. We show that a set of particular approximations to the Maxwell-Boltzmann (MB) distribution virtually closes most of the shaping gap. We relate these symbol-level distributions to bit-level distributions, and demonstrate that they correspond to keeping some of the amplitude bit-levels uniform and independent of the others. Then we propose partial enumerative sphere shaping (P-ESS) to realize such distributions in the probabilistic amplitude shaping (PAS) framework. Simulations over the AWGN channel exhibit that shaping 2 amplitude bits of 16-ASK have almost the same performance as shaping 3 bits, which is 1.3 dB more power-efficient than uniform signaling at a rate of 3 bit/symbol. In this way, required storage and computational complexity of shaping are reduced by factors of 6 and 3, respectively.

eess.SP↗
arXiv2019

Enumerative Sphere Shaping for Wireless Communications with Short Packets

Probabilistic amplitude shaping (PAS) combines an outer shaping layer with an inner, systematic forward error correction (FEC) layer to close the shaping gap. Proposed for PAS, constant composition distribution matching (CCDM) produces amplitude sequences with a fixed empirical distribution. We show that CCDM suffers from high rate losses for small block lengths, and we propose to use Enumerative Sphere Shaping (ESS) instead. ESS minimizes the rate loss at any block length. Furthermore, we discuss the computational complexity of ESS and demonstrate that it is significantly smaller than shell mapping (SM), which is another method to perform sphere shaping. We then study the choice of design parameters for PAS. Following Wachsmann et al., we show that for a given constellation and target rate, there is an optimum balance between the FEC code rate and the entropy of the Maxwell-Boltzmann distribution that minimizes the gap-to-capacity. Moreover, we demonstrate how to utilize the non-systematic convolutional code from IEEE 802.11 in PAS. Simulations over the additive white Gaussian noise (AWGN) and frequency-selective channels exhibit that ESS is up to 1.6 and 0.7 dB more energy-efficient than uniform signaling at block lengths as small as 96 symbols, respectively, with convolutional and low-density parity-check (LDPC) codes.

eess.SP↗
arXiv2019

Introducing Enumerative Sphere Shaping for Optical Communication Systems with Short Blocklengths

Probabilistic shaping based on constant composition distribution matching (CCDM) has received considerable attention as a way to increase the capacity of fiber optical communication systems. CCDM suffers from significant rate loss at short blocklengths and requires long blocklengths to achieve high shaping gain, which makes its implementation very challenging. In this paper, we propose to use enumerative sphere shaping (ESS) and investigate its performance for the nonlinear fiber optical channel. ESS has lower rate loss than CCDM at the same shaping rate, which makes it a suitable candidate to be implemented in real-time high-speed optical systems. In this paper, we first show that finite blocklength ESS and CCDM exhibit higher effective signal-to-noise ratio than their infinite blocklength counterparts. These results show that for the nonlinear fiber optical channel, large blocklengths should be avoided. We then show that for a 400 Gb/s dual-polarization 64-QAM WDM transmission system, ESS with short blocklengths outperforms both uniform signaling and CCDM. Gains in terms of both bit-metric decoding rate and bit-error rate are presented. ESS with a blocklength of 200 is shown to provide an extension reach of about 200 km in comparison with CCDM with the same blocklength. The obtained reach increase of ESS with a blocklength of 200 over uniform signaling is approximately 450 km (approximately 19%)

cs.IT↗
arXiv2019

Probabilistic Shaping for Finite Blocklengths: Distribution Matching and Sphere Shaping

In this paper, we provide for the first time a systematic comparison of distribution matching (DM) and sphere shaping (SpSh) algorithms for short blocklength probabilistic amplitude shaping. For asymptotically large blocklengths, constant composition distribution matching (CCDM) is known to generate the target capacity-achieving distribution. As the blocklength decreases, however, the resulting rate loss diminishes the efficiency of CCDM. We claim that for such short blocklengths and over the additive white Gaussian channel (AWGN), the objective of shaping should be reformulated as obtaining the most energy-efficient signal space for a given rate (rather than matching distributions). In light of this interpretation, multiset-partition DM (MPDM), enumerative sphere shaping (ESS) and shell mapping (SM), are reviewed as energy-efficient shaping techniques. Numerical results show that MPDM and SpSh have smaller rate losses than CCDM. SpSh--whose sole objective is to maximize the energy efficiency--is shown to have the minimum rate loss amongst all. We provide simulation results of the end-to-end decoding performance showing that up to 1 dB improvement in power efficiency over uniform signaling can be obtained with MPDM and SpSh at blocklengths around 200. Finally, we present a discussion on the complexity of these algorithms from the perspective of latency, storage and computations.

eess.SP↗
arXiv2017

Achievable Information Rates for Fiber Optics: Applications and Computations

In this paper, achievable information rates (AIR) for fiber optical communications are discussed. It is shown that AIRs such as the mutual information and generalized mutual information are good design metrics for coded optical systems. The theoretical predictions of AIRs are compared to the performance of modern codes including low-parity density check (LDPC) and polar codes. Two different computation methods for these AIRs are also discussed: Monte-Carlo integration and Gauss-Hermite quadrature. Closed-form ready-to-use approximations for such computations are provided for arbitrary constellations and the multidimensional AWGN channel. The computation of AIRs in optical experiments and simulations is also discussed.

eess.SP↗
arXiv2017

A Robust SRAM-PUF Key Generation Scheme Based on Polar Codes

Physical unclonable functions (PUFs) are relatively new security primitives used for device authentication and device-specific secret key generation. In this paper we focus on SRAM-PUFs. The SRAM-PUFs enjoy uniqueness and randomness properties stemming from the intrinsic randomness of SRAM memory cells, which is a result of manufacturing variations. This randomness can be translated into the cryptographic keys thus avoiding the need to store and manage the device cryptographic keys. Therefore these properties, combined with the fact that SRAM memory can be often found in today's IoT devices, make SRAM-PUFs a promising candidate for securing and authentication of the resource-constrained IoT devices. PUF observations are always effected by noise and environmental changes. Therefore secret-generation schemes with helper data are used to guarantee reliable regeneration of the PUF-based secret keys. Error correction codes (ECCs) are an essential part of these schemes. In this work, we propose a practical error correction construction for PUF-based secret generation that are based on polar codes. The resulting scheme can generate $128$-bit keys using $1024$ SRAM-PUF bits and $896$ helper data bits and achieve a failure probability of $10^{-9}$ or lower for a practical SRAM-PUFs setting with bit error probability of $15\%$. The method is based on successive cancellation combined with list decoding and hash-based checking that makes use of the hash that is already available at the decoder. In addition, an adaptive list decoder for polar codes is investigated. This decoder increases the list size only if needed.

cs.IT↗
arXiv2014

Information Theoretical Analysis of Identification based on Active Content Fingerprinting

Content fingerprinting and digital watermarking are techniques that are used for content protection and distribution monitoring. Over the past few years, both techniques have been well studied and their shortcomings understood. Recently, a new content fingerprinting scheme called {\em active content fingerprinting} was introduced to overcome these shortcomings. Active content fingerprinting aims to modify a content to extract robuster fingerprints than the conventional content fingerprinting. Moreover, contrary to digital watermarking, active content fingerprinting does not embed any message independent of contents thus does not face host interference. The main goal of this paper is to analyze fundamental limits of active content fingerprinting in an information theoretical framework.

cs.IT↗