SearcharxivSearch

arXiv subjects

Anna Pastuszczak

Publications and source records attributed to Anna Pastuszczak.

11 recordsLinked to original sources

High-resolution single-pixel imaging in real time with iterative or deep learning-based reconstruction enhancement

We introduce a compressive single-pixel imaging (SPI) framework for high-resolution image capture in fractions of a second. This framework combines a dedicated sampling strategy with a tailored reconstruction method to enable high-quality imaging of spatially sparse scenes at the native 1024x768 resolution of a digital micromirror device (DMD). The reconstruction process consists of two phases: first, the measured data is processed using the generalized inverse of the measurement matrix for quick image recovery. Then, the spatial sparsity of the scene is leveraged to enhance reconstruction in dense areas, using either an iterative method or a neural network-based approach. With a compression ratio of 0.41% and an image acquisition rate of 6.8 Hz at 22 kHz DMD operation, this framework supports real-time, high-resolution dynamic imaging with the reconstruction that matches the acquisition rate on a mid-tier desktop GPU.

eess.IV

Single pixel imaging at high pixel resolutions

The usually reported pixel resolution of single pixel imaging (SPI) varies between $32 \times 32$ and $256 \times 256$ pixels falling far below imaging standards with classical methods. Low resolution results from the trade-off between the acceptable compression ratio, the limited DMD modulation frequency, and reasonable reconstruction time, and has not improved significantly during the decade of intensive research on SPI. In this paper we show that image measurement at the full resolution of the DMD, which lasts only a fraction of a second, is possible for sparse images or in a situation when the field of view is limited but is a priori unknown. We propose the sampling and reconstruction strategies that enable us to reconstruct sparse images at the resolution of $1024 \times 768$ within the time of $0.3~$s. Non-sparse images are reconstructed with less details. The compression ratio is on the order of $0.4 \%$ which corresponds to an acquisition frequency of $7~$Hz. Sampling is differential, binary, and non-adaptive, and includes information on multiple partitioning of the image which later allows us to determine the actual field of view. Reconstruction is based on the differential Fourier domain regularized inversion (D-FDRI). The proposed SPI framework is an alternative to both adaptive SPI, which is challenging to implement in real time, and to classical compressive sensing image recovery methods, which are very slow at high resolutions.

physics.optics

Differential real-time single-pixel imaging with Fourier domain regularization -- applications to VIS-IR imaging and polarization imaging

The speed and quality of single-pixel imaging (SPI) are fundamentally limited by image modulation frequency and by the levels of optical noise and compression noise. In an approach to come close to these limits, we introduce a SPI technique, which is inherently differential, and comprises a novel way of measuring the zeroth spatial frequency of images and makes use of varied thresholding of sampling patterns. With the proposed sampling, the entropy of the detection signal is increased in comparison to standard SPI protocols. Image reconstruction is obtained with a single matrix-vector product so the cost of the reconstruction method scales proportionally with the number of measured samples. A differential operator is included in the reconstruction and following the method is based on finding the generalized inversion of the modified measurement matrix with regularization in the Fourier domain. We demonstrate $256 \times 256$ SPI at up to $17~$Hz at visible and near-infrared wavelength ranges using two polarization or spectral channels. A low bit-resolution data acquisition device with alternating-current-coupling can be used in the measurement indicating that the proposed method combines improved noise robustness with a differential removal of the direct current component of the signal.

physics.optics

Single-pixel imaging with sampling distributed over simplex vertices

We propose a method of reduction of experimental noise in single-pixel imaging by expressing the subsets of sampling patterns as linear combinations of vertices of a multidimensional regular simplex. This method may be also directly extended to complementary sampling. The modified sampling consists only of non-negative patterns. The measurement becomes theoretically independent of the ambient illumination, and in practice becomes more robust to the varying conditions of the experiment. We show how the optimal dimensionality of the simplex depends on the level of measurement noise. We present experimental results of single-pixel imaging using binarized sampling and a real-time reconstruction with the Fourier domain regularized inversion method.

eess.IV

Real-time single-pixel video imaging with Fourier domain regularization

We present a closed-form image reconstruction method for single pixel imaging based on the generalized inverse of the measurement matrix. Its numerical cost scales linearly with the number of measured samples. Regularization is obtained by minimizing the norms of the convolution between the reconstructed image and a set of spatial filters, and the final reconstruction formula can be expressed in terms of matrix pseudoinverse. At high compression this approach is an interesting alternative to the methods of compressive sensing based on l1-norm optimization, which are too slow for real-time applications. For instance, we demonstrate experimental single-pixel detection with real-time reconstruction obtained in parallel with the measurement at the frame rate of $11$ Hz for highly compressive measurements with the resolution of $256\times 256$. For this purpose, we preselect the sampling functions to match the average spectrum obtained with an image database. The sampling functions are selected from the Walsh-Hadamard basis, from the discrete cosine basis, or from a subset of Morlet wavelets convolved with white noise. We show that by incorporating the quadratic criterion into the closed-form reconstruction formula, we are able to use binary rather than continuous sampling reaching similar reconstruction quality as is obtained by minimizing the total variation. This makes it possible to use cosine or Morlet-based sampling with digital micromirror devices without advanced binarization methods.

eess.IV

Single-pixel imaging with Morlet wavelet correlated random patterns

Single-pixel imaging is an indirect imaging technique which utilizes simplified optical hardware and advanced computational methods. It offers novel solutions for hyper-spectral imaging, polarimetric imaging, three-dimensional imaging, holographic imaging, optical encryption and imaging through scattering media. The main limitations for its use come from relatively high measurement and reconstruction times. In this paper we propose to reduce the required signal acquisition time by using a novel sampling scheme based on a random selection of Morlet wavelets convolved with white noise. While such functions exhibit random properties, they are locally determined by Morlet wavelet parameters. The proposed method is equivalent to random sampling of the properly selected part of the feature space, which maps the measured images accurately both in the spatial and spatial frequency domains. We compare both numerically and experimentally the image quality obtained with our sampling protocol against widely-used sampling with Walsh-Hadamard or noiselet functions. The results show considerable improvement over the former methods, enabling single-pixel imaging at low compression rates on the order of a few percent.

eess.IV

Compressive phase-only filtering at extreme compression rates

We introduce an efficient method for the reconstruction of the correlation between a compressively measured image and a phase-only filter. The proposed method is based on two properties of phase-only filtering: such filtering is a unitary circulant transform, and the correlation plane it produces is usually sparse. Thanks to these properties, phase-only filters are perfectly compatible with the framework of compressive sensing. Moreover, the lasso-based recovery algorithm is very fast when phase-only filtering is used as the compression matrix. The proposed method can be seen as a generalisation of the correlation-based pattern recognition technique, which is hereby applied directly to non-adaptively acquired compressed data. At the time of measurement, any prior knowledge of the target object for which the data will be scanned is not required. We show that images measured at extremely high compression rates may still contain sufficient information for target classification and localization, even if the compression rate is high enough, that visual recognition of the target in the reconstructed image is no longer possible. The method has been applied by us to highly undersampled measurements obtained from a single-pixel camera, with sampling based on randomly chosen Walsh-Hadamard patterns.

cs.CV

Efficient adaptation of complex-valued noiselet sensing matrices for compressed single-pixel imaging

Minimal mutual coherence of discrete noiselets and Haar wavelets makes this pair of bases an essential choice for the measurement and compression matrices in compressed-sensing-based single-pixel detectors. In this paper we propose an efficient way of using complex-valued and non-binary noiselet functions for object sampling in single-pixel cameras with binary spatial light modulators and incoherent illumination. The proposed method allows to determine m complex noiselet coefficients from m+1 binary sampling measurements. Further, we introduce a modification to the complex fast noiselet transform, which enables computationally-efficient real-time generation of the binary noiselet-based patterns using efficient integer calculations on bundled patterns. The proposed method is verified experimentally with a single-pixel camera system using a binary spatial light modulator.

cs.CV

Engineering the point spread function of layered metamaterials

Layered metal-dielectric metamaterials have filtering properties both in the frequency domain and in the spatial frequency domain. Engineering their spatial filtering response is a way of designing structures with specific diffraction properties for such applications as sub-diffraction imaging, supercollimation, or optical signal processing at the nanoscale. In this paper we review the recent progress in this field. We also present a numerical optimization framework for layered metamaterials, based on the use of evolutionary algorithms. A measure of similarity obtained using Hoelder's inequality is adapted to construct the overall criterion function. We analyze the influence of surface roughness on the quality of imaging.

physics.optics

Multilayer metamaterial absorbers inspired by perfectly matched layers

We derive periodic multilayer absorbers with effective uniaxial properties similar to perfectly matched layers (PML). This approximate representation of PML is based on the effective medium theory and we call it an effective medium PML (EM-PML). We compare the spatial reflection spectrum of the layered absorbers to that of a PML material and demonstrate that after neglecting gain and magnetic properties, the absorber remains functional. This opens a route to create electromagnetic absorbers for real and not only numerical applications and as an example we introduce a layered absorber for the wavelength of $8$~$μ$m made of SiO$_2$ and NaCl. We also show that similar cylindrical core-shell nanostructures derived from flat multilayers also exhibit very good absorptive and reflective properties despite the different geometry.

physics.optics

Optimised low-loss multilayers for imaging with sub-wavelength resolution in the visible wavelength range

We optimise the effective skin-depth and resolution of Ag-TiO2, Ag-SrTiO3, and Ag-GaP multilayers for imaging with sub-wavelength resolution. In terms of transmission and resolution the optimised multilayers outperform simple designs based on combined use of effective medium theory, impedance matching and Fabry-Perot resonances. For instance, an optimised Ag-GaP multilayer consisting of only 17 layers, operating at the wavelength of 490 nm and having a total thickness equal to one wavelength, combines 78% intensity transmission with a resolution of 60 nm. It is also shown that use of the effective medium theory leads to sub-optimal multilayer designs with respect to the trade-off between the skin depth and resolution already when the period of the structure is on the order of 40 nm or larger.

physics.optics