Searcharxiv⌕ Search

arXiv subjects

Ori Katz

Publications and source records attributed to Ori Katz.

At least 55 records · Page 3Linked to original sources

Super-resolution photoacoustic and ultrasound imaging with sparse arrays

It has previously been demonstrated that model-based reconstruction methods relying on a priori knowledge of the imaging point spread function (PSF) coupled to sparsity priors on the object to image can provide super-resolution in photoacoustic (PA) or in ultrasound (US) imaging. Here, we experimentally show that such reconstruction also leads to super-resolution in both PA and US imaging with arrays having much less elements than used conventionally (sparse arrays). As a proof of concept, we obtained super-resolution PA and US cross-sectional images of microfluidic channels with only 8 elements of a 128-elements linear array using a reconstruction approach based on a linear propagation forward model and assuming sparsity of the imaged structure. Although the microchannels appear indistinguishable in the conventional delay-and-sum images obtained with all the 128 transducer elements, the applied sparsity-constrained model-based reconstruction provides super-resolution with down to only 8 elements. We also report simulation results showing that the minimal number of transducer elements required to obtain a correct reconstruction is fundamentally limited by the signal-to-noise ratio. The proposed method can be straigthforwardly applied to any transducer geometry, including 2D sparse arrays for 3D super-resolution PA and US imaging.

eess.IV↗

CB2CF: A Neural Multiview Content-to-Collaborative Filtering Model for Completely Cold Item Recommendations

In Recommender Systems research, algorithms are often characterized as either Collaborative Filtering (CF) or Content Based (CB). CF algorithms are trained using a dataset of user preferences while CB algorithms are typically based on item profiles. These approaches harness different data sources and therefore the resulting recommended items are generally very different. This paper presents the CB2CF, a deep neural multiview model that serves as a bridge from items content into their CF representations. CB2CF is a real-world algorithm designed for Microsoft Store services that handle around a billion users worldwide. CB2CF is demonstrated on movies and apps recommendations, where it is shown to outperform an alternative CB model on completely cold items.

cs.IR↗

Photoacoustic imaging beyond the acoustic diffraction-limit with dynamic speckle illumination and sparse joint support recovery

In deep tissue photoacoustic imaging the spatial resolution is inherently limited by the acoustic wavelength. Recently, it was demonstrated that it is possible to surpass the acoustic diffraction limit by analyzing fluctuations in a set of photoacoustic images obtained under unknown speckle illumination patterns. Here, we purpose an approach to boost reconstruction fidelity and resolution, while reducing the number of acquired images by utilizing a compressed sensing computational reconstruction framework. The approach takes into account prior knowledge of the system response and sparsity of the target structure. We provide proof of principle experiments of the approach and demonstrate that improved performance is obtained when both speckle fluctuations and object priors are used. We numerically study the expected performance as a function of the measurements signal to noise ratio and sample spatial-sparsity. The presented reconstruction framework can be applied to analyze existing photoacoustic experimental datasets containing dynamic fluctuations.

physics.optics↗

Acousto-optic tomography beyond the acoustic diffraction-limit using speckle decorrelation

Acousto-optic tomography (AOT) enables optical-contrast imaging deep inside scattering samples via localized ultrasound modulation of scattered light. However, the resolution of AOT is inherently limited by the ultrasound focus size, prohibiting microscopic investigations. In the last few years, advances in the field of digital wavefront-shaping have allowed the development of novel approaches for overcoming the acoustic resolution limit of AOT. However, these novel approaches require the execution of thousands of wavefront measurements within the sample speckle decorrelation time, limiting their application to static samples. Here, we show that it is possible to surpass the acoustic resolution limit with a conventional AOT system by exploiting the natural dynamics of speckle decorrelations rather than trying to overcome them. We achieve this by adapting the principles of super-resolution optical fluctuations imaging (SOFI), originally developed for imaging blinking fluorophores, to AOT. We show that naturally fluctuating optical speckle grains can serve as the analogues of blinking fluorophores, enabling super-resolution by statistical analysis of fluctuating acousto-optic signals.

physics.optics↗

Diffusion-based nonlinear filtering for multimodal data fusion with application to sleep stage assessment

The problem of information fusion from multiple data-sets acquired by multimodal sensors has drawn significant research attention over the years. In this paper, we focus on a particular problem setting consisting of a physical phenomenon or a system of interest observed by multiple sensors. We assume that all sensors measure some aspects of the system of interest with additional sensor-specific and irrelevant components. Our goal is to recover the variables relevant to the observed system and to filter out the nuisance effects of the sensor-specific variables. We propose an approach based on manifold learning, which is particularly suitable for problems with multiple modalities, since it aims to capture the intrinsic structure of the data and relies on minimal prior model knowledge. Specifically, we propose a nonlinear filtering scheme, which extracts the hidden sources of variability captured by two or more sensors, that are independent of the sensor-specific components. In addition to presenting a theoretical analysis, we demonstrate our technique on real measured data for the purpose of sleep stage assessment based on multiple, multimodal sensor measurements. We show that without prior knowledge on the different modalities and on the measured system, our method gives rise to a data-driven representation that is well correlated with the underlying sleep process and is robust to noise and sensor-specific effects.

stat.ML↗

Passive optical time-of-flight for Non line-of-sight localization

Optical imaging through diffusive, visually-opaque barriers, and around corners is an important challenge in many fields, ranging from defense to medical applications. Recently, novel techniques that combine time-of-flight (TOF) measurements with computational reconstruction, have allowed breakthrough imaging and tracking of objects hidden from view. These light detection and ranging (LiDAR)-based approaches, however, require active short-pulsed illumination and ultrafast time-resolved detection. Here, bringing notions from passive RADAR and passive geophysical mapping approaches, we present an optical TOF technique that allows to passively localize light sources and reflective objects through diffusive barriers and around corners. Our approach retrieves TOF information from temporal cross-correlations of scattered light, providing temporal resolution that surpasses the state-of-the-art ultrafast detectors by three orders of magnitude. We demonstrate passive localization of multiple white-light sources and reflective objects hidden from view, using a simple setup, with interesting potential for covert imaging.

physics.optics↗

Compressive three-dimensional super-resolution microscopy with speckle-saturated fluorescence excitation

Nonlinear structured illumination microscopy (nSIM) is an effective approach for super-resolution wide-field fluorescence microscopy with a theoretically unlimited resolution. In nSIM, carefully designed, highly-contrasted illumination patterns are combined with the saturation of an optical transition to enable sub-diffraction imaging. While the technique proved useful for two-dimensional imaging, extending it to three-dimensions (3D) is challenging due to the fading/fatigue of organic fluorophores under intense cycling conditions. Here, we present a compressed sensing approach that allows for the first time 3D sub-diffraction nSIM of cultured cells by saturating fluorescence excitation. Exploiting the natural orthogonality of transverse speckle illumination planes, 3D probing of the sample is achieved by a single two-dimensional scan. Fluorescence contrast under saturated excitation is ensured by the inherent high density of intensity minima associated with optical vortices in polarized speckle patterns. Compressed speckle microscopy is thus a simple approach that enables 3D super-resolved nSIM imaging with potentially considerably reduced acquisition time and photobleaching.les fast 3D super-resolved imaging with considerably minimized photo-bleaching.

physics.optics↗

Depth-Resolved Speckle-Correlations Imaging through Scattering Layers

Recently, novel imaging techniques based on the 'memory-effect' speckle-correlations have enabled diffraction-limited imaging through scattering layers and around corners. These techniques, however, are currently limited to imaging only small planar objects that are contained within the angular and axial range of the memory effect. In addition, they do not provide depth information or depth sectioning capability. Here, we extend speckle-correlation imaging to include high-resolution depth-sectioning capability in reflection-mode, by combining it with coherence-gating via low coherence holography. We demonstrate depth measurements of hidden targets through a scattering layer, and speckle-correlation imaging using coherence-gated scattered light.

physics.optics↗

Non-invasive Focusing Through Scattering Layers Using Speckle-Correlations

Angular speckle correlations known as the 'memory-effect' have recently been exploited for non-invasive imaging through scattering layers. Here, we show how the imaging information obtained from speckle correlations can be used as a noninvasive feedback mechanism for wavefront shaping. We utilize this feedback to demonstrate guide-star free noninvasive focusing of coherent light through highly scattering layers.

physics.optics↗

Two-Photon Lensless Micro-endoscopy with in-situ Wavefront Correction

Multi-core fiber-bundle endoscopes provide a minimally-invasive solution for deep tissue imaging and opto-genetic stimulation, at depths beyond the reach of conventional microscopes. Recently, wavefront-shaping has enabled lensless bundle-based micro-endoscopy by correcting the wavefront distortions induced by core-to-core inhomogeneities. However, current wavefront-shaping solutions require access to the fiber distal end for determining the bend-sensitive wavefront-correction. Here, we show that it is possible to determine the wavefront correction in-situ, without any distal access. Exploiting the nonlinearity of two-photon excited fluorescence, we adaptively determine the wavefront correction in-situ, using only proximal detection of epi-detected fluorescence. We experimentally demonstrate diffraction-limited, three-dimensional, two-photon lensless microendoscopy with commercially-available ordered- and disordered multi-core fiber bundles.

physics.optics↗

Controlling light in complex media beyond the acoustic diffraction-limit using the acousto-optic transmission matrix

Studying the internal structure of complex samples with light is an important task, but a difficult challenge due to light scattering. While the complex optical distortions induced by multiple scattering can be effectively undone with the knowledge of the medium's scattering-matrix, this matrix is generally unknown, and cannot be measured with high resolution without the presence of fluorescent or absorbing probes at all points of interest. To overcome these limitations, we introduce here the concept of the acousto-optic transmission matrix (AOTM). Taking advantage of the near scattering-free propagation of ultrasound in complex samples, we noninvasively measure an ultrasonically-encoded, spatially-resolved, optical scattering-matrix. We demonstrate that a singular value decomposition analysis of the AOTM, acquired using a single or multiple ultrasonic beams, allows controlled optical focusing beyond the acoustic diffraction limit in scattering media. Our approach provides a generalized framework for analyzing acousto-optical experiments, and for noninvasive, high-resolution study of complex media.

physics.optics↗

Super-resolution photoacoustic imaging via flow induced absorption fluctuations

In deep tissue photoacoustic imaging the spatial resolution is inherently limited by the acoustic wavelength. We present an approach for surpassing the acoustic diffraction limit by exploiting temporal fluctuations in the sample absorption distribution, such as those induced by flowing particles. In addition to enhanced resolution, our approach inherently provides background reduction, and can be implemented with any conventional photoacoustic imaging system. The considerable resolution increase is made possible by adapting notions from super-resolution optical fluctuations imaging (SOFI) developed for blinking fluorescent molecules, to flowing acoustic emitters. By generalizing SOFI mathematical analysis to complex valued signals, we demonstrate super-resolved photoacoustic images that are free from oscillations caused by band-limited detection. The presented technique holds potential for contrast-agent free micro-vessels imaging, as red blood cells provide a strong endogenous source of naturally fluctuating absorption.

physics.optics↗

Widefield lensless endoscopy with a multicore fiber

We demonstrate pixelation-free real-time widefield endoscopic imaging through an aperiodic multicore fiber (MCF) without any distal opto-mechanical elements or proximal scanners. Exploiting the memory effect in MCFs the images in our system are directly obtained without any post-processing using a static wavefront correction obtained from a single calibration procedure. Our approach allows for video-rate 3D widefield imaging of incoherently illuminated objects with imaging speed not limited by the wavefront shaping device refresh rate.

physics.optics↗

Spatiotemporal coherent control of light through a multiply scattering medium with the Multi-Spectral Transmission Matrix

We report broadband characterization of the propagation of light through a multiply scattering medium by means of its Multi-Spectral Transmission Matrix. Using a single spatial light modulator, our approach enables the full control of both spatial and spectral properties of an ultrashort pulse transmitted through the medium. We demonstrate spatiotemporal focusing of the pulse at any arbitrary position and time with any desired spectral shape. Our approach opens new perspectives for fundamental studies of light-matter interaction in disordered media, and has potential applications in sensing, coherent control and imaging.

physics.optics↗

Widefield lensless endoscopy via speckle-correlations

Flexible fiber-optic endoscopes provide a minimally-invasive solution for imaging at depths beyond the reach of conventional microscopes. Current endoscopes require focusing and/or scanning mechanisms at the distal end, which limit miniaturization and frame-rate, and induce aberrations. Alternative lensless solutions are based on adaptive wavefront-correction, but are extremely sensitive to fiber bending. Here, we demonstrate a novel endoscopic approach, which enables single-shot imaging at a variable working distance through a conventional fiber bundle, without the use of any distal optics. Our approach computationally retrieves the object image from a single speckle pattern transmitted through the bundle, exploiting phase information preserved through inherent angular speckle correlations. Unlike conventional fiber-bundle endoscopes, the resulting image is unpixelated, the resolution is diffraction-limited, objects can be imaged at variable working distance, and the technique is completely insensitive to fiber bending. Since no optical elements are required, miniaturization is limited only by the bundle diameter.

physics.optics↗

Super-resolution photoacoustic fluctuation imaging with multiple speckle illumination

In deep tissue photoacoustic imaging, the spatial resolution is inherently limited by acoustic diffraction. Moreover, as the ultrasound attenuation increases with frequency, resolution is often traded-off for penetration depth. Here we report on super-resolution photoacoustic imaging by use of multiple speckle illumination. Specifically, we show that the analysis of second-order fluctuations of the photoacoustic images combined with image deconvolution enables resolving optically absorbing structures beyond the acoustic diffraction limit. A resolution increase of almost a factor 2 is demonstrated experimentally. Our method introduces a new framework that could potentially lead to deep tissue photoacoustic imaging with sub-acoustic resolution.

physics.optics↗

Focusing and Scanning through Flexible Multimode Fibers without Access to the Distal End

Multimode fibers (MMFs) are attractive ultra-thin replacements for state-of-the-art endoscopes, but the phase randomization in propagation through MMFs poses a major hurdle for imaging and focusing of light. Recently, this challenge has been addressed by pre-measuring the compensation for the fiber's complex input-output modes relations. Unfortunately, the sensitivity of this approach to fiber bending and temperature variations renders it inappropriate for many applications. Here, we demonstrate a truly endoscopic robust method for controlled in-situ focusing and scanning through a flexible uncharacterized MMF, whereby all the instrumentation is situated at the proximal end. We show that in graded-index (GRIN) fibers, light patterns at the proximal end allow retrieving information about the distal light distribution. We utilize these properties and two-photon fluorescence for robust controlled focusing through bended GRIN fibers. Our results carry potential for lensless two-photon micro-endoscopy.

physics.optics↗

Deterministic control of broadband light through a multiply scattering medium via the multispectral transmission matrix

We present a method to measure the spectrally-resolved transmission matrix of a multiply scattering medium, thus allowing for the deterministic spatiospectral control of a broadband light source by means of wavefront shaping. As a demonstration, we show how the medium can be used to selectively focus one or many spectral components of a femtosecond pulse, and how it can be turned into a controllable dispersive optical element to spatially separate different spectral components to arbitrary positions.

physics.optics↗