SearcharxivSearch

arXiv subjects

Benjamin A. Ash

Publications and source records attributed to Benjamin A. Ash.

3 recordsLinked to original sources

Ultra-low-light computer vision using trained photon correlations

Illumination using correlated photon sources has been established as an approach to allowing high-fidelity images to be reconstructed from noisy camera frames by taking advantage of the knowledge that signal photons are spatially correlated whereas detector clicks due to noise are uncorrelated. However, in computer-vision tasks, the goal is often not ultimately to reconstruct an image, but to make inferences about a scene -- such as what object is present. Here we show how correlated-photon illumination can be used to gain an advantage in a hybrid optical-electronic computer-vision pipeline for object recognition. We demonstrate correlation-aware training (CAT): end-to-end optimization of a trainable correlated-photon illumination source and a Transformer backend in a way that the Transformer can learn to benefit from the correlations, using a small number (<= 100) of shots. We show a classification accuracy enhancement of up to 15 percentage points over conventional, uncorrelated-illumination-based computer vision in ultra-low-light and noisy imaging conditions, as well as an improvement over using untrained correlated-photon illumination. Our work illustrates how specializing to a computer-vision task -- object recognition -- and training the pattern of photon correlations in conjunction with a digital backend allows us to push the limits of accuracy in highly photon-budget-constrained scenarios beyond existing methods focused on image reconstruction.

cs.CV

Programmable on-chip nonlinear photonics

Nonlinear photonics uses coherent interactions between optical waves to engineer functionality that is not possible with purely linear optics. Traditionally, the function of a nonlinear-optical device is determined during design and fixed during fabrication. In this paper, we present a photonic device with highly programmable nonlinear functionality: an optical slab waveguide with an arbitrarily reconfigurable two-dimensional distribution of $\chi^{(2)}$ nonlinearity. The nonlinearity is realized using electric-field-induced $\chi^{(2)}$ in a $\chi^{(3)}$ material. The programmability is engineered by massively parallel control of the electric-field distribution within the device using a photoconductive layer and optical programming with a spatial light pattern. To showcase the versatility of our device, we demonstrated spectral, spatial, and spatio-spectral engineering of second-harmonic generation by tailoring arbitrary quasi-phase-matching (QPM) grating structures in two dimensions. Second-harmonic light was generated with programmable spectra, enabled by real-time in situ inverse design of QPM gratings. Flexible spatial control was also achieved, including the generation of complex waveforms such as Airy beams and the simultaneous engineering of spectral and spatial features. This allowed us to create distinct spatial light profiles across multiple wavelengths. The programmability also allowed us to demonstrate in situ, real-time compensation of fluctuations in pump laser wavelength. Our work shows that we can transcend the conventional one-device--one-function paradigm, expanding the potential applications of nonlinear optics in situations where fast device reconfigurability is not merely practically convenient but essential -- such as in programmable optical quantum gates and quantum light sources, all-optical signal processing, optical computation, and structured light for sensing.

physics.optics

Arbitrary control over multimode wave propagation for machine learning

Controlled multimode wave propagation can enable more space-efficient photonic processors than architectures based on discrete components connected by single-mode waveguides. Instead of defining discrete elements, one can sculpt the continuous substrate of a photonic processor to perform computations through multimode interference in two dimensions. Here we designed and demonstrated a device with a refractive index that can be rapidly reprogrammed across space, allowing arbitrary control of wave propagation. The device, a two-dimensional programmable waveguide, uses parallel electro-optic modulation of the refractive index of a slab waveguide with about $10^4$ programmable spatial degrees of freedom. We implemented neural network inference on benchmark tasks with up to $49$-dimensional vectors in a single pass, without digital pre-processing or post-processing. Theoretical and numerical analyses further indicated that two-dimensional programmable waveguides may offer not only a constant-factor reduction in device area but also a scaling benefit, with the area required growing as $N^{1.5}$ rather than $N^2$.

physics.optics