SearcharxivSearch

arXiv subjects

Guillaume Noetinger

Publications and source records attributed to Guillaume Noetinger.

5 recordsLinked to original sources

Multi-channel Optical Vision Model

Spatial multiplexing is one of the natural strengths of optics, yet in optical neural networks, it is often used mainly as parallel throughput. Here, we show that spatial multiplexing in an optical neural network can be used not only to process multiple inputs in parallel, but also to define a trainable representational coordinate of the model. In three implemented scenarios, parallel-input processing, class-code readout and channel-mixed feature interaction, spatial channels act as independent learners, structured code dimensions, and interacting feature groups. The programmable free-space optical processor is trained through an online physical-forward/surrogate-backward scheme, where measured optical outputs define the forward pass while a differentiable surrogate estimates gradients and is continually fine-tuned during training from newly acquired optical data. We demonstrate these channel roles in image classification and regression tasks using multi-layer architectures with more than one million trainable optical phase parameters. We further implement a hybrid optical-electronic vision-language model, in which the optical neural network provides visual tokens to a digital transformer decoder for controlled image-captioning tasks. These results establish spatially multiplexed optical channels as a programmable feature and readout space for hybrid optical vision models.

physics.optics

Dynamical frustration in spacetime metamaterials enables cascading logic and synchronization

Spacetime metamaterials are engineered media whose constitutive parameters such as permittivity, permeability, stiffness, or mass density are modulated simultaneously in both space and time. These additional degrees of freedom, absent in conventional static metamaterials, unlock a cabinet of wave phenomena that cannot be achieved in time-invariant structures, e.g. compact nonreciprocal devices, topological insulators, and devices for efficient frequency conversion and mixing and pulse shaping. The vast majority of these studies, however, operate in the stable regime, where modulation parameters are chosen to yield linear wave propagation. Here, we push spacetime metamaterials into the regime of parametric instability, and discover a novel type of ``dynamically frustrated'' oscillating states, where nonlinear non-reciprocal, topologically protected phase dislocations emerge. We control these dislocations and make them stop, split, and recombine. We harness this control to create devices for cascading logic in branched networks, and synchronization in 2D metamaterials. Our findings are broadly applicable anywhere where spacetime modulation can be pushed beyond linear stability, from cold atoms and superconducting circuits to acoustics and RF circuits.

cond-mat.soft

Tutorial: A practical guide to the alignment of defocused spatial light modulators for fast diffractive neural networks

The conjugation of multiple spatial light modulators (SLMs) enables the construction of optical diffractive neural networks (DNNs). To accelerate training, which is limited by the low refresh rate of SLMs, spatial multiplexing of the input data across different spatial channels is possible, maximizing the number of available spatial degrees of freedom (DoFs). Precise alignment is required in order to ensure that the same physical operation is performed across each channel and thus the learning operation of the network. We present a semi-automatic procedure for this experimentally challenging alignment resulting in a pixel-level conjugation. It is scalable to any number of SLMs and may be useful in wavefront shaping setups where precise conjugation of SLMs is required, e.g. for the control of optical waves in phase and amplitude. The resulting setup functions as an optical DNN capable of processing hundreds of inputs simultaneously, thereby reducing training times and experimental noise through spatial averaging. We further present a characterization of the setup and an alignment method.

physics.optics

Dynamic structured illumination for confocal microscopy

Structured illumination enables the tailoring of an imaging device's optical transfer function to enhance resolution. We propose the incorporation of a temporal periodic modulation, specifically a rotating mask, to encode multiple transfer functions in the temporal domain. This approach is demonstrated using a confocal microscope configuration. At each scanning position, a temporal periodic signal is recorded. By filtering around each harmonic of the rotation frequency, multiple images of the same object can be constructed. The image carried by the $n{\mathrm{th}}$ harmonic is a convolution of the object with a phase vortex of topological charge $n$, similar to the outcome when using a vortex phase plate as an illumination. This enables the collection of chosen high spatial frequencies from the sample, thereby enhancing the spatial resolution of the confocal microscope.

physics.optics

Super-resolved imaging based on spatiotemporal wavefront shaping

A novel approach to improving the performances of confocal scanning imaging is proposed. We experimentally demonstrate its feasibility using acoustic waves. It relies on a new way to encode spatial information using the temporal dimension. By moving an emitter, used to insonify an object, along a circular path, we create a temporally modulated wavefield. Due to the cylindrical symmetry of the problem and its temporal periodicity, the spatiotemporal input field can be decomposed into harmonics corresponding to different spatial vortices, or topological charges. Acquiring the back-reflected waves with receivers which are also rotating, multiple images of the same object with different Point Spread Functions (PSFs) are obtained. Not only is the resolution improved compared to a standard confocal configuration, but the accumulation of information also allows building images beating the diffraction limit. The topological robustness of the approach promises good performances in real life conditions.

physics.optics