arXiv subjects

Han Han

Publications and source records attributed to Han Han.

33 records · Page 2Linked to original sources

arXiv2024

Event-Based Eye Tracking. AIS 2024 Challenge Survey

This survey reviews the AIS 2024 Event-Based Eye Tracking (EET) Challenge. The task of the challenge focuses on processing eye movement recorded with event cameras and predicting the pupil center of the eye. The challenge emphasizes efficient eye tracking with event cameras to achieve good task accuracy and efficiency trade-off. During the challenge period, 38 participants registered for the Kaggle competition, and 8 teams submitted a challenge factsheet. The novel and diverse methods from the submitted factsheets are reviewed and analyzed in this survey to advance future event-based eye tracking research.

cs.CV↗

arXiv2023

Traffic Sign Interpretation in Real Road Scene

Most existing traffic sign-related works are dedicated to detecting and recognizing part of traffic signs individually, which fails to analyze the global semantic logic among signs and may convey inaccurate traffic instruction. Following the above issues, we propose a traffic sign interpretation (TSI) task, which aims to interpret global semantic interrelated traffic signs (e.g.,~driving instruction-related texts, symbols, and guide panels) into a natural language for providing accurate instruction support to autonomous or assistant driving. Meanwhile, we design a multi-task learning architecture for TSI, which is responsible for detecting and recognizing various traffic signs and interpreting them into a natural language like a human. Furthermore, the absence of a public TSI available dataset prompts us to build a traffic sign interpretation dataset, namely TSI-CN. The dataset consists of real road scene images, which are captured from the highway and the urban way in China from a driver's perspective. It contains rich location labels of texts, symbols, and guide panels, and the corresponding natural language description labels. Experiments on TSI-CN demonstrate that the TSI task is achievable and the TSI architecture can interpret traffic signs from scenes successfully even if there is a complex semantic logic among signs. The TSI-CN dataset and the source code of the TSI architecture will be publicly available after the revision process.

cs.CV↗

arXiv2023

Fitting Auditory Filterbanks with Multiresolution Neural Networks

Waveform-based deep learning faces a dilemma between nonparametric and parametric approaches. On one hand, convolutional neural networks (convnets) may approximate any linear time-invariant system; yet, in practice, their frequency responses become more irregular as their receptive fields grow. On the other hand, a parametric model such as LEAF is guaranteed to yield Gabor filters, hence an optimal time-frequency localization; yet, this strong inductive bias comes at the detriment of representational capacity. In this paper, we aim to overcome this dilemma by introducing a neural audio model, named multiresolution neural network (MuReNN). The key idea behind MuReNN is to train separate convolutional operators over the octave subbands of a discrete wavelet transform (DWT). Since the scale of DWT atoms grows exponentially between octaves, the receptive fields of the subsequent learnable convolutions in MuReNN are dilated accordingly. For a given real-world dataset, we fit the magnitude response of MuReNN to that of a well-established auditory filterbank: Gammatone for speech, CQT for music, and third-octave for urban sounds, respectively. This is a form of knowledge distillation (KD), in which the filterbank ''teacher'' is engineered by domain knowledge while the neural network ''student'' is optimized from data. We compare MuReNN to the state of the art in terms of goodness of fit after KD on a hold-out set and in terms of Heisenberg time-frequency localization. Compared to convnets and Gabor convolutions, we find that MuReNN reaches state-of-the-art performance on all three optimization problems.

cs.SD↗

arXiv2023

Perceptual-Neural-Physical Sound Matching

Sound matching algorithms seek to approximate a target waveform by parametric audio synthesis. Deep neural networks have achieved promising results in matching sustained harmonic tones. However, the task is more challenging when targets are nonstationary and inharmonic, e.g., percussion. We attribute this problem to the inadequacy of loss function. On one hand, mean square error in the parametric domain, known as "P-loss", is simple and fast but fails to accommodate the differing perceptual significance of each parameter. On the other hand, mean square error in the spectrotemporal domain, known as "spectral loss", is perceptually motivated and serves in differentiable digital signal processing (DDSP). Yet, spectral loss is a poor predictor of pitch intervals and its gradient may be computationally expensive; hence a slow convergence. Against this conundrum, we present Perceptual-Neural-Physical loss (PNP). PNP is the optimal quadratic approximation of spectral loss while being as fast as P-loss during training. We instantiate PNP with physical modeling synthesis as decoder and joint time-frequency scattering transform (JTFS) as spectral representation. We demonstrate its potential on matching synthetic drum sounds in comparison with other loss functions.

cs.SD↗

arXiv2023

Mesostructures: Beyond Spectrogram Loss in Differentiable Time-Frequency Analysis

Computer musicians refer to mesostructures as the intermediate levels of articulation between the microstructure of waveshapes and the macrostructure of musical forms. Examples of mesostructures include melody, arpeggios, syncopation, polyphonic grouping, and textural contrast. Despite their central role in musical expression, they have received limited attention in deep learning. Currently, autoencoders and neural audio synthesizers are only trained and evaluated at the scale of microstructure: i.e., local amplitude variations up to 100 milliseconds or so. In this paper, we formulate and address the problem of mesostructural audio modeling via a composition of a differentiable arpeggiator and time-frequency scattering. We empirically demonstrate that time--frequency scattering serves as a differentiable model of similarity between synthesis parameters that govern mesostructure. By exposing the sensitivity of short-time spectral distances to time alignment, we motivate the need for a time-invariant and multiscale differentiable time--frequency model of similarity at the level of both local spectra and spectrotemporal modulations.

cs.SD↗

arXiv2022

Reconfigurable Intelligent Surface-induced Randomness for mmWave Key Generation

Secret key generation in physical layer security exploits the unpredictable random nature of wireless channels. The millimeter-wave (mmWave) channels have limited multipath and channel randomness in static environments. In this paper, for mmWave secret key generation of physical layer security, we use a reconfigurable intelligent surface (RIS) to induce randomness directly in wireless environments, without adding complexity to transceivers. We consider RIS to have continuous individual phase shifts (CIPS) and derive the RIS-assisted reflection channel distribution with its parameters. Then, we propose continuous group phase shifts (CGPS) to increase the randomness specifically at legal parties. Since the continuous phase shifts are expensive to implement, we analyze discrete individual phase shifts (DIPS) and derive the corresponding channel distribution, which is dependent on the quantization bit. We then derive the secret key rate (SKR) to evaluate the randomness performance. With the simulation results verifying the analytical results, this work explains the mathematical principles and lays a foundation for future mmWave evaluation and optimization of artificial channel randomness.

eess.SP↗

arXiv2022

Differentiable Time-Frequency Scattering on GPU

Joint time-frequency scattering (JTFS) is a convolutional operator in the time-frequency domain which extracts spectrotemporal modulations at various rates and scales. It offers an idealized model of spectrotemporal receptive fields (STRF) in the primary auditory cortex, and thus may serve as a biological plausible surrogate for human perceptual judgments at the scale of isolated audio events. Yet, prior implementations of JTFS and STRF have remained outside of the standard toolkit of perceptual similarity measures and evaluation methods for audio generation. We trace this issue down to three limitations: differentiability, speed, and flexibility. In this paper, we present an implementation of time-frequency scattering in Python. Unlike prior implementations, ours accommodates NumPy, PyTorch, and TensorFlow as backends and is thus portable on both CPU and GPU. We demonstrate the usefulness of JTFS via three applications: unsupervised manifold learning of spectrotemporal modulations, supervised classification of musical instruments, and texture resynthesis of bioacoustic sounds.

cs.SD↗

arXiv2020

wav2shape: Hearing the Shape of a Drum Machine

Disentangling and recovering physical attributes, such as shape and material, from a few waveform examples is a challenging inverse problem in audio signal processing, with numerous applications in musical acoustics as well as structural engineering. We propose to address this problem via a combination of time--frequency analysis and supervised machine learning. We start by synthesizing a dataset of sounds using the functional transformation method. Then, we represent each percussive sound in terms of its time-invariant scattering transform coefficients and formulate the parametric estimation of the resonator as multidimensional regression with a deep convolutional neural network. We interpolate scattering coefficients over the surface of the drum as a surrogate for potentially missing data, and study the response of the neural network to interpolated samples. Lastly, we resynthesize drum sounds from scattering coefficients, therefore paving the way towards a deep generative model of drum sounds whose latent variables are physically interpretable.

cs.SD↗

arXiv2019

Novel two-dimensional Ca-Cl crystals with metallicity, piezoelectric effect and room-temperature ferromagnetism

Recently we have reported the direct observation of two-dimensional (2D) Ca-Cl crystals on reduced graphene oxide (rGO) membranes, in which the calcium ions are only about monovalent (i.e. ~+1) and metallic rather than insulating properties are displayed by those CaCl crystals. Here, we report the experimental observation and demonstration of the formation of graphene-Ca-Cl heterojunction owing to the metallicity of 2D Ca-Cl crystals, unexpected piezoelectric effect, room-temperature ferromagnetism, as well as the distinct hydrogen storage and release capability of the Ca-Cl crystals in rGO membranes. Theoretical studies show that the formation of those abnormal crystals is attributed to the strong cation-pi interactions of the Ca2+ with the aromatic rings in the graphitic surfaces. Since strong cation-pi interactions also exist between other metal ions (such as Mg2+, Fe2+, Co2+, Cu2+, Cd2+, Cr2+ and Pb2+) and graphitic surfaces, similar 2D crystals with abnormal valence state of the metal cations and corresponding abnormal properties as well as novel applications are highly expected. Those findings further show the realistically potential applications of such abnormal CaCl material with unusual electronic properties in designing novel transistors and magnetic devices, hydrogen storage, catalyzer, high-performance conducting electrodes and sensors, with a size down to atomic scale.

physics.chem-ph↗

arXiv2018

Two-dimensional Ca-Cl crystals under ambient conditions observed directly by cryo-electron microscopy

Recently, we report the direct observation, under ambient conditions, of Na2Cl and Na3Cl as two-dimensional (2D) Na-Cl crystals, together with regular NaCl, on reduced graphene oxide membranes and on the surfaces of natural graphite powders from salt solutions far below the saturated concentration. However, what are these abnormal stoichiometries for high valence ions, such as calcium ions and copper ions still remain unknown. Here, using cryo-electron microscopy, we report the direct observation of two-dimensional (2D) Ca-Cl crystals on reduced graphene oxide (rGO) membranes, in which the calcium ions are only monovalent (i.e. +1). Remarkably, metallic properties rather than insulating are displayed by those CaCl crystals. We note that such CaCl crystals are obtained by simply incubating rGO membranes in salt solutions below the saturated concentration, under ambient conditions. Theoretical studies show that the formation of those abnormal crystals is attributed to the strong cation-pi interactions of the Ca2+ ions with the aromatic rings in the graphitic surfaces. Since strong cation-pi interactions also exist between other metal ions (such as Mg2+, Fe2+, Co2+, Cu2+, Cd2+, Cr2+ and Pb2+) and graphitic surfaces, similar 2D crystals with abnormal valence state of the metal cations and corresponding abnormal properties are highly expected. The 2D crystals with monovalent calcium ions show unusual electronic properties, and can be applicated in catalyzer, hydrogen storage, high-performance conducting electrodes and sensors. These findings also produce functionalized graphene including compact "graphene-metallic CaCl-insulating CaCl2" junction that can serve as transistors down to the atomic scale, and other devices for magnetic, optical and mechanical applications.

physics.chem-ph↗

arXiv2018

Observation of Meisser effect in Kapton Tapes

Composed of organic compounds, Kapton tape is regularly used as a non-conducting and non-magnetic material in cryogenic experiments. Here we report the discovery of Meisser effect at transition temperature (Tc) of ~ 3.8 K and ~ 8.0 K in Kapton tapes. New organic superconducting materials may be further explored in the tapes.

cond-mat.supr-con↗

arXiv2016

Saturation of ion irradiation effects in Cr2AlC

Cr2AlC materials were irradiated with 7 MeV Xe26+ ions and 500 keV He2+ ions at room temperature. A structural transition with an increased c lattice parameter and a decreased a lattice parameter occurs after irradiation to doses above 1 dpa. Nevertheless, the modified structure is stable up to the dose of 5.2 dpa without obvious lattice disorder. The three samples irradiated to doses above 1 dpa have comparable lattice parameters and hardness values, suggesting a saturation of irradiation effects in Cr2AlC. The structural transition and irradiation effects saturation are ascribed to irradiation-induced antisite defects (CrAl and AlCr) and C interstitials, which is supported by the calculations of the formation energies of various defects in Cr2AlC. The irradiation-induced antisite defects and C interstitials may be critical to understand the excellent resistance to irradiation-induced amorphization of MAX phases.

cond-mat.mtrl-sci↗

arXiv2013

Atomic Calligraphy: The Direct Writing of Nanoscale Structures using MEMS

We present a micro-electromechanical system (MEMS) based method for the resist free patterning of nano-structures. Using a focused ion beam (FIB) to customize larger MEMS machines, we fabricate apertures as small as 50 nm on plates that can be moved with nanometer precision over an area greater than 20x20 μm^2. Depositing thermally evaporated gold atoms though the apertures while moving the plate results in the deposition of nanoscale metal patterns. Adding a shutter only microns above the aperture, enables high speed control of not only where but also when atoms are deposited. Using a shutter, different sized apertures can be selectively opened and closed for nano-structure fabrication with features ranging from nano- to micrometers in scale. The ability to evaporate materials with high precision, and thereby fabricate circuits and structures in situ, enables new kinds of experiments based on the interactions of a small number of atoms and eventually even single atoms.

cond-mat.mes-hall↗

arXiv2011

On Bayes' theorem for improper mixtures

Although Bayes's theorem demands a prior that is a probability distribution on the parameter space, the calculus associated with Bayes's theorem sometimes generates sensible procedures from improper priors, Pitman's estimator being a good example. However, improper priors may also lead to Bayes procedures that are paradoxical or otherwise unsatisfactory, prompting some authors to insist that all priors be proper. This paper begins with the observation that an improper measure on Theta satisfying Kingman's countability condition is in fact a probability distribution on the power set. We show how to extend a model in such a way that the extended parameter space is the power set. Under an additional finiteness condition, which is needed for the existence of a sampling region, the conditions for Bayes's theorem are satisfied by the extension. Lack of interference ensures that the posterior distribution in the extended space is compatible with the original parameter space. Provided that the key finiteness condition is satisfied, this probabilistic analysis of the extended model may be interpreted as a vindication of improper Bayes procedures derived from the original model.

math.ST↗

arXiv2011

CeNiAsO: an antiferromagnetic dense Kondo lattice

A cerium containing pnictide, CeNiAsO, crystallized in the ZrCuSiAs type structure, has been investigated by measuring transport and magnetic properties, as well as specific heat. We found that CeNiAsO is an antiferromagnetic dense Kondo lattice metallic compound with Kondo scale $T_K \sim$ 15 K and shows an enhanced Sommerfeld coefficient of $γ_0 \sim$ 203 mJ/mol$\cdot$K$^{2}$. While no superconductivity can been observed down to 30 mK, Ce ions exhibit two successive antiferromagnetic (AFM) transitions. We propose that the magnetic moment of Ce ion could align in the G type AFM order below the first transition at $T_{N1}$=9.3 K, and it might be modified into the C type AFM order below a lower transition at $T_{N2}$=7.3 K. Our results indicate that the 3$d-4f$ interlayer Kondo interactions play an important role in Ni-based Ce-containing pnictide.

cond-mat.str-el↗