SearcharxivSearch

arXiv subjects

Hao Sha

Publications and source records attributed to Hao Sha.

12 recordsLinked to original sources

Spectral Property-Driven Data Augmentation for Hyperspectral Single-Source Domain Generalization

While hyperspectral images (HSI) benefit from numerous spectral channels that provide rich information for classification, the increased dimensionality and sensor variability make them more sensitive to distributional discrepancies across domains, which in turn can affect classification performance. To tackle this issue, hyperspectral single-source domain generalization (SDG) typically employs data augmentation to simulate potential domain shifts and enhance model robustness under the condition of single-source domain training data availability. However, blind augmentation may produce samples misaligned with real-world scenarios, while excessive emphasis on realism can suppress diversity, highlighting a tradeoff between realism and diversity that limits generalization to target domains. To address this challenge, we propose a spectral property-driven data augmentation (SPDDA) that explicitly accounts for the inherent properties of HSI, namely the device-dependent variation in the number of spectral channels and the mixing of adjacent channels. Specifically, SPDDA employs a spectral diversity module that resamples data from the source domain along the spectral dimension to generate samples with varying spectral channels, and constructs a channel-wise adaptive spectral mixer by modeling inter-channel similarity, thereby avoiding fixed augmentation patterns. To further enhance the realism of the augmented samples, we propose a spatial-spectral co-optimization mechanism, which jointly optimizes a spatial fidelity constraint and a spectral continuity self-constraint. Moreover, the weight of the spectral self-constraint is adaptively adjusted based on the spatial counterpart, thus preventing over-smoothing in the spectral dimension and preserving spatial structure. Extensive experiments conducted on three remote sensing benchmarks demonstrate that SPDDA outperforms state-of-the-art methods.

cs.CV

Quantitative evaluation of methods to analyze motion changes in single-particle experiments

The analysis of live-cell single-molecule imaging experiments can reveal valuable information about the heterogeneity of transport processes and interactions between cell components. These characteristics are seen as motion changes in the particle trajectories. Despite the existence of multiple approaches to carry out this type of analysis, no objective assessment of these methods has been performed so far. Here, we report the results of a competition to characterize and rank the performance of these methods when analyzing the dynamic behavior of single molecules. To run this competition, we implemented a software library that simulates realistic data corresponding to widespread diffusion and interaction models, both in the form of trajectories and videos obtained in typical experimental conditions. The competition constitutes the first assessment of these methods, providing insights into the current limitations of the field, fostering the development of new approaches, and guiding researchers to identify optimal tools for analyzing their experiments.

cond-mat.soft

LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving

Existing learning-based autonomous driving (AD) systems face challenges in comprehending high-level information, generalizing to rare events, and providing interpretability. To address these problems, this work employs Large Language Models (LLMs) as a decision-making component for complex AD scenarios that require human commonsense understanding. We devise cognitive pathways to enable comprehensive reasoning with LLMs, and develop algorithms for translating LLM decisions into actionable driving commands. Through this approach, LLM decisions are seamlessly integrated with low-level controllers by guided parameter matrix adaptation. Extensive experiments demonstrate that our proposed method not only consistently surpasses baseline approaches in single-vehicle tasks, but also helps handle complex driving behaviors even multi-vehicle coordination, thanks to the commonsense reasoning capabilities of LLMs. This paper presents an initial step toward leveraging LLMs as effective decision-makers for intricate AD scenarios in terms of safety, efficiency, generalizability, and interoperability. We aspire for it to serve as inspiration for future research in this field. Project page: https://sites.google.com/view/llm-mpc

cs.RO

Lensless coherent diffraction imaging based on spatial light modulator with unknown modulation curve

Lensless imaging is a popular research field for the advantages of small size, wide field-of-view and low aberration in recent years. However, some traditional lensless imaging methods suffer from slow convergence, mechanical errors and conjugate solution interference, which limit its further application and development. In this work, we proposed a lensless imaging method based on spatial light modulator (SLM) with unknown modulation curve. In our imaging system, we use SLM to modulate the wavefront of object, and introduce the ptychographic scanning algorithm that is able to recover the complex amplitude information even the SLM modulation curve is inaccurate or unknown. In addition, we also design a split-beam interference experiment to calibrate the modulation curve of SLM, and using the calibrated modulation function as the initial value of the expended ptychography iterative engine (ePIE) algorithm can improve the convergence speed. We further analyze the effect of modulation function, algorithm parameters and the characteristics of the coherent light source on the quality of reconstructed image. The simulated and real experiments show that the proposed method is superior to traditional mechanical scanning methods in terms of recovering speed and accuracy, with the recovering resolution up to 14 um.

physics.optics

GnetDet: Object Detection Optimized on a 224mW CNN Accelerator Chip at the Speed of 106FPS

Object detection is widely used on embedded devices. With the wide availability of CNN (Convolutional Neural Networks) accelerator chips, the object detection applications are expected to run with low power consumption, and high inference speed. In addition, the CPU load is expected to be as low as possible for a CNN accelerator chip working as a co-processor with a host CPU. In this paper, we optimize the object detection model on the CNN accelerator chip by minimizing the CPU load. The resulting model is called GnetDet. The experimental result shows that the GnetDet model running on a 224mW chip achieves the speed of 106FPS with excellent accuracy.

cs.AR

GnetSeg: Semantic Segmentation Model Optimized on a 224mW CNN Accelerator Chip at the Speed of 318FPS

Semantic segmentation is the task to cluster pixels on an image belonging to the same class. It is widely used in the real-world applications including autonomous driving, medical imaging analysis, industrial inspection, smartphone camera for person segmentation and so on. Accelerating the semantic segmentation models on the mobile and edge devices are practical needs for the industry. Recent years have witnessed the wide availability of CNN (Convolutional Neural Networks) accelerators. They have the advantages on power efficiency, inference speed, which are ideal for accelerating the semantic segmentation models on the edge devices. However, the CNN accelerator chips also have the limitations on flexibility and memory. In addition, the CPU load is very critical because the CNN accelerator chip works as a co-processor with a host CPU. In this paper, we optimize the semantic segmentation model in order to fully utilize the limited memory and the supported operators on the CNN accelerator chips, and at the same time reduce the CPU load of the CNN model to zero. The resulting model is called GnetSeg. Furthermore, we propose the integer encoding for the mask of the GnetSeg model, which minimizes the latency of data transfer between the CNN accelerator and the host CPU. The experimental result shows that the model running on the 224mW chip achieves the speed of 318FPS with excellent accuracy for applications such as person segmentation.

cs.CV

SuperOCR: A Conversion from Optical Character Recognition to Image Captioning

Optical Character Recognition (OCR) has many real world applications. The existing methods normally detect where the characters are, and then recognize the character for each detected location. Thus the accuracy of characters recognition is impacted by the performance of characters detection. In this paper, we propose a method for recognizing characters without detecting the location of each character. This is done by converting the OCR task into an image captioning task. One advantage of the proposed method is that the labeled bounding boxes for the characters are not needed during training. The experimental results show the proposed method outperforms the existing methods on both the license plate recognition and the watermeter character recognition tasks. The proposed method is also deployed into a low-power (300mW) CNN accelerator chip connected to a Raspberry Pi 3 for on-device applications.

cs.CV

Dynamic topic modeling of the COVID-19 Twitter narrative among U.S. governors and cabinet executives

A combination of federal and state-level decision making has shaped the response to COVID-19 in the United States. In this paper we analyze the Twitter narratives around this decision making by applying a dynamic topic model to COVID-19 related tweets by U.S. Governors and Presidential cabinet members. We use a network Hawkes binomial topic model to track evolving sub-topics around risk, testing and treatment. We also construct influence networks amongst government officials using Granger causality inferred from the network Hawkes process.

cs.SI

Multi-modal Sentiment Analysis using Super Characters Method on Low-power CNN Accelerator Device

Recent years NLP research has witnessed the record-breaking accuracy improvement by DNN models. However, power consumption is one of the practical concerns for deploying NLP systems. Most of the current state-of-the-art algorithms are implemented on GPUs, which is not power-efficient and the deployment cost is also very high. On the other hand, CNN Domain Specific Accelerator (CNN-DSA) has been in mass production providing low-power and low cost computation power. In this paper, we will implement the Super Characters method on the CNN-DSA. In addition, we modify the Super Characters method to utilize the multi-modal data, i.e. text plus tabular data in the CL-Aff sharedtask.

cs.CL

Signature of Magnetic Phase Separation in the Ground State of Pr1-xCaxMnO3

Neutron scattering has been used to investigate the evolution of the long- and short-range charge-ordered (CO), ferromagnetic (FM), and antiferromagnetic (AF) correlations in single crystals of Pr1-xCaxMnO3. The existence and population of spin clusters as refected by short-range correlations are found to drastically depend on the doping (x) and temperature (T). Concentrated spin clusters coexist with long-range canted AF order in a wide temperature range in x = 0.3 while clusters do not appear in x = 0.4 crystal. In contrast, both CO and AF order parameters in the x = 0.35 crystal show a precipitous decrease below ~ 35 K where spin clusters form. These results provide direct evidence of magnetic phase separation and indicate that there is a critical doping x_c (close to x = 0.35) that divides the phase-separated site-centered from the homogeneous bond-centered or charge-disproportionated CO ground state.

cond-mat.str-el

Magnons in Ferromagnetic Metallic Manganites

Ferromagnetic (FM) manganites, a group of likely half-metallic oxides, are of special interest not only because they are a testing ground of the classical doubleexchange interaction mechanism for the colossal magnetoresistance, but also because they exhibit an extraordinary arena of emergent phenomena. These emergent phenomena are related to the complexity associated with strong interplay between charge, spin, orbital, and lattice. In this review, we focus on the use of inelastic neutron scattering to study the spin dynamics, mainly the magnon excitations in this class of FM metallic materials. In particular, we discussed the unusual magnon softening and damping near the Brillouin zone boundary in relatively narrow band compounds with strong Jahn-Teller lattice distortion and charge/orbital correlations. The anomalous behaviors of magnons in these compounds indicate the likelihood of cooperative excitations involving spin, lattice, as well as orbital degrees of freedom.

cond-mat.str-el

Evolution of spin-wave excitations in ferromagnetic metallic manganites

Neutron scattering results are presented for spin-wave excitations of three ferromagnetic metallic $A_{1-x}A^{\prime}_{x}$MnO$_3$ manganites (where $A$ and $A^\prime$ are rare- and alkaline-earth ions), which when combined with previous work elucidate systematics of the interactions as a function of carrier concentration $x$, on-site disorder, and strength of the lattice distortion. The long wavelength spin dynamics show only a very weak dependence across the series. The ratio of fourth to first neighbor exchange ($J_4/J_1$) that controls the zone boundary magnon softening changes systematically with $x$, but does not depend on the other parameters. None of the prevailing models can account for these behaviors.

cond-mat.str-el