arXiv subjects

Ruixuan Wang

Publications and source records attributed to Ruixuan Wang.

At least 37 records · Page 2Linked to original sources

arXiv2025

Preserve and Sculpt: Manifold-Aligned Fine-tuning of Vision-Language Models for Few-Shot Learning

Pretrained vision-language models (VLMs), such as CLIP, have shown remarkable potential in few-shot image classification and led to numerous effective transfer learning strategies. These methods leverage the pretrained knowledge of VLMs to enable effective domain adaptation while mitigating overfitting through parameter-efficient tuning or instance-based consistency constraints. However, such regularizations often neglect the geometric structure of data distribution, which may lead to distortion of the overall semantic representation. To overcome this limitation, we propose a novel fine-tuning method, Manifold-Preserving and Sculpting Tuning (MPS-Tuning). Regarding the data distribution in feature space as a semantic manifold, MPS-Tuning explicitly constrains the intrinsic geometry of this manifold while further sculpting it to enhance class separability. Specifically, MPS-Tuning preserves both macroscopic and microscopic topological structures of the original manifold by aligning Gram matrices of features before and after fine-tuning. Theoretically, this constraint is shown to approximate an upper bound of the Gromov-Wasserstein distance. Furthermore, features from the image and text modalities are paired, and pairwise similarities are optimized to enhance the manifold's class discriminability. Extensive experiments demonstrate that MPS-Tuning significantly improves model performance while effectively preserving the structure of the semantic manifold. The code will be released.

cs.CV↗

arXiv2025

Augmenting Continual Learning of Diseases with LLM-Generated Visual Concepts

Continual learning is essential for medical image classification systems to adapt to dynamically evolving clinical environments. The integration of multimodal information can significantly enhance continual learning of image classes. However, while existing approaches do utilize textual modality information, they solely rely on simplistic templates with a class name, thereby neglecting richer semantic information. To address these limitations, we propose a novel framework that harnesses visual concepts generated by large language models (LLMs) as discriminative semantic guidance. Our method dynamically constructs a visual concept pool with a similarity-based filtering mechanism to prevent redundancy. Then, to integrate the concepts into the continual learning process, we employ a cross-modal image-concept attention module, coupled with an attention loss. Through attention, the module can leverage the semantic knowledge from relevant visual concepts and produce class-representative fused features for classification. Experiments on medical and natural image datasets show our method achieves state-of-the-art performance, demonstrating the effectiveness and superiority of our method. We will release the code publicly.

cs.CV↗

arXiv2025

Raman-enabled platicon microcomb in 4H-SiC microresonator

Stimulated Raman scattering in a Kerr microresonator is generally considered a competing nonlinear process that hinders the formation of Kerr soliton microcombs. In this work, we experimentally demonstrate that the ubiquitous Raman gain in Kerr microresonators can, in fact, be harnessed to achieve the opposite effect: it enables the formation of platicon microcomb in the normal dispersion regime, while also relaxing the conditions for soliton formation and broadening the spectrum through the simultaneous excitation of a Stokes soliton. We showcase this process in a compact silicon carbide microresonator supporting a platicon microcomb spanning 1500 to 1700 nm, with a pump-to-comb conversion efficiency as high as $56\%$. Furthermore, the presence of a Stokes soliton in the same mode family extends the comb spectrum beyond 1800 nm. By intentionally leveraging-rather than suppressing-the Raman effect, our work offers new insights into the Raman-Kerr interplay and introduces a promising approach to generating broadband platicon microcombs.

physics.optics↗

arXiv2025

Integrated microheater on the 4H-silicon-carbide-on-insulator platform and its applications

Recent progress in the 4H-silicon-carbide-on-insulator (4H-SiCOI) platform has resulted in the demonstration of essential building blocks such as low-loss waveguides and microresonators. In this work, we add tunability to the 4H-SiCOI platform by integrating microheaters with compact microresonators. The strong thermo-optic effect in SiC enables a resonance tuning rate of $11.7$ pm/mW for a 36-$μ$m-radius SiC microring, with a maximum wavelength shift up to $2.4$ nm (300 GHz). The thermal time constant of the microheater is estimated near 7 $μ$s, corresponding to a 3-dB electrical bandwidth of 40 kHz. As a demonstration of potential applications, we employ the microheater to perform fast thermo-optic scans to deterministically access the single-soliton state of a 36-$μ$m-radius microcomb source. In addition, an add-drop filter based on an over-coupled 18-$μ$m-radius SiC microring is combined with the microcomb source for the selective filtering of individual comb lines, featuring an approximate 3-dB bandwidth of 5 GHz and an insertion loss of less than 1 dB. With such demonstrations, our work brings the much-needed tunability and reconfigurability to the 4H-SiCOI platform, paving the way for a wealth of chip-scale applications.

physics.optics↗

arXiv2025

Optimizing electro-optic modulators for interfacing color centers in an integrated silicon carbide platform

Silicon carbide is a promising material platform for hosting various color centers suitable for quantum information processing. Here, we report the design and demonstration of an integrated electro-optic modulator that can directly interface the silicon vacancy centers in the 4H-silicon-carbide-on-insulator platform. Despite a relatively low electro-optic coefficient ($0.22$ pm/V), the optimized silicon carbide modulator is able to work in the 920 nm range with a propagation loss of less than $0.5$ dB/cm, featuring a 3-dB bandwidth around 500 MHz, an extinction ratio of 8-12 dB for an operating peak-to-peak voltage of 10 V, and a footprint of less than $0.1\ \text{mm}^2$. With such modulation performance, our work provides a cost-effective solution for the chip-scale implementation of the electro-optic modulation technology for interfacing color centers in the silicon carbide platform.

physics.optics↗

arXiv2024

TagFog: Textual Anchor Guidance and Fake Outlier Generation for Visual Out-of-Distribution Detection

Out-of-distribution (OOD) detection is crucial in many real-world applications. However, intelligent models are often trained solely on in-distribution (ID) data, leading to overconfidence when misclassifying OOD data as ID classes. In this study, we propose a new learning framework which leverage simple Jigsaw-based fake OOD data and rich semantic embeddings (`anchors') from the ChatGPT description of ID knowledge to help guide the training of the image encoder. The learning framework can be flexibly combined with existing post-hoc approaches to OOD detection, and extensive empirical evaluations on multiple OOD detection benchmarks demonstrate that rich textual representation of ID knowledge and fake OOD knowledge can well help train a visual encoder for OOD detection. With the learning framework, new state-of-the-art performance was achieved on all the benchmarks. The code is available at \url{https://github.com/Cverchen/TagFog}.

cs.CV↗

arXiv2024

FodFoM: Fake Outlier Data by Foundation Models Creates Stronger Visual Out-of-Distribution Detector

Out-of-Distribution (OOD) detection is crucial when deploying machine learning models in open-world applications. The core challenge in OOD detection is mitigating the model's overconfidence on OOD data. While recent methods using auxiliary outlier datasets or synthesizing outlier features have shown promising OOD detection performance, they are limited due to costly data collection or simplified assumptions. In this paper, we propose a novel OOD detection framework FodFoM that innovatively combines multiple foundation models to generate two types of challenging fake outlier images for classifier training. The first type is based on BLIP-2's image captioning capability, CLIP's vision-language knowledge, and Stable Diffusion's image generation ability. Jointly utilizing these foundation models constructs fake outlier images which are semantically similar to but different from in-distribution (ID) images. For the second type, GroundingDINO's object detection ability is utilized to help construct pure background images by blurring foreground ID objects in ID images. The proposed framework can be flexibly combined with multiple existing OOD detection methods. Extensive empirical evaluations show that image classifiers with the help of constructed fake images can more accurately differentiate real OOD images from ID ones. New state-of-the-art OOD detection performance is achieved on multiple benchmarks. The code is available at \url{https://github.com/Cverchen/ACMMM2024-FodFoM}.

cs.CV↗

arXiv2024

4H-SiC microring opto-mechanical oscillator with a self-injection locked pump

We have demonstrated, for the first time to our knowledge, self-injection locking of a distributed feedback (DFB) diode laser to a multimode 4H-silicon carbide (4H-SiC) microring resonator, and observed resonant opto-mechanical oscillation in the cavity modes. While the fundamental transverse-electric mode family of the silicon carbide microring was optically pumped, Stokes light was generated in the adjacent fundamental transverse-magnetic resonant mode. The threshold of the process did not exceed 5~mW of light entering the cavity characterized with a loaded optical quality factor of $\smash{2\times10^6}$. These results mark a significant milestone in unlocking the potential of 4H-SiC through turnkey soliton microcomb generation and empowering future advancements in areas such as cavity optomechanics using this versatile and quantum-friendly material platform.

physics.optics↗

arXiv2024

Physical Vapor Deposition of High Mobility P-type Tellurium and its Applications for Gate-tunable van der Waals PN Photodiodes

Recently tellurium (Te) has attracted resurgent interests due to its p-type characteristics and outstanding ambient environmental stability. Here we present a substrate engineering based physical vapor deposition method to synthesize high-quality Te nanoflakes and achieved a field-effect hole mobility of 1500 cm2/Vs, which is, to the best of our knowledge, the highest among the existing synthesized van der Waals p-type semiconductors. The high mobility Te enables the fabrication of Te/MoS2 pn diodes with highly gate-tunable electronic and optoelectronic characteristics. The Te/MoS2 heterostructure can be used as a visible range photodetector with a current responsivity up to 630 A/W, which is about one order of magnitude higher than the one achieved using p-type Si-MoS2 PN photodiodes. The photo response of the Te/MoS2 heterojunction also exhibits strong gate tunability due to their ultrathin thickness and unique band structures. The successful synthesis of high mobility Te and the enabled Te/MoS2 photodiodes show promise for the development of highly tunable and ultrathin photodetectors.

physics.app-ph↗

arXiv2024

Generalizable Two-Branch Framework for Image Class-Incremental Learning

Deep neural networks often severely forget previously learned knowledge when learning new knowledge. Various continual learning (CL) methods have been proposed to handle such a catastrophic forgetting issue from different perspectives and achieved substantial improvements. In this paper, a novel two-branch continual learning framework is proposed to further enhance most existing CL methods. Specifically, the main branch can be any existing CL model and the newly introduced side branch is a lightweight convolutional network. The output of each main branch block is modulated by the output of the corresponding side branch block. Such a simple two-branch model can then be easily implemented and learned with the vanilla optimization setting without whistles and bells. Extensive experiments with various settings on multiple image datasets show that the proposed framework yields consistent improvements over state-of-the-art methods.

cs.CV↗

arXiv2024

Silicon carbide soliton microcomb generation for narrow-grid optical communications

A soliton microcomb can play a crucial role in narrow-grid optical communications by replacing many independently operated lasers in wavelength-division multiplexing systems. In this work, we designed and demonstrated power-efficient soliton microcombs with 100-GHz free spectral range in an integrated 4H-SiC platform for the first time. The combination of enabling technologies, including efficient fiber coupling (3 dB insertion loss), high-quality-factor microrings (intrinsic quality factors up to 5.7 million), and the employment of the Raman effect for adiabatic accessing of the soliton state, has enabled the demonstration of soliton pump power as low as 6 mW while supporting comb powers above -20 dBm per line near the pump wavelength.

physics.optics↗

arXiv2024

A Computing-in-Memory-based One-Class Hyperdimensional Computing Model for Outlier Detection

In this work, we present ODHD, an algorithm for outlier detection based on hyperdimensional computing (HDC), a non-classical learning paradigm. Along with the HDC-based algorithm, we propose IM-ODHD, a computing-in-memory (CiM) implementation based on hardware/software (HW/SW) codesign for improved latency and energy efficiency. The training and testing phases of ODHD may be performed with conventional CPU/GPU hardware or our IM-ODHD, SRAM-based CiM architecture using the proposed HW/SW codesign techniques. We evaluate the performance of ODHD on six datasets from different application domains using three metrics, namely accuracy, F1 score, and ROC-AUC, and compare it with multiple baseline methods such as OCSVM, isolation forest, and autoencoder. The experimental results indicate that ODHD outperforms all the baseline methods in terms of these three metrics on every dataset for both CPU/GPU and CiM implementations. Furthermore, we perform an extensive design space exploration to demonstrate the tradeoff between delay, energy efficiency, and performance of ODHD. We demonstrate that the HW/SW codesign implementation of the outlier detection on IM-ODHD is able to outperform the GPU-based implementation of ODHD by at least 331.5x/889x in terms of training/testing latency (and on average 14.0x/36.9x in terms of training/testing energy consumption.

cs.AR↗

arXiv2024

Intensive Vision-guided Network for Radiology Report Generation

Automatic radiology report generation is booming due to its huge application potential for the healthcare industry. However, existing computer vision and natural language processing approaches to tackle this problem are limited in two aspects. First, when extracting image features, most of them neglect multi-view reasoning in vision and model single-view structure of medical images, such as space-view or channel-view. However, clinicians rely on multi-view imaging information for comprehensive judgment in daily clinical diagnosis. Second, when generating reports, they overlook context reasoning with multi-modal information and focus on pure textual optimization utilizing retrieval-based methods. We aim to address these two issues by proposing a model that better simulates clinicians' perspectives and generates more accurate reports. Given the above limitation in feature extraction, we propose a Globally-intensive Attention (GIA) module in the medical image encoder to simulate and integrate multi-view vision perception. GIA aims to learn three types of vision perception: depth view, space view, and pixel view. On the other hand, to address the above problem in report generation, we explore how to involve multi-modal signals to generate precisely matched reports, i.e., how to integrate previously predicted words with region-aware visual content in next word prediction. Specifically, we design a Visual Knowledge-guided Decoder (VKGD), which can adaptively consider how much the model needs to rely on visual information and previously predicted text to assist next word prediction. Hence, our final Intensive Vision-guided Network (IVGN) framework includes a GIA-guided Visual Encoder and the VKGD. Experiments on two commonly-used datasets IU X-Ray and MIMIC-CXR demonstrate the superior ability of our method compared with other state-of-the-art approaches.

cs.CV↗

arXiv2024

Demonstration of 4H silicon carbide on aluminum nitride integrated photonics platform

The existing silicon-carbide-on-insulator photonic platform utilizes a thin layer of silicon dioxide under silicon carbide to provide optical confinement and mode isolation. Here, we replace the underneath silicon dioxide layer with a 1-$μ$m-thick aluminum nitride and demonstrate a 4H-silicon-carbide-on-aluminum-nitride integrated photonics platform for the first time. Efficient grating couplers, low-loss waveguides, and compact microring resonators with intrinsic quality factors up to 210,000 are fabricated. In addition, by undercutting the aluminum nitride layer, the intrinsic quality factor of the silicon carbide microring is improved by nearly one order of magnitude (1.8 million). Finally, an optical pump-probe method is developed to measure the thermal conductivity of the aluminum nitride layer, which is estimated to be over 30 times of that of silicon dioxide.

physics.optics↗

arXiv2023

A Target Detection Algorithm in Traffic Scenes Based on Deep Reinforcement Learning

This research presents a novel active detection model utilizing deep reinforcement learning to accurately detect traffic objects in real-world scenarios. The model employs a deep Q-network based on LSTM-CNN that identifies and aligns target zones with specific categories of traffic objects through implementing a top-down approach with efficient feature extraction of the environment. The model integrates historical and current actions and observations to make a comprehensive analysis. The design of the state space and reward function takes into account the impact of time steps to enable the model to complete the task in fewer steps. Tests conducted demonstrate the model's proficiency, exhibiting exceptional precision and performance in locating traffic signal lights and speed limit signs. The findings of this study highlight the efficacy and potential of the deep reinforcement learning-based active detection model in traffic-related applications, underscoring its robust detection abilities and promising performance.

cs.CV↗

arXiv2023

Efficient Raman lasing and Raman-Kerr interaction in an integrated silicon carbide platform

Implementing stimulated Raman scattering in a low-loss microresonator could lead to Raman lasing. Here, we report the demonstration of an efficient Raman laser with $>50 \%$ power efficiency in an integrated silicon carbide platform for the first time. By fine tuning the free spectral range (FSR) of 43-$μ$m-radius silicon carbide microresonators, the Stokes resonance corresponding to the dominant Raman shift of $777\ \text{cm}^{-1}$ ($23.3$ THz) is aligned to the center of the Raman gain spectrum, resulting in a low power threshold of $2.5$ mW. The peak Raman gain coefficient is estimated to be ($0.75 \pm 0.15) \ \text{cm}/\text{GW}$ in the 1550 nm band, with an approximate full width at half maximum of ($120 \pm 30$) GHz. In addition, the microresonator is designed to exhibit normal dispersion at the pump wavelength near 1550 nm while possessing anomalous dispersion at the first Stokes near 1760 nm. At high enough input powers, a Kerr microcomb is generated by the Stokes signal acting as the secondary pump, which then mixes with the pump laser through four-wave mixing to attain a wider spectral coverage. Furthermore, cascaded Raman lasing and occurrence of multiple Raman shifts, including $204\ \text{cm}^{-1}$ ($6.1$ THz) and $266\ \text{cm}^{-1}$ ($8.0$ THz) transitions, are also observed. Finally, we show that the Stokes Raman could also help broaden the spectrum in a Kerr microcomb which has anomalous dispersion at the pump wavelength. Our example of a 100-GHz-FSR microcomb has a wavelength span from 1200 nm to 1900 nm with 300 mW on-chip power.

physics.optics↗

arXiv2023

Classifier-head Informed Feature Masking and Prototype-based Logit Smoothing for Out-of-Distribution Detection

Out-of-distribution (OOD) detection is essential when deploying neural networks in the real world. One main challenge is that neural networks often make overconfident predictions on OOD data. In this study, we propose an effective post-hoc OOD detection method based on a new feature masking strategy and a novel logit smoothing strategy. Feature masking determines the important features at the penultimate layer for each in-distribution (ID) class based on the weights of the ID class in the classifier head and masks the rest features. Logit smoothing computes the cosine similarity between the feature vector of the test sample and the prototype of the predicted ID class at the penultimate layer and uses the similarity as an adaptive temperature factor on the logit to alleviate the network's overconfidence prediction for OOD data. With these strategies, we can reduce feature activation of OOD data and enlarge the gap in OOD score between ID and OOD data. Extensive experiments on multiple standard OOD detection benchmarks demonstrate the effectiveness of our method and its compatibility with existing methods, with new state-of-the-art performance achieved from our method. The source code will be released publicly.

cs.CV↗

arXiv2023

Adapter Learning in Pretrained Feature Extractor for Continual Learning of Diseases

Currently intelligent diagnosis systems lack the ability of continually learning to diagnose new diseases once deployed, under the condition of preserving old disease knowledge. In particular, updating an intelligent diagnosis system with training data of new diseases would cause catastrophic forgetting of old disease knowledge. To address the catastrophic forgetting issue, an Adapter-based Continual Learning framework called ACL is proposed to help effectively learn a set of new diseases at each round (or task) of continual learning, without changing the shared feature extractor. The learnable lightweight task-specific adapter(s) can be flexibly designed (e.g., two convolutional layers) and then added to the pretrained and fixed feature extractor. Together with a specially designed task-specific head which absorbs all previously learned old diseases as a single "out-of-distribution" category, task-specific adapter(s) can help the pretrained feature extractor more effectively extract discriminative features between diseases. In addition, a simple yet effective fine-tuning is applied to collaboratively fine-tune multiple task-specific heads such that outputs from different heads are comparable and consequently the appropriate classifier head can be more accurately selected during model inference. Extensive empirical evaluations on three image datasets demonstrate the superior performance of ACL in continual learning of new diseases. The source code is available at https://github.com/GiantJun/CL_Pytorch.

cs.CV↗