SearcharxivSearch

arXiv subjects

Jinyeong Park

Publications and source records attributed to Jinyeong Park.

6 recordsLinked to original sources

GuideCAD: A Lightweight Multimodal Framework for 3D CAD Model Generation via Prefix Embedding

Multi-modal approaches used for 3D CAD generation require substantial computational resources, necessitating efficient training. To address this, we propose GuideCAD, which leverages semantically rich visual-textual representations having only a small number of trainable parameters to generate 3D CAD models. Specifically, GuideCAD uses a mapping network that converts image embeddings into prefix embeddings, enabling a pretrained large language model to integrate visual and textual information. As a result, a transformer-based decoder predicts the construction sequence using the visual-textual embeddings in order to generate the 3D CAD model. For experimental evaluation, we construct a new dataset, referred to as GuideCAD, which consists of text-image pairs. Each pair includes a text prompt that represents a 3D CAD construction sequence and its corresponding 3D CAD image. Our experimental results show that GuideCAD generates comparably high-quality 3D CAD models while using approximately four times fewer parameters and achieving twice the training efficiency compared to fine-tuning approaches. We have released the source code and dataset for our method at: https://github.com/mskimS2/GuideCAD

cs.CV

QATMA: Quantization-Aware Training with Multimodal Alignment for Open-Vocabulary Object Detection

Quantizing open-vocabulary object detection (OVOD) models reduces their memory and computational costs, but extremely low-bit quantization severely degrades both cross-modal (region-text) and intra-modal (region-region) alignments. This multimodal degradation is a unique challenge that prior quantization methods for closed-vocabulary detectors fail to resolve. To overcome this, we propose Quantization-Aware Training with Multimodal Alignment (QATMA), the first multimodal-aware and architecture-agnostic QAT framework tailored for OVOD. QATMA integrates two key components: (i) Curriculum QAT, which partitions the detector by functional roles and progressively expands the quantization scope to suppress error accumulation and ensure stable optimization; and (ii) Text-anchored Pairwise Similarity Distillation, which transfers both region-text and region-region alignments from a full-precision teacher model via pairwise cosine similarities in the joint embedding space. Experimental results on LVIS and COCO zero-shot benchmarks demonstrate that QATMA significantly outperforms existing QAT baselines under extremely low-bit settings, achieving gains of up to 4.3 and 7.6 AP, respectively.

cs.CV

CAMEL-CLIP: Channel-aware Multimodal Electroencephalography-text Alignment for Generalizable Brain Foundation Models

Electroencephalography (EEG) foundation models have shown promise for learning generalizable representations, yet they remain sensitive to channel heterogeneity, such as changes in channel composition or ordering. We propose channel-aware multimodal EEG-text alignment contrastive language-image pretraining (CAMEL-CLIP), a contrastive EEG-text multimodal foundation model designed to be robust to heterogeneous channel configurations and widely applicable to diverse downstream tasks. CAMEL-CLIP introduces three key components: (1) channel attribute-based positional encoding, which identifies channels through semantic information; (2) dynamic channel projection, which generates variable-length embeddings by independently projecting each channel without feature compression; and (3) dual-level contrastive learning, which jointly performs channel-level and sample-level contrastive learning to capture both channel-specific and global signal characteristics. Experimental results demonstrate that CAMEL-CLIP achieves state-of-the-art performance under linear-probing and outperforms existing foundation models that rely on full-finetuning.

cs.LG

Mol-AIR: Molecular Reinforcement Learning with Adaptive Intrinsic Rewards for Goal-directed Molecular Generation

Optimizing techniques for discovering molecular structures with desired properties is crucial in artificial intelligence(AI)-based drug discovery. Combining deep generative models with reinforcement learning has emerged as an effective strategy for generating molecules with specific properties. Despite its potential, this approach is ineffective in exploring the vast chemical space and optimizing particular chemical properties. To overcome these limitations, we present Mol-AIR, a reinforcement learning-based framework using adaptive intrinsic rewards for effective goal-directed molecular generation. Mol-AIR leverages the strengths of both history-based and learning-based intrinsic rewards by exploiting random distillation network and counting-based strategies. In benchmark tests, Mol-AIR demonstrates superior performance over existing approaches in generating molecules with desired properties without any prior knowledge, including penalized LogP, QED, and celecoxib similarity. We believe that Mol-AIR represents a significant advancement in drug discovery, offering a more efficient path to discovering novel therapeutics.

cs.LG

Filippov trajectories and clustering in the Kuramoto model with singular couplings

We study the synchronization of a generalized Kuramoto system in which the coupling weights are determined by the phase differences between oscillators. We employ the fast-learning regime in a Hebbian-like plasticity rule so that the interaction between oscillators is enhanced by the approach of phases. First, we study the well-posedness problem for the singular weighted Kuramoto systems in which the Lipschitz continuity is deprived. We present the dynamics of the system equipped with singular weights in all the subcritical, critical and supercritical regimes of the singularity. A key fact is that solutions in the most singular cases must be considered in Filippov's sense. We characterize sticking of phases in the subcritical and critical case and we exhibit a continuation criterion of classical solutions after any collision state in the supercritical regime. Second, we prove that strong solutions to these systems of differential inclusions can be recovered as singular limits of regular weights. We also provide the emergence of synchronous dynamics for the singular and regular weighted Kuramoto models.

math.AP

Emergence of phase concentration for the Kuramoto-Sakaguchi equation

We study the asymptotic phase concentration phenomena for the Kuramoto-Sakaguchi(K-S) equation in a large coupling strength regime. For this, we analyze the detailed dynamics of the order parameters such as the amplitude and the average phase. For the infinite ensemble of oscillators with the identical natural frequency, we show that the total mass distribution concentrates on the average phase asymptotically, whereas the mass around the antipodal point of the average phase decays to zero exponentially fast in any positive coupling strength regime. Thus, generic initial kinetic densities evolve toward the Dirac measure concentrated on the average phase. In contrast, for the infinite ensemble with distributed natural frequencies, we find a certain time-dependent interval whose length can be explicitly quantified in terms of the coupling strength. Provided that the coupling strength is sufficiently large, the mass on such an interval is eventually non-decreasing over the time. We also show that the amplitude order parameter has a positive lower bound that depends on the size of support of the distribution function for the natural frequencies and the coupling strength. The proposed asymptotic lower bound on the order parameter tends to unity, as the coupling strength increases to infinity. This is reminiscent of practical synchronization for the Kuramoto model, in which the diameter for the phase configuration is inversely proportional to the coupling strength. Our results for the K-S equation generalize the results in [19] on the emergence of phase-locked states for the Kuramoto model in a large coupling strength regime.

math.AP