SearcharxivSearch

arXiv subjects

Yi-Kun Tang

Publications and source records attributed to Yi-Kun Tang.

4 recordsLinked to original sources

PA-RNet: Perturbation-Aware Residual Network for Robust Multimodal Time Series Forecasting

In real-world applications, multimodal time-series forecasting faces a key challenge: textual information is often useful but unreliable. Auxiliary texts may contain irrelevant, ambiguous, incomplete, or structurally corrupted content, making direct text integration prone to introducing noisy semantic signals and degrading forecasting performance. Therefore, robust multimodal forecasting requires a model that can exploit useful textual context while suppressing misleading perturbations. To address this challenge, we propose PA-RNet, a carefully designed perturbation-aware residual network for robust multimodal time-series forecasting. Rather than directly fusing textual and numerical representations, PA-RNet first refines multimodal features in a perturbation-aware manner, preserving stable contextual information while reducing unstable or misleading signals. The refined textual representations are then aligned with temporal dynamics, enabling more reliable forecasting under noisy multimodal conditions. Theoretically, we prove that PA-RNet is Lipschitz continuous with respect to textual embeddings and show that the proposed spectral residual correction can reduce the expected prediction error under zero-mean textual perturbations. We further conduct supplementary experiments with injected textual perturbations to examine the robustness of PA-RNet. The results across diverse domains demonstrate that PA-RNet consistently outperforms state-of-the-art baselines and maintains stable forecasting performance under both original and noise-perturbed textual conditions.

cs.LG

Tag Recommendation by Word-Level Tag Sequence Modeling

In this paper, we transform tag recommendation into a word-based text generation problem and introduce a sequence-to-sequence model. The model inherits the advantages of LSTM-based encoder for sequential modeling and attention-based decoder with local positional encodings for learning relations globally. Experimental results on Zhihu datasets illustrate the proposed model outperforms other state-of-the-art text classification based methods.

cs.CL

Neural Chinese Word Segmentation as Sequence to Sequence Translation

Recently, Chinese word segmentation (CWS) methods using neural networks have made impressive progress. Most of them regard the CWS as a sequence labeling problem which construct models based on local features rather than considering global information of input sequence. In this paper, we cast the CWS as a sequence translation problem and propose a novel sequence-to-sequence CWS model with an attention-based encoder-decoder framework. The model captures the global information from the input and directly outputs the segmented sequence. It can also tackle other NLP tasks with CWS jointly in an end-to-end mode. Experiments on Weibo, PKU and MSRA benchmark datasets show that our approach has achieved competitive performances compared with state-of-the-art methods. Meanwhile, we successfully applied our proposed model to jointly learning CWS and Chinese spelling correction, which demonstrates its applicability of multi-task fusion.

cs.CL

Conceptualization Topic Modeling

Recently, topic modeling has been widely used to discover the abstract topics in text corpora. Most of the existing topic models are based on the assumption of three-layer hierarchical Bayesian structure, i.e. each document is modeled as a probability distribution over topics, and each topic is a probability distribution over words. However, the assumption is not optimal. Intuitively, it's more reasonable to assume that each topic is a probability distribution over concepts, and then each concept is a probability distribution over words, i.e. adding a latent concept layer between topic layer and word layer in traditional three-layer assumption. In this paper, we verify the proposed assumption by incorporating the new assumption in two representative topic models, and obtain two novel topic models. Extensive experiments were conducted among the proposed models and corresponding baselines, and the results show that the proposed models significantly outperform the baselines in terms of case study and perplexity, which means the new assumption is more reasonable than traditional one.

cs.CL