arXiv subjects

Ruiqi Li

Publications and source records attributed to Ruiqi Li.

At least 55 records · Page 3Linked to original sources

arXiv2024

FAITH: Frequency-domain Attention In Two Horizons for Time Series Forecasting

Time Series Forecasting plays a crucial role in various fields such as industrial equipment maintenance, meteorology, energy consumption, traffic flow and financial investment. However, despite their considerable advantages over traditional statistical approaches, current deep learning-based predictive models often exhibit a significant deviation between their forecasting outcomes and the ground truth. This discrepancy is largely due to an insufficient emphasis on extracting the sequence's latent information, particularly its global information within the frequency domain and the relationship between different variables. To address this issue, we propose a novel model Frequency-domain Attention In Two Horizons, which decomposes time series into trend and seasonal components using a multi-scale sequence adaptive decomposition and fusion architecture, and processes them separately. FAITH utilizes Frequency Channel feature Extraction Module and Frequency Temporal feature Extraction Module to capture inter-channel relationships and temporal global information in the sequence, significantly improving its ability to handle long-term dependencies and complex patterns. Furthermore, FAITH achieves theoretically linear complexity by modifying the time-frequency domain transformation method, effectively reducing computational costs. Extensive experiments on 6 benchmarks for long-term forecasting and 3 benchmarks for short-term forecasting demonstrate that FAITH outperforms existing models in many fields, such as electricity, weather and traffic, proving its effectiveness and superiority both in long-term and short-term time series forecasting tasks. Our codes and data are available at https://github.com/LRQ577/FAITH.

cs.LG↗

arXiv2024

Self-Supervised Singing Voice Pre-Training towards Speech-to-Singing Conversion

Speech-to-singing voice conversion (STS) task always suffers from data scarcity, because it requires paired speech and singing data. Compounding this issue are the challenges of content-pitch alignment and the suboptimal quality of generated outputs, presenting significant hurdles in STS research. This paper presents SVPT, an STS approach boosted by a self-supervised singing voice pre-training model. We leverage spoken language model techniques to tackle the rhythm alignment problem and the in-context learning capability to achieve zero-shot conversion. We adopt discrete-unit random resampling and pitch corruption strategies, enabling training with unpaired singing data and thus mitigating the issue of data scarcity. SVPT also serves as an effective backbone for singing voice synthesis (SVS), offering insights into scaling up SVS models. Experimental results indicate that SVPT delivers notable improvements in both STS and SVS endeavors. Audio samples are available at https://speech2sing.github.io.

eess.AS↗

arXiv2024

Robust Singing Voice Transcription Serves Synthesis

Note-level Automatic Singing Voice Transcription (AST) converts singing recordings into note sequences, facilitating the automatic annotation of singing datasets for Singing Voice Synthesis (SVS) applications. Current AST methods, however, struggle with accuracy and robustness when used for practical annotation. This paper presents ROSVOT, the first robust AST model that serves SVS, incorporating a multi-scale framework that effectively captures coarse-grained note information and ensures fine-grained frame-level segmentation, coupled with an attention-based pitch decoder for reliable pitch prediction. We also established a comprehensive annotation-and-training pipeline for SVS to test the model in real-world settings. Experimental findings reveal that ROSVOT achieves state-of-the-art transcription accuracy with either clean or noisy inputs. Moreover, when trained on enlarged, automatically annotated datasets, the SVS model outperforms its baseline, affirming the capability for practical application. Audio samples are available at https://rosvot.github.io.

eess.AS↗

arXiv2024

Text-to-Song: Towards Controllable Music Generation Incorporating Vocals and Accompaniment

A song is a combination of singing voice and accompaniment. However, existing works focus on singing voice synthesis and music generation independently. Little attention was paid to explore song synthesis. In this work, we propose a novel task called text-to-song synthesis which incorporating both vocals and accompaniments generation. We develop Melodist, a two-stage text-to-song method that consists of singing voice synthesis (SVS) and vocal-to-accompaniment (V2A) synthesis. Melodist leverages tri-tower contrastive pretraining to learn more effective text representation for controllable V2A synthesis. A Chinese song dataset mined from a music website is built up to alleviate data scarcity for our research. The evaluation results on our dataset demonstrate that Melodist can synthesize songs with comparable quality and style consistency. Audio samples can be found in https://text2songMelodist.github.io/Sample/.

eess.AS↗

arXiv2024

Local dominance unveils clusters in networks

Clusters or communities can provide a coarse-grained description of complex systems at multiple scales, but their detection remains challenging in practice. Community detection methods often define communities as dense subgraphs, or subgraphs with few connections in-between, via concepts such as the cut, conductance, or modularity. Here we consider another perspective built on the notion of local dominance, where low-degree nodes are assigned to the basin of influence of high-degree nodes, and design an efficient algorithm based on local information. Local dominance gives rises to community centers, and uncovers local hierarchies in the network. Community centers have a larger degree than their neighbors and are sufficiently distant from other centers. The strength of our framework is demonstrated on synthesized and empirical networks with ground-truth community labels. The notion of local dominance and the associated asymmetric relations between nodes are not restricted to community detection, and can be utilised in clustering problems, as we illustrate on networks derived from vector data.

physics.soc-ph↗

arXiv2023

Zero-shot Medical Image Translation via Frequency-Guided Diffusion Models

Recently, the diffusion model has emerged as a superior generative model that can produce high quality and realistic images. However, for medical image translation, the existing diffusion models are deficient in accurately retaining structural information since the structure details of source domain images are lost during the forward diffusion process and cannot be fully recovered through learned reverse diffusion, while the integrity of anatomical structures is extremely important in medical images. For instance, errors in image translation may distort, shift, or even remove structures and tumors, leading to incorrect diagnosis and inadequate treatments. Training and conditioning diffusion models using paired source and target images with matching anatomy can help. However, such paired data are very difficult and costly to obtain, and may also reduce the robustness of the developed model to out-of-distribution testing data. We propose a frequency-guided diffusion model (FGDM) that employs frequency-domain filters to guide the diffusion model for structure-preserving image translation. Based on its design, FGDM allows zero-shot learning, as it can be trained solely on the data from the target domain, and used directly for source-to-target domain translation without any exposure to the source-domain data during training. We evaluated it on three cone-beam CT (CBCT)-to-CT translation tasks for different anatomical sites, and a cross-institutional MR imaging translation task. FGDM outperformed the state-of-the-art methods (GAN-based, VAE-based, and diffusion-based) in metrics of Frechet Inception Distance (FID), Peak Signal-to-Noise Ratio (PSNR), and Structural Similarity Index Measure (SSIM), showing its significant advantages in zero-shot medical image translation.

eess.IV↗

arXiv2023

When Do Discourse Markers Affect Computational Sentence Understanding?

The capabilities and use cases of automatic natural language processing (NLP) have grown significantly over the last few years. While much work has been devoted to understanding how humans deal with discourse connectives, this phenomenon is understudied in computational systems. Therefore, it is important to put NLP models under the microscope and examine whether they can adequately comprehend, process, and reason within the complexity of natural language. In this chapter, we introduce the main mechanisms behind automatic sentence processing systems step by step and then focus on evaluating discourse connective processing. We assess nine popular systems in their ability to understand English discourse connectives and analyze how context and language understanding tasks affect their connective comprehension. The results show that NLP systems do not process all discourse connectives equally well and that the computational processing complexity of different connective kinds is not always consistently in line with the presumed complexity order found in human processing. In addition, while humans are more inclined to be influenced during the reading procedure but not necessarily in the final comprehension performance, discourse connectives have a significant impact on the final accuracy of NLP systems. The richer knowledge of connectives a system learns, the more negative effect inappropriate connectives have on it. This suggests that the correct explicitation of discourse connectives is important for computational natural language processing.

cs.CL↗

arXiv2023

DisCover: Disentangled Music Representation Learning for Cover Song Identification

In the field of music information retrieval (MIR), cover song identification (CSI) is a challenging task that aims to identify cover versions of a query song from a massive collection. Existing works still suffer from high intra-song variances and inter-song correlations, due to the entangled nature of version-specific and version-invariant factors in their modeling. In this work, we set the goal of disentangling version-specific and version-invariant factors, which could make it easier for the model to learn invariant music representations for unseen query songs. We analyze the CSI task in a disentanglement view with the causal graph technique, and identify the intra-version and inter-version effects biasing the invariant learning. To block these effects, we propose the disentangled music representation learning framework (DisCover) for CSI. DisCover consists of two critical components: (1) Knowledge-guided Disentanglement Module (KDM) and (2) Gradient-based Adversarial Disentanglement Module (GADM), which block intra-version and inter-version biased effects, respectively. KDM minimizes the mutual information between the learned representations and version-variant factors that are identified with prior domain knowledge. GADM identifies version-variant factors by simulating the representation transitions between intra-song versions, and exploits adversarial distillation for effect blocking. Extensive comparisons with best-performing methods and in-depth analysis demonstrate the effectiveness of DisCover and the and necessity of disentanglement for CSI.

cs.IR↗

arXiv2023

Automated Action Model Acquisition from Narrative Texts

Action models, which take the form of precondition/effect axioms, facilitate causal and motivational connections between actions for AI agents. Action model acquisition has been identified as a bottleneck in the application of planning technology, especially within narrative planning. Acquiring action models from narrative texts in an automated way is essential, but challenging because of the inherent complexities of such texts. We present NaRuto, a system that extracts structured events from narrative text and subsequently generates planning-language-style action models based on predictions of commonsense event relations, as well as textual contradictions and similarities, in an unsupervised manner. Experimental results in classical narrative planning domains show that NaRuto can generate action models of significantly better quality than existing fully automated methods, and even on par with those of semi-automated methods.

cs.CL↗

arXiv2023

AlignSTS: Speech-to-Singing Conversion via Cross-Modal Alignment

The speech-to-singing (STS) voice conversion task aims to generate singing samples corresponding to speech recordings while facing a major challenge: the alignment between the target (singing) pitch contour and the source (speech) content is difficult to learn in a text-free situation. This paper proposes AlignSTS, an STS model based on explicit cross-modal alignment, which views speech variance such as pitch and content as different modalities. Inspired by the mechanism of how humans will sing the lyrics to the melody, AlignSTS: 1) adopts a novel rhythm adaptor to predict the target rhythm representation to bridge the modality gap between content and pitch, where the rhythm representation is computed in a simple yet effective way and is quantized into a discrete space; and 2) uses the predicted rhythm representation to re-align the content based on cross-attention and conducts a cross-modal fusion for re-synthesize. Extensive experiments show that AlignSTS achieves superior performance in terms of both objective and subjective metrics. Audio samples are available at https://alignsts.github.io.

eess.AS↗

arXiv2023

The evolution of k-shell in syndication networks reveals financial performance of venture capital institutions

Venture capital (VC) is a relatively newly emergent industry that is still subject to large uncertainties in China. Therefore, building a robust social network with other VC institutions is a good way to share information, various resources, and benefit from skill and knowledge complementarity to against risks. Strong evidences indicate that better networked VC institutions are of a better financial performance, however, most of previous works overlook the evolution of VC institutions and only focus on some simple topology indicators of the static syndication network, which also neglects higher-order network structure and cannot give a comprehensive evaluation. In this paper, based on VC investment records in the Chinese market, we construct temporal syndication networks between VC institutions year by year. As k-shell decomposition considers higher-order connection patterns, we employ k-shell as an evaluation of the influence of VC institutions in syndication networks. By clustering time series of k-shell values, the VC institutions in China fall into five groups that are quite different from each other on financial performances and investment behaviors. This, in turn, proves the power of our method that only based on proper sequential network properties, we can reveal their financial investment performance. Compared to other network centrality measurements, k-shell is a better indicator that is indicated by a smaller intra-group distance and a larger inter-group distance.

physics.soc-ph↗

arXiv2023

EDeR: A Dataset for Exploring Dependency Relations Between Events

Relation extraction is a central task in natural language processing (NLP) and information retrieval (IR) research. We argue that an important type of relation not explored in NLP or IR research to date is that of an event being an argument - required or optional - of another event. We introduce the human-annotated Event Dependency Relation dataset (EDeR) which provides this dependency relation. The annotation is done on a sample of documents from the OntoNotes dataset, which has the added benefit that it integrates with existing, orthogonal, annotations of this dataset. We investigate baseline approaches for predicting the event dependency relation, the best of which achieves an accuracy of 82.61 for binary argument/non-argument classification. We show that recognizing this relation leads to more accurate event extraction (semantic role labelling) and can improve downstream tasks that depend on this, such as co-reference resolution. Furthermore, we demonstrate that predicting the three-way classification into the required argument, optional argument or non-argument is a more challenging task.

cs.CL↗

arXiv2022

Effects of syndication network on specialisation and performance of venture capital firms

The Chinese venture capital (VC) market is a young and rapidly expanding financial subsector. Gaining a deeper understanding of the investment behaviours of VC firms is crucial for the development of a more sustainable and healthier market and economy. Contrasting evidence supports that either specialisation or diversification helps to achieve a better investment performance. However, the impact of the syndication network is overlooked. Syndication network has a great influence on the propagation of information and trust. By exploiting an authoritative VC dataset of thirty-five-year investment information in China, we construct a joint-investment network of VC firms and analyse the effects of syndication and diversification on specialisation and investment performance. There is a clear correlation between the syndication network degree and specialisation level of VC firms, which implies that the well-connected VC firms are diversified. More connections generally bring about more information or other resources, and VC firms are more likely to enter a new stage or industry with some new co-investing VC firms when compared to a randomised null model. Moreover, autocorrelation analysis of both specialisation and success rate on the syndication network indicates that clustering of similar VC firms is roughly limited to the secondary neighbourhood. When analysing local clustering patterns, we discover that, contrary to popular beliefs, there is no apparent successful club of investors. In contrast, investors with low success rates are more likely to cluster. Our discoveries enrich the understanding of VC investment behaviours and can assist policymakers in designing better strategies to promote the development of the VC industry.

physics.soc-ph↗

arXiv2022

Data-Driven Model Predictive Control for Linear Time-Periodic Systems

We consider the problem of data-driven predictive control for an unknown discrete-time linear time-periodic (LTP) system of known period. Our proposed strategy generalizes both Data-enabled Predictive Control (DeePC) and Subspace Predictive Control (SPC), which are established data-driven control techniques for linear time-invariant (LTI) systems. The approach is supported by an extensive theoretical development of behavioral systems theory for LTP systems, culminating in a generalization of the fundamental lemma. Our algorithm produces results identical to standard Model Predictive Control (MPC) for deterministic LTP systems. Robustness of the algorithm to noisy data is illustrated via simulation of a regularized version of the algorithm applied to a stochastic multi-input multi-output LTP system.

eess.SY↗

arXiv2022

Revealing spatio-temporal interaction patterns behind complex cities

Cities are typical dynamic complex systems that connect people and facilitate interactions. Revealing universal collective patterns behind spatio-temporal interactions between residents is crucial for various urban studies, of which we are still lacking a comprehensive understanding. Massive cellphone data enable us to construct interaction networks based on spatio-temporal co-occurrence of individuals. The rank-size distributions of hourly dynamic population of locations are stable, although people are almost constantly moving in cities and hotspots that attract people are changing over time in a day. A larger city is of a stronger heterogeneity as indicated by a larger scaling exponent. After aggregating spatio-temporal interaction networks over consecutive time windows, we reveal a switching behavior of cities between two states. During the "active" state, the whole city is concentrated in fewer larger communities; while in the "sleeping" state, people are scattered in more smaller communities. Above discoveries are universal over diversified cities across continents. In addition, a city sleeps less, when its population grows larger. And spatio-temporal interaction segregation can be well approximated by residential segregation in smaller cities, but not in larger ones. We propose a temporal-population-weighted-opportunity model by integrating time-dependent departure probability to make dynamic predictions on human mobility, which can reasonably well explain observed patterns of spatio-temporal interactions in cities.

physics.soc-ph↗

arXiv2022

Understanding urban congestion with biking traffic and routing detour ratio

Bike-sharing systems have been regarded as a critical component of solutions towards the transition to greener and more sustainable transportation, with the benefits of reducing carbon emissions, improving public health, and mitigating congestion by replacing short-distance motorized trips. Due to better accessibility and usage flexibility, newly emergent dockless sharing bikes have become quite popular and are reviving the fashion of cycling in cities. Urban congestion is simultaneously influenced by heterogeneous saptio-temporal travel demands, topology and spatial characteristics of road networks, and the interplay between travel modes. In this paper, by considering aforementioned factors, we discover a robust sublinear scaling relation between the level of congestion for vehicles and the detour ratio weighted by biking traffic, which is intriguing given the fact that congestion and detour ratio is linearly independent. Such a scaling relation implies a strong interplay between vehicle traffic and cycling activities and can be applied in predictions for congestion or aggregated to more sophisticated traffic models. In addition, biking-traffic-weighted detour ratio can be applied to detect inefficient routes, which would help alleviate urban congestion, make better urban planning, and improve transportation efficiency and equity in cities.

physics.soc-ph↗

arXiv2022

Quantifying relation between mobility patterns and socioeconomic status of dockless sharing-bike users

Bikes are among the healthiest, greenest, and most affordable means of transportation for a better future city, but mobility patterns of riders with different income were rarely studied due to limitations on collecting data. Newly emergent dockless bike-sharing platforms that record detailed information regarding each trip provide us a unique opportunity. Attribute to its better usage flexibility and accessibility, dockless bike-sharing platforms are booming over the past a few years worldwide and reviving the riding fashion in cities. In this work, by exploiting massive riding records in two megacities from a dockless bike-sharing platform, we reveal that individual mobility patterns, including radius of gyration and average travel distance, are similar among users with different income, which indicates that human beings all follow similar physical rules. However, collective mobility patterns, including average range and diversity of visitation, and commuting directions, all exhibit different behaviors and spatial patterns across income categories. Hotspot locations that attract more cycling activities are quite different over groups, and locations where users reside are of a low user ratio for both higher and lower income groups. Lower income groups are inclined to visit less flourishing locations, and commute towards the direction to the city center in both cities, and of a smaller mobility diversity in Beijing but a larger diversity in Shanghai. In addition, differences on mobility patterns among socioeconomic categories are more evident in Beijing than in Shanghai. Our findings would be helpful on designing better promotion strategies for dockless bike-sharing platforms and towards the transition to a more sustainable green transportation.

physics.soc-ph↗

arXiv2022

Emergence of scaling in dockless bike-sharing systems

Fundamental laws of human mobility have been extensively studied, yet we are still lacking a comprehensive understanding of the mobility patterns of sharing conveyances. Since travellers would highly probably no longer possess their own conveyances in the near future, the interplay between travellers and sharing bikes is a central question for developing more sustainable transportation. Dockless bike-sharing systems that record detailed information of every trip provide us a unique opportunity for revealing the hidden patterns behind riding activities. By treating each bike as an individual entity, we reveal that distributions of mobility indicators of bikes are quite different from humans; and mobility patterns are even inconsistent across cities. All above discrepancies can be well explained by a choice model that is characterized by a universal scaling. Our model unveils that instead of choosing among the newest bikes, the distribution of rank values of selected bikes on usage condition manifests a truncated power-law and is quite stable across several cities despite various diversities. Our framework would have broad implications in sharing economy and contribute towards developing a greener, healthier, and more sustainable future city.

physics.soc-ph↗