arXiv subjects

Ye Liu

Publications and source records attributed to Ye Liu.

At least 145 records · Page 8Linked to original sources

arXiv2023

Just Noticeable Visual Redundancy Forecasting: A Deep Multimodal-driven Approach

Just noticeable difference (JND) refers to the maximum visual change that human eyes cannot perceive, and it has a wide range of applications in multimedia systems. However, most existing JND approaches only focus on a single modality, and rarely consider the complementary effects of multimodal information. In this article, we investigate the JND modeling from an end-to-end homologous multimodal perspective, namely hmJND-Net. Specifically, we explore three important visually sensitive modalities, including saliency, depth, and segmentation. To better utilize homologous multimodal information, we establish an effective fusion method via summation enhancement and subtractive offset, and align homologous multimodal features based on a self-attention driven encoder-decoder paradigm. Extensive experimental results on eight different benchmark datasets validate the superiority of our hmJND-Net over eight representative methods.

cs.CV↗

arXiv2023

Locating the Sources of Sub-synchronous Oscillations Induced by the Control of Voltage Source Converters Based on Energy Structure and Nonlinearity Detection

The oscillation phenomena associated with the control of voltage source converters (VSCs) are widely concerning, and locating the source of these oscillations is crucial to suppressing them; therefore, this paper presents a locating scheme, based on the energy structure and nonlinearity detection. On the one hand, the energy structure, which conforms with the principle of the energy-based method and dissipativity theory, is constructed to describe the transient energy flow for VSCs, and on this basis, a defined characteristic quantity is implemented to narrow the scope of oscillation source location; on the other hand, according to the self-sustained oscillation characteristics of VSCs, an index for nonlinearity detection is applied to locate the VSCs which produce the oscillation energy. The combination of the energy structure and nonlinearity detection could distinguish the contributions of different VSCs to the oscillation. The results of a case study implemented by the PSCAD/EMTDC simulation validate the proposed scheme.

eess.SY↗

arXiv2023

Holonomy Lie algebra of a geometric lattice

Motivated by Kohno's result on the holonomy Lie algebra of a hyperplane arrangement, we define the holonomy Lie algebra of a finite geometric lattice in a combinatorial way. For a solvable pair of lattices, we show that the holonomy Lie algebra is an almost-direct product of the holonomy Lie algebra of the sublattice and a free Lie subalgebra. This yields the structure of the holonomy Lie algebra of a finite hypersolvable (including supersolvable) lattice. As applications, we obtain the structure of the holonomy Lie algebra of (the Salvetti complex of) a supersolvable oriented matroid, and that of a hypersolvable arrangement.

math.GT↗

arXiv2022

Data-driven Emergency Frequency Control for Multi-Infeed Hybrid AC-DC System

With the continuous development of large-scale complex hybrid AC-DC grids, the fast adjustability of HVDC systems is required by the grid to provide frequency regulation services. This paper develops a fully data-driven linear quadratic regulator (LQR) for the HVDC to provide temporal frequency support. The main technical challenge is the complexity and the nonlinearity of multi-infeed hybrid AC-DC (MIDC) systems dynamics that make the LQR intractable. Based on Koopman operator (KO) theory, a Koopman eigenpairs construction method is developed to fit a global linear dynamic model of MIDC systems. Once globally linear representation of uncontrolled system dynamics is obtained offline, the control term is constituted by the gradient of the identified eigenfunctions and the control matrix $\mathbf{B}$. In case that $\mathbf{B}$ is unknown, we propose a method to identify it based on the verified Koopman eigenfunctions. The active power reference is optimized online for LCC-HVDC in a moving horizon fashion to provide frequency support, with only local frequency and transmission power measurements. The robustness of the proposed control method against approximation errors of the linear representation in eigenfunction coordinates is analyzed. Simulation results show the effectiveness, robustness and adaptability of the proposed emergency control strategy.

eess.SY↗

arXiv2022

Equivalent Inertia Provided by Droop Control of Fast Frequency Regulation Resources

Conventional inertia control strategies (i.e., the VSG-based and PD-based strategies) for the fast frequency regulation resources (FFRs) might lead to system oscillations due to their emulations of generator dynamics. The only-droop-based inertia control strategy is a feasible idea to address this issue. This letter quantitatively investigates the equivalent inertia provided by the droop control of the FFRs. First, an equivalent-scenario-based method is proposed to evaluate the equivalent inertia provided by the droop control, which shows that the droop control with a constant droop coefficient provides time-variant equivalent inertia. Then, the time-variant-droop-based equivalent inertia control (VDIC) strategy is proposed for the FFRs, which can provide the required constant inertia support without introducing generator-like dynamics. A case study verifies the effectiveness of the VDIC strategy.

eess.SY↗

arXiv2022

A Dynamic Equivalent Method for PMSG-WTG Based Wind Farms Considering wind Speeds and Fault Severities

The dynamic security assessment of power systems needs to scan contingencies in a preselected set through time-domain simulations. With more and more inverter-based-generation, such as wind and solar power generation, integrated into power systems, electro-magnetic transient simulation is adopted. However, the complexity of simulation will increase greatly if inverter-based-generation units are modeled in detail. In order to reduce the complexity of simulation of power systems including large-scale wind farms, it is critical to develop dynamic equivalent methods for wind farms which are applicable to the expected contingency analysis. The dynamic response characteristics of permanent magnet synchronous generator-wind turbine generators (PMSG-WTGs) are not only influenced by their control strategies, but also by the operating wind speeds and the fault severities. Thus, this paper proposes a dynamic equivalent method for PMSG-WTG based wind farms considering the wind speeds and the fault severities. Firstly, this paper analyzes all possible response characteristics of a PMSG-WTG and proposes a clustering method based on the operating wind speed and the terminal voltage of each PMSG-WTG at the end of the fault. Then, a single-machine equivalent method is introduced for each group of PMSG-WTGs. For the group of PMSG-WTGs with active power ramp recovery process, an equivalent model with segmented ramp rate limitation for active current is designed. In order to obtain the clustering indicators, a simulation-based iterative method is put forward to calculate the voltage at point of common connection (PCC) of the wind farm, and a PMSG-WTG terminal voltage calculation method is further presented. Eventually, the efficiency and accuracy of the proposed method are verified by the simulation results.

eess.SY↗

arXiv2022

Enhanced sensing of optomechanically induced nonlinearity by linewidth suppression and optical bistability in cavity-waveguide systems

We study enhanced sensing of optomechanically induced nonlinearity (OMIN) in a cavity-waveguide coupled system. The Hamiltonian of the system is anti-PT symmetric with the two involved cavities being dissipatively coupled via the waveguide. When a weak waveguide-mediated coherent coupling is introduced, the anti-PT symmetry may break down. However, we find a strong bistable response of the cavity intensity to the OMIN near the cavity resonance, benefiting from linewidth suppression caused by the vacuum induced coherence. The joint effect of optical bistability and the linewidth suppression is inaccessible by the anti-PT symmetric system involving only dissipative coupling. Due to that, the sensitivity is greatly enhanced by two orders of magnitude compared to that for the anti-PT symmetric model. Moreover, the sensitivity shows resistances to a reasonably large cavity decay and robustness to fluctuations in the cavity-waveguide detuning. Based on the integrated optomechanical cavity-waveguide systems, the scheme can be used for sensing different physical quantities related to the single-photon coupling strength, and has potential applications in high-precision measurements with physical systems involving Kerr-type nonlinearity.

quant-ph↗

arXiv2022

Grafting Pre-trained Models for Multimodal Headline Generation

Multimodal headline utilizes both video frames and transcripts to generate the natural language title of the videos. Due to a lack of large-scale, manually annotated data, the task of annotating grounded headlines for video is labor intensive and impractical. Previous researches on pre-trained language models and video-language models have achieved significant progress in related downstream tasks. However, none of them can be directly applied to multimodal headline architecture where we need both multimodal encoder and sentence decoder. A major challenge in simply gluing language model and video-language model is the modality balance, which is aimed at combining visual-language complementary abilities. In this paper, we propose a novel approach to graft the video encoder from the pre-trained video-language model on the generative pre-trained language model. We also present a consensus fusion mechanism for the integration of different components, via inter/intra modality relation. Empirically, experiments show that the grafted model achieves strong results on a brand-new dataset collected from real-world applications.

cs.CV↗

arXiv2022

Unsupervised Extractive Summarization with Heterogeneous Graph Embeddings for Chinese Document

In the scenario of unsupervised extractive summarization, learning high-quality sentence representations is essential to select salient sentences from the input document. Previous studies focus more on employing statistical approaches or pre-trained language models (PLMs) to extract sentence embeddings, while ignoring the rich information inherent in the heterogeneous types of interaction between words and sentences. In this paper, we are the first to propose an unsupervised extractive summarizaiton method with heterogeneous graph embeddings (HGEs) for Chinese document. A heterogeneous text graph is constructed to capture different granularities of interactions by incorporating graph structural information. Moreover, our proposed graph is general and flexible where additional nodes such as keywords can be easily integrated. Experimental results demonstrate that our method consistently outperforms the strong baseline in three summarization datasets.

cs.CL↗

arXiv2022

Uni-Parser: Unified Semantic Parser for Question Answering on Knowledge Base and Database

Parsing natural language questions into executable logical forms is a useful and interpretable way to perform question answering on structured data such as knowledge bases (KB) or databases (DB). However, existing approaches on semantic parsing cannot adapt to both modalities, as they suffer from the exponential growth of the logical form candidates and can hardly generalize to unseen data. In this work, we propose Uni-Parser, a unified semantic parser for question answering (QA) on both KB and DB. We introduce the primitive (relation and entity in KB, and table name, column name and cell value in DB) as an essential element in our framework. The number of primitives grows linearly with the number of retrieved relations in KB and DB, preventing us from dealing with exponential logic form candidates. We leverage the generator to predict final logical forms by altering and composing topranked primitives with different operations (e.g. select, where, count). With sufficiently pruned search space by a contrastive primitive ranker, the generator is empowered to capture the composition of primitives enhancing its generalization ability. We achieve competitive results on multiple KB and DB QA benchmarks more efficiently, especially in the compositional and zero-shot settings.

cs.CL↗

arXiv2022

Distributed Emergency Frequency Control Considering Transient Stability Constraints in Multi-Infeed Hybrid AC-DC System

Due to possible emergency faults and frequency regulation reserve shortage in the multi-infeed hybrid AC-DC (MIDC) system, the emergency frequency control (EFC) with LCC-HVDC systems participating is important for system frequency stability. Nevertheless, the existing decentralized EFC strategies cannot guarantee the transient stability constraints of lines and cannot meet the frequency restoration requirement. To fill this gap, this paper proposes a complementary distributed EFC strategy. By selecting the semi-distributed or fully-distributed control law according to the state of AC system control center, the proposed distributed EFC can improve the control performance with a normal control center and enhance the control reliability in case of control center failure. Then, to derive the semi-distributed and fully-distributed control laws, a general design method is proposed by formulating an optimal EFC problem. Both of these two control laws can guarantee transient stability constraints, restore system frequency and achieve the defined optimal control objective. Moreover, the optimality of the closed-loop equilibrium is proven, and a Lyapunov analysis shows the asymptotic stability of the closed-loop system with the discontinuous control dynamics. A case study verifies the effectiveness of the proposed distributed EFC strategy.

eess.SY↗

arXiv2022

ConceptNet infused DialoGPT for Underlying Commonsense Understanding and Reasoning in Dialogue Response Generation

The pre-trained conversational models still fail to capture the implicit commonsense (CS) knowledge hidden in the dialogue interaction, even though they were pre-trained with an enormous dataset. In order to build a dialogue agent with CS capability, we firstly inject external knowledge into a pre-trained conversational model to establish basic commonsense through efficient Adapter tuning (Section 4). Secondly, we propose the ``two-way learning'' method to enable the bidirectional relationship between CS knowledge and sentence pairs so that the model can generate a sentence given the CS triplets, also generate the underlying CS knowledge given a sentence (Section 5). Finally, we leverage this integrated CS capability to improve open-domain dialogue response generation so that the dialogue agent is capable of understanding the CS knowledge hidden in dialogue history on top of inferring related other knowledge to further guide response generation (Section 6). The experiment results demonstrate that CS\_Adapter fusion helps DialoGPT to be able to generate series of CS knowledge. And the DialoGPT+CS\_Adapter response model adapted from CommonGen training can generate underlying CS triplets that fits better to dialogue context.

cs.CL↗

arXiv2022

OS-MSL: One Stage Multimodal Sequential Link Framework for Scene Segmentation and Classification

Scene segmentation and classification (SSC) serve as a critical step towards the field of video structuring analysis. Intuitively, jointly learning of these two tasks can promote each other by sharing common information. However, scene segmentation concerns more on the local difference between adjacent shots while classification needs the global representation of scene segments, which probably leads to the model dominated by one of the two tasks in the training phase. In this paper, from an alternate perspective to overcome the above challenges, we unite these two tasks into one task by a new form of predicting shots link: a link connects two adjacent shots, indicating that they belong to the same scene or category. To the end, we propose a general One Stage Multimodal Sequential Link Framework (OS-MSL) to both distinguish and leverage the two-fold semantics by reforming the two learning tasks into a unified one. Furthermore, we tailor a specific module called DiffCorrNet to explicitly extract the information of differences and correlations among shots. Extensive experiments on a brand-new large scale dataset collected from real-world applications, and MovieScenes are conducted. Both the results demonstrate the effectiveness of our proposed method against strong baselines.

cs.CV↗

arXiv2022

Contrastive Graph Multimodal Model for Text Classification in Videos

The extraction of text information in videos serves as a critical step towards semantic understanding of videos. It usually involved in two steps: (1) text recognition and (2) text classification. To localize texts in videos, we can resort to large numbers of text recognition methods based on OCR technology. However, to our knowledge, there is no existing work focused on the second step of video text classification, which will limit the guidance to downstream tasks such as video indexing and browsing. In this paper, we are the first to address this new task of video text classification by fusing multimodal information to deal with the challenging scenario where different types of video texts may be confused with various colors, unknown fonts and complex layouts. In addition, we tailor a specific module called CorrelationNet to reinforce feature representation by explicitly extracting layout information. Furthermore, contrastive learning is utilized to explore inherent connections between samples using plentiful unlabeled videos. Finally, we construct a new well-defined industrial dataset from the news domain, called TI-News, which is dedicated to building and evaluating video text recognition and classification applications. Extensive experiments on TI-News demonstrate the effectiveness of our method.

cs.CV↗

arXiv2022

Incentive Mechanism Design for Emergency Frequency Control in Multi-Infeed Hybrid AC-DC System

In multi-infeed hybrid AC-DC (MIDC) systems, the emergency frequency control (EFC) with LCC-HVDC systems participating is of vital importance for system frequency stability. Nevertheless, when regional power systems are operated by different decision-makers, the LCC-HVDC systems and their connected AC systems might be unwilling to participate in the EFC due to the costs and losses. In this paper, to incentivize the LCC-HVDC systems and their connected adjacent AC systems to participate in the droop-based EFC, a novel control-parameter-based incentive mechanism is proposed, which can deal with various possible emergency frequency faults. Then, a non-cooperative-based incentive game model is formulated to implement the incentive mechanism in the MIDC system. An algorithm for seeking the Nash equilibrium is designed, and the uniqueness of Nash equilibrium is proven. Moreover, the individual rationality, incentive compatibility and social optimality of the proposed mechanism are analyzed and proven. The effectiveness of the proposed incentive mechanism is verified through a case study.

eess.SY↗

arXiv2022

Fast Parallel Hypertree Decompositions in Logarithmic Recursion Depth

Modern trends in data collection are bringing current mainstream techniques for database query processing to their limits. Consequently, various novel approaches for efficient query processing are being actively studied. One such approach is based on hypertree decompositions (HDs), which have been shown to carry great potential to process complex queries more efficiently and with stronger theoretical guarantees. However, using HDs for query execution relies on the difficult task of computing decompositions of the query structure, which guides the efficient execution of the query. From theoretical results we know that the performance of purely sequential methods is inherently limited, yet the problem is susceptible to parallelisation. In this paper we propose the first algorithm for computing hypertree decompositions that is well-suited for parallelisation. The proposed algorithm log-k-decomp requires only a logarithmic number of recursion levels and additionally allows for highly parallelised pruning of the search space by restriction to balanced separators. We provide detailed experimental evaluation over the HyperBench benchmark and demonstrate that our approach is highly effective especially for complex queries.

cs.DB↗

arXiv2022

Are Pretrained Transformers Robust in Intent Classification? A Missing Ingredient in Evaluation of Out-of-Scope Intent Detection

Pre-trained Transformer-based models were reported to be robust in intent classification. In this work, we first point out the importance of in-domain out-of-scope detection in few-shot intent recognition tasks and then illustrate the vulnerability of pre-trained Transformer-based models against samples that are in-domain but out-of-scope (ID-OOS). We construct two new datasets, and empirically show that pre-trained models do not perform well on both ID-OOS examples and general out-of-scope examples, especially on fine-grained few-shot intent detection tasks. To figure out how the models mistakenly classify ID-OOS intents as in-scope intents, we further conduct analysis on confidence scores and the overlapping keywords, as well as point out several prospective directions for future work. Resources are available on https://github.com/jianguoz/Few-Shot-Intent-Detection.

cs.CL↗

arXiv2022

Practical Evaluation of Adversarial Robustness via Adaptive Auto Attack

Defense models against adversarial attacks have grown significantly, but the lack of practical evaluation methods has hindered progress. Evaluation can be defined as looking for defense models' lower bound of robustness given a budget number of iterations and a test dataset. A practical evaluation method should be convenient (i.e., parameter-free), efficient (i.e., fewer iterations) and reliable (i.e., approaching the lower bound of robustness). Towards this target, we propose a parameter-free Adaptive Auto Attack (A$^3$) evaluation method which addresses the efficiency and reliability in a test-time-training fashion. Specifically, by observing that adversarial examples to a specific defense model follow some regularities in their starting points, we design an Adaptive Direction Initialization strategy to speed up the evaluation. Furthermore, to approach the lower bound of robustness under the budget number of iterations, we propose an online statistics-based discarding strategy that automatically identifies and abandons hard-to-attack images. Extensive experiments demonstrate the effectiveness of our A$^3$. Particularly, we apply A$^3$ to nearly 50 widely-used defense models. By consuming much fewer iterations than existing methods, i.e., $1/10$ on average (10$\times$ speed up), we achieve lower robust accuracy in all cases. Notably, we won $\textbf{first place}$ out of 1681 teams in CVPR 2021 White-box Adversarial Attacks on Defense Models competitions with this method. Code is available at: $\href{https://github.com/liuye6666/adaptive_auto_attack}{https://github.com/liuye6666/adaptive\_auto\_attack}$

cs.CV↗