arXiv subjects

Tao Meng

Publications and source records attributed to Tao Meng.

At least 55 records · Page 3Linked to original sources

arXiv2024

Revisiting Multi-modal Emotion Learning with Broad State Space Models and Probability-guidance Fusion

Multi-modal Emotion Recognition in Conversation (MERC) has received considerable attention in various fields, e.g., human-computer interaction and recommendation systems. Most existing works perform feature disentanglement and fusion to extract emotional contextual information from multi-modal features and emotion classification. After revisiting the characteristic of MERC, we argue that long-range contextual semantic information should be extracted in the feature disentanglement stage and the inter-modal semantic information consistency should be maximized in the feature fusion stage. Inspired by recent State Space Models (SSMs), Mamba can efficiently model long-distance dependencies. Therefore, in this work, we fully consider the above insights to further improve the performance of MERC. Specifically, on the one hand, in the feature disentanglement stage, we propose a Broad Mamba, which does not rely on a self-attention mechanism for sequence modeling, but uses state space models to compress emotional representation, and utilizes broad learning systems to explore the potential data distribution in broad space. Different from previous SSMs, we design a bidirectional SSM convolution to extract global context information. On the other hand, we design a multi-modal fusion strategy based on probability guidance to maximize the consistency of information between modalities. Experimental results show that the proposed method can overcome the computational and memory limitations of Transformer when modeling long-distance contexts, and has great potential to become a next-generation general architecture in MERC.

cs.CL↗

arXiv2024

Revisiting Multimodal Emotion Recognition in Conversation from the Perspective of Graph Spectrum

Efficiently capturing consistent and complementary semantic features in a multimodal conversation context is crucial for Multimodal Emotion Recognition in Conversation (MERC). Existing methods mainly use graph structures to model dialogue context semantic dependencies and employ Graph Neural Networks (GNN) to capture multimodal semantic features for emotion recognition. However, these methods are limited by some inherent characteristics of GNN, such as over-smoothing and low-pass filtering, resulting in the inability to learn long-distance consistency information and complementary information efficiently. Since consistency and complementarity information correspond to low-frequency and high-frequency information, respectively, this paper revisits the problem of multimodal emotion recognition in conversation from the perspective of the graph spectrum. Specifically, we propose a Graph-Spectrum-based Multimodal Consistency and Complementary collaborative learning framework GS-MCC. First, GS-MCC uses a sliding window to construct a multimodal interaction graph to model conversational relationships and uses efficient Fourier graph operators to extract long-distance high-frequency and low-frequency information, respectively. Then, GS-MCC uses contrastive learning to construct self-supervised signals that reflect complementarity and consistent semantic collaboration with high and low-frequency signals, thereby improving the ability of high and low-frequency information to reflect real emotions. Finally, GS-MCC inputs the collaborative high and low-frequency information into the MLP network and softmax function for emotion prediction. Extensive experiments have proven the superiority of the GS-MCC architecture proposed in this paper on two benchmark data sets.

cs.CL↗

arXiv2024

An Effective Index for Truss-based Community Search on Large Directed Graphs

Community search is a derivative of community detection that enables online and personalized discovery of communities and has found extensive applications in massive real-world networks. Recently, there needs to be more focus on the community search issue within directed graphs, even though substantial research has been carried out on undirected graphs. The recently proposed D-truss model has achieved good results in the quality of retrieved communities. However, existing D-truss-based work cannot perform efficient community searches on large graphs because it consumes too many computing resources to retrieve the maximal D-truss. To overcome this issue, we introduce an innovative merge relation known as D-truss-connected to capture the inherent density and cohesiveness of edges within D-truss. This relation allows us to partition all the edges in the original graph into a series of D-truss-connected classes. Then, we construct a concise and compact index, ConDTruss, based on D-truss-connected. Using ConDTruss, the efficiency of maximum D-truss retrieval will be greatly improved, making it a theoretically optimal approach. Experimental evaluations conducted on large directed graph certificate the effectiveness of our proposed method.

cs.SI↗

arXiv2024

Fast Butterfly-Core Community Search For Large Labeled Graphs

Community Search (CS) aims to identify densely interconnected subgraphs corresponding to query vertices within a graph. However, existing heterogeneous graph-based community search methods need help identifying cross-group communities and suffer from efficiency issues, making them unsuitable for large graphs. This paper presents a fast community search model based on the Butterfly-Core Community (BCC) structure for heterogeneous graphs. The Random Walk with Restart (RWR) algorithm and butterfly degree comprehensively evaluate the importance of vertices within communities, allowing leader vertices to be rapidly updated to maintain cross-group cohesion. Moreover, we devised a more efficient method for updating vertex distances, which minimizes vertex visits and enhances operational efficiency. Extensive experiments on several real-world temporal graphs demonstrate the effectiveness and efficiency of this solution.

cs.SI↗

arXiv2024

Deciphering Interphase Instability of Lithium Metal Batteries with Localized High-Concentration Electrolytes at Elevated Temperatures

Lithium metal batteries (LMBs), when coupled with a localized high-concentration electrolyte and a high-voltage nickel-rich cathode, offer a solution to the increasing demand for high energy density and long cycle life. However, the aggressive electrode chemistry poses safety risks to LMBs at higher temperatures and cutoff voltages. Here, we decipher the interphase instability in LHCE-based LMBs with a Ni0.8Co0.1Mn0.1O2 cathode at elevated temperatures. Our findings reveal that the generation of fluorine radicals in the electrolyte induces the solvent decomposition and consequent chain reactions, thereby reconstructing the cathode electrolyte interphase (CEI) and degrading battery cyclability. As further evidenced, introducing an acid scavenger of dimethoxydimethylsilane (DODSi) significantly boosts CEI stability with suppressed microcracking. A Ni0.8Co0.1Mn0.1O2||Li cell with this DODSi-functionalized LHCE achieves an unprecedented capacity retention of 93.0% after 100 cycles at 80 °C. This research provides insights into electrolyte engineering for practical LMBs with high safety under extreme temperatures.

cond-mat.mtrl-sci↗

arXiv2024

A Two-Stage Multimodal Emotion Recognition Model Based on Graph Contrastive Learning

In terms of human-computer interaction, it is becoming more and more important to correctly understand the user's emotional state in a conversation, so the task of multimodal emotion recognition (MER) started to receive more attention. However, existing emotion classification methods usually perform classification only once. Sentences are likely to be misclassified in a single round of classification. Previous work usually ignores the similarities and differences between different morphological features in the fusion process. To address the above issues, we propose a two-stage emotion recognition model based on graph contrastive learning (TS-GCL). First, we encode the original dataset with different preprocessing modalities. Second, a graph contrastive learning (GCL) strategy is introduced for these three modal data with other structures to learn similarities and differences within and between modalities. Finally, we use MLP twice to achieve the final emotion classification. This staged classification method can help the model to better focus on different levels of emotional information, thereby improving the performance of the model. Extensive experiments show that TS-GCL has superior performance on IEMOCAP and MELD datasets compared with previous methods.

cs.CL↗

arXiv2023

Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversations

The main task of Multimodal Emotion Recognition in Conversations (MERC) is to identify the emotions in modalities, e.g., text, audio, image and video, which is a significant development direction for realizing machine intelligence. However, many data in MERC naturally exhibit an imbalanced distribution of emotion categories, and researchers ignore the negative impact of imbalanced data on emotion recognition. To tackle this problem, we systematically analyze it from three aspects: data augmentation, loss sensitivity, and sampling strategy, and propose the Class Boundary Enhanced Representation Learning (CBERL) model. Concretely, we first design a multimodal generative adversarial network to address the imbalanced distribution of {emotion} categories in raw data. Secondly, a deep joint variational autoencoder is proposed to fuse complementary semantic information across modalities and obtain discriminative feature representations. Finally, we implement a multi-task graph neural network with mask reconstruction and classification optimization to solve the problem of overfitting and underfitting in class boundary learning, and achieve cross-modal emotion recognition. We have conducted extensive experiments on the IEMOCAP and MELD benchmark datasets, and the results show that CBERL has achieved a certain performance improvement in the effectiveness of emotion recognition. Especially on the minority class fear and disgust emotion labels, our model improves the accuracy and F1 value by 10% to 20%.

cs.SD↗

arXiv2023

Adaptive Reduced-Attitude Control for Spacecraft Boresight Alignment with Safety Constraints and Accuracy Requirements

This paper investigates the boresight alignment control problem under safety constraints and performance requirements, involving pointing-forbidden constraint, attitude angular velocity limitation, and pointing accuracy requirement. Meanwhile, the parameter uncertainty issue is taken into account simultaneously. To address this problem, we propose a modified composite framework integrating the Artificial Potential Field (APF) methodology and the Prescribed Performance Control (PPC) scheme. The APF scheme ensures safety, while the PPC scheme is employed to realize an accuracy-guaranteed control. A Switched Prescribed Performance Function (SPPF) is proposed to facilitate the integration, which monitors various constraints and further establishes compatibility between safety and performance concerns by leveraging a special PPC freezing mechanism. To further address the parameter uncertainty, we introduce the Immersion-and-Invariance (I\&I) adaptive control technique to derive an adaptive APF-PPC composite controller, further guaranteeing the closed-loop system's asymptotic convergence. Finally, numerical simulations are carried out to validate the effectiveness of the proposed scheme.

eess.SY↗

arXiv2023

Safety Guaranteed Control for Spacecraft Inspection Mission

This paper investigates the safety guaranteed problem in spacecraft inspection missions, considering multiple position obstacles and logical attitude forbidden zones. In order to address this issue, we propose a control strategy based on control barrier functions, summarized as "safety check on kinematics" and "velocity tracking on dynamics" approach. The proposed approach employs control barrier functions to describe the obstacles and to generate safe velocities via the solution of a quadratic programming problem. Subsequently, we design a proportional-like controller based on the generated velocity, which, despite its simplicity, can ensure safety even in the presence of velocity tracking errors. The stability and safety of the system are rigorously analyzed in this paper. Furthermore, to account for model uncertainties and external disturbances, we incorporate an immersion and invariance-based disturbance observer in our design. Finally, numerical simulations are performed to demonstrate the effectiveness of the proposed control strategy.

eess.SY↗

arXiv2023

Adaptive Compatible Performance Control for Spacecraft Attitude Control under Motion Constraints with Guaranteed Accuracy

This paper focuses on the problem of spacecraft attitude control in the presence of time-varying parameter uncertainties and multiple constraints, accounting for angular velocity limitation, performance requirements, and input saturation. To tackle this problem, we propose a modified framework called Compatible Performance Control (CPC), which integrates the Prescribed Performance Control (PPC) scheme with a contradiction detection and alleviation strategy. Firstly, by introducing the Zeroing Barrier Function (ZBF) concept, we propose a detection strategy to yield judgment on the compatibility between the angular velocity constraint and the performance envelope constraint. Subsequently, we propose a projection operator-governed dynamical system with a varying upper bound to generate an appropriate bounded performance envelope-modification signal if a contradiction exists, thereby alleviating the contradiction and promoting compatibility within the system. Next, a dynamical filter technique is introduced to construct a bounded reference velocity signal to address the angular velocity limitation. Furthermore, we employ a time-varying gain technique to address the challenge posed by time-varying parameter uncertainties, further developing an adaptive strategy that exhibits robustness on disturbance rejection. By utilizing the proposed CPC scheme and time-varying gain adaptive strategy, we construct an adaptive CPC controller, which guarantees the ultimate boundedness of the system, and all constraints are satisfied simultaneously during the whole control process. Finally, numerical simulation results are presented to show the effectiveness of the proposed framework.

eess.SY↗

arXiv2023

Composite Triggered Intermittent Control for Constrained Spacecraft Attitude Tracking

This paper focuses on the spacecraft attitude control problem with intermittent actuator activation, taking into account the attitude rotation rate limitation and input saturation issue simultaneously. To address this problem, we first propose a composite event-trigger mechanism, which composed of two state-dependent trigger that governing the activation and deactivation of actuators. Subsequently, by introducing the cascaded decomposition of Backstepping control philosophy, the designed trigger mechanism is then applied to the decomposed dynamical subsystem, providing a layered intermittent stabilization strategy. Further, the basic intermittent attitude controller is extended to a "constrained version" by introducing a strictly bounded virtual control law and an input saturation compensation auxiliary system. By analyzing the local boundedness of the system on each inter-event time interval, a uniformly, strictly decreasing upper boundary of the lumped system is further characterized, thereby completing the proof of the system's uniformly ultimately boundedness (UUB). Finally, numerical simulation results are illustrated to demonstrate the effectiveness of the proposed scheme.

eess.SY↗

arXiv2022

Event-Triggered Intermittent Prescribed Performance Control for Spacecraft Attitude Reorientation

This paper focuses on the issue of how to realize spacecraft attitude control with guaranteed performance while conspicuously reducing the actuator acting frequency simultaneously. The prescribed performance control (PPC) scheme is often employed for the control with guaranteed performance. However, conventional PPC controllers are designed from the perspective of continuous system, which contradicts the "discrete" control logic in actual spacecraft control system, and such a problem limited the application value of PPC scheme in actual applications. In order to significantly lower the actuator acting frequency while still maintaining the desired performance, a composite event-trigger mechanism is proposed for this issue, turning off the actuator and eliminating unnecessary control output under appropriate conditions. Further, the proposed composite event-trigger mechanism is combined with a prescribed performance control scheme, constructing a complete controller structure for solving the presented issue. Meanwhile, a special performance function is designed to provide mild transition process. Based on the proposed scheme, a specific backstepping controller is further developed as a validation. Finally, numerical simulation results are presented to validate the effectiveness of the proposed scheme.

eess.SY↗

arXiv2022

Controllable Text Generation with Neurally-Decomposed Oracle

We propose a general and efficient framework to control auto-regressive generation models with NeurAlly-Decomposed Oracle (NADO). Given a pre-trained base language model and a sequence-level boolean oracle function, we propose to decompose the oracle function into token-level guidance to steer the base model in text generation. Specifically, the token-level guidance is approximated by a neural model trained with examples sampled from the base model, demanding no additional auxiliary labeled data. Based on posterior regularization, we present the closed-form optimal solution to incorporate the token-level guidance into the base model for controllable generation. We further provide a theoretical analysis of how the approximation quality of NADO affects the controllable generation results. Experiments conducted on two applications: (1) text generation with lexical constraints and (2) machine translation with formality control demonstrate that our framework efficiently guides the base model towards the given oracle while maintaining high generation quality.

cs.CL↗

arXiv2022

InsNet: An Efficient, Flexible, and Performant Insertion-based Text Generation Model

We propose InsNet, an expressive insertion-based text generator with efficient training and flexible decoding (parallel or sequential). Unlike most existing insertion-based text generation works that require re-encoding of the context after each insertion operation and thus are inefficient to train, InsNet only requires one pass of context encoding for the entire sequence during training by introducing a novel insertion-oriented position encoding and a light-weighted slot representation strategy to enable computation sharing. Furthermore, we propose an algorithm InsNet-Dinic to better determine the parallelization of insertion operations that provides a controllable switch between parallel and sequential decoding, making it flexible to handle more parallelizable tasks such as machine translation with efficient decoding, or less parallelizable tasks such as open-domain text generation to guarantee high-quality outputs. Experiments on two lexically constrained text generation datasets and three machine translation datasets demonstrate InsNet's advantages over previous insertion-based methods in terms of training speed, inference efficiency, and generation quality.

cs.CL↗

arXiv2022

Robust Control For Spacecraft Attitude Tracking Under Multiple Physical Limitations with Guaranteed Performance

This paper considers the prescribed performance control (PPC) of spacecraft attitude tracking under multiple physical constraints, focusing on the robust issues. A novel Barrier Lyapunov function is proposed to realize the guaranteed-performance control under angular velocity constraint without singularity. Additionally, an adaptive strategy for the performance function is presented to soften the constraint and quickly re-stabilize the system after severe disturbances occur, providing strong robustness. Further, an auxiliary system is designed to handle the input saturation issue, incorporating the actuator limitation into the system. Based on the proposed structure, a backstepping controller is developed accordingly using a double-layer PPC framework. Numerical simulation results are presented to validate the proposed controller framework's efficiency and robustness.8 pa

eess.SY↗

arXiv2022

Spacecraft Attitude Pointing Control under Pointing Forbidden Constraints with Guaranteed Accuracy

This paper focuses on the attitude pointing control problem under pointing-forbidden constraints and performance constraints. The spacecraft is expected to align its sensor's boresight to a desired direction, while the terminal control accuracy and the attitude adjustment rapidity should also be guaranteed simultaneously. To resolve this problem, a switching controller structure is proposed in this paper based on the reduced-attitude representation, fusing the artificial potential field (APF) methodology and the Prescribed Performance Control (PPC) scheme together. Firstly, a novel artificial potential field is presented, and a particular function is designed for the mollification of the switching process, aiming at providing a smooth transition for the system status. Subsequently, we propose a special performance function, which can freeze the PPC part when necessary. In this way, the intrinsic contradictory between the fast attitude maneuver and forbidden direction avoidance is tackled Further, an asynchronous switching strategy is designed, guarantees the system's stability. Based on these proposed issues, a switching backstepping controller is developed, and a tracking differentiator(TD) is employed to generate a smooth approximation of differential signals. Numerical simulation results are illustrated to show the effectiveness of the proposed scheme.

eess.SY↗

arXiv2022

Singularity-Avoidance Prescribed Performance Attitude Tracking of Spacecraft

The attitude tracking problem with preassigned performance requirements has earned tremendous interest in recent years, and the Prescribed Performance Control (PPC) scheme is often adopted to tackle this problem. Nevertheless, traditional PPC schemes have inherent problems, which the solution still lacks, such as the singularity problem when the state constraint is violated and the potential over-control problem when the state trajectory approaches the constraint boundary. This paper proposes a Singularity-Avoidance Prescribed Performance Control scheme (SAPPC) to deal with these problems. A novel shear mapping-based error transformation is proposed to provide a globally non-singular error transformation procedure, while a time-varying constraint boundary is employed to exert appropriate constraint strength at different control stages, alleviating the potential instability caused by the over-control problem. Besides, a novel piece-wise reference performance function (RPF) is constructed to provide a relevant reference trajectory for the state responding signals, allowing precise control of the system's responding behavior. Based on the proposed SAPPC scheme, a backstepping controller is developed, with the predefined-time stability technique and the dynamic surface control technique employed to enhance the controller's robustness and performance. Finally, theoretical analysis and numerical simulation results are presented to validate the proposed control scheme's effectiveness and robustness.

eess.SY↗

arXiv2022

On the Paradox of Learning to Reason from Data

Logical reasoning is needed in a wide range of NLP tasks. Can a BERT model be trained end-to-end to solve logical reasoning problems presented in natural language? We attempt to answer this question in a confined problem space where there exists a set of parameters that perfectly simulates logical reasoning. We make observations that seem to contradict each other: BERT attains near-perfect accuracy on in-distribution test examples while failing to generalize to other data distributions over the exact same problem space. Our study provides an explanation for this paradox: instead of learning to emulate the correct reasoning function, BERT has in fact learned statistical features that inherently exist in logical reasoning problems. We also show that it is infeasible to jointly remove statistical features from data, illustrating the difficulty of learning to reason in general. Our result naturally extends to other neural models and unveils the fundamental difference between learning to reason and learning to achieve high performance on NLP benchmarks using statistical features.

cs.CL↗