arXiv subjects

Xiao Xu

Publications and source records attributed to Xiao Xu.

At least 73 records · Page 4Linked to original sources

arXiv2024

Vacancy enhanced cation ordering enables >15% efficiency in Kesterite solar cells

Atomic disorder, a widespread problem in compound crystalline materials, is a imperative affecting the performance of multi-chalcogenide Cu2ZnSn(S, Se)4 (CZTSSe) photovoltaic device known for its low cost and environmental friendliness. Cu-Zn disorder is particularly abundantly present in CZTSSe due to its extraordinarily low formation energy, having induced high-concentration deep defects and severe charge loss, while its regulation remains challenging due to the contradiction between disorder-order phase transition thermodynamics and atom-interchange kinetics. Herein, through introducing more vacancies in the CZTSSe surface, we explored a vacancy-assisted strategy to reduce the atom-interchange barrier limit to facilitate the Cu-Zn ordering kinetic process. The improvement in the Cu-Zn order degree has significantly reduced the charge loss in the device and helped us realize 15.4% (certified at 14.9%) and 13.5% efficiency (certified at 13.3%) in 0.27 cm2 and 1.1 cm2-area CZTSSe solar cells, respectively, thus bringing substantial advancement for emerging inorganic thin-film photovoltaics.

cond-mat.mtrl-sci↗

arXiv2024

Gradient bandgap enables >13% efficiency sulfide Kesterite solar cells with open-circuit voltage over 800 mV

Sulfide Kesterite Cu2ZnSnS4 (CZTS), a nontoxic and low-cost photovoltaic material, has always being facing severe charge recombination and poor carrier transport, resulting in the cell efficiency record stagnating around 11% for years. Gradient bandgap is a promising approach to relieve these issues, however, has not been effectively realized in Kesterite solar cells due to the challenges in controlling the gradient distribution of alloying elements at high temperatures. Herein, targeting at the Cd alloyed CZTS, we propose a pre-crystallization strategy to reduce the intense vertical mass transport and Cd rapid diffusion in the film growth process, thereby realizing front Cd-gradient CZTS absorber. The Cd-gradient CZTS absorber, exhibiting downward bending conduction band structure, has significantly enhanced the minority carrier transport and additionally improved band alignment and interface property of CZTS/CdS heterojunction. Ultimately, we have achieved a champion total-area efficiency of 13.5% (active-area efficiency: 14.1%) in the cell and in particular a high open-circuit voltage of >800 mV. We have also achieved a certified total-area cell efficiency of 13.16%, realizing a substantial step forward for the pure sulfide Kesterite solar cell.

cond-mat.mtrl-sci↗

arXiv2024

BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning

Vision-Language (VL) models with the Two-Tower architecture have dominated visual-language representation learning in recent years. Current VL models either use lightweight uni-modal encoders and learn to extract, align and fuse both modalities simultaneously in a deep cross-modal encoder, or feed the last-layer uni-modal representations from the deep pre-trained uni-modal encoders into the top cross-modal encoder. Both approaches potentially restrict vision-language representation learning and limit model performance. In this paper, we propose BridgeTower, which introduces multiple bridge layers that build a connection between the top layers of uni-modal encoders and each layer of the cross-modal encoder. This enables effective bottom-up cross-modal alignment and fusion between visual and textual representations of different semantic levels of pre-trained uni-modal encoders in the cross-modal encoder. Pre-trained with only 4M images, BridgeTower achieves state-of-the-art performance on various downstream vision-language tasks. In particular, on the VQAv2 test-std set, BridgeTower achieves an accuracy of 78.73%, outperforming the previous state-of-the-art model METER by 1.09% with the same pre-training data and almost negligible additional parameters and computational costs. Notably, when further scaling the model, BridgeTower achieves an accuracy of 81.15%, surpassing models that are pre-trained on orders-of-magnitude larger datasets. Code and checkpoints are available at https://github.com/microsoft/BridgeTower.

cs.CV↗

arXiv2024

Pro-HAN: A Heterogeneous Graph Attention Network for Profile-Based Spoken Language Understanding

Recently, Profile-based Spoken Language Understanding (SLU) has gained increasing attention, which aims to incorporate various types of supplementary profile information (i.e., Knowledge Graph, User Profile, Context Awareness) to eliminate the prevalent ambiguities in user utterances. However, existing approaches can only separately model different profile information, without considering their interrelationships or excluding irrelevant and conflicting information within them. To address the above issues, we introduce a Heterogeneous Graph Attention Network to perform reasoning across multiple Profile information, called Pro-HAN. Specifically, we design three types of edges, denoted as intra-Pro, inter-Pro, and utterance-Pro, to capture interrelationships among multiple Pros. We establish a new state-of-the-art on the ProSLU dataset, with an improvement of approximately 8% across all three metrics. Further analysis experiments also confirm the effectiveness of our method in modeling multi-source profile information.

cs.CL↗

arXiv2024

T2MAC: Targeted and Trusted Multi-Agent Communication through Selective Engagement and Evidence-Driven Integration

Communication stands as a potent mechanism to harmonize the behaviors of multiple agents. However, existing works primarily concentrate on broadcast communication, which not only lacks practicality, but also leads to information redundancy. This surplus, one-fits-all information could adversely impact the communication efficiency. Furthermore, existing works often resort to basic mechanisms to integrate observed and received information, impairing the learning process. To tackle these difficulties, we propose Targeted and Trusted Multi-Agent Communication (T2MAC), a straightforward yet effective method that enables agents to learn selective engagement and evidence-driven integration. With T2MAC, agents have the capability to craft individualized messages, pinpoint ideal communication windows, and engage with reliable partners, thereby refining communication efficiency. Following the reception of messages, the agents integrate information observed and received from different sources at an evidence level. This process enables agents to collectively use evidence garnered from multiple perspectives, fostering trusted and cooperative behaviors. We evaluate our method on a diverse set of cooperative multi-agent tasks, with varying difficulties, involving different scales and ranging from Hallway, MPE to SMAC. The experiments indicate that the proposed model not only surpasses the state-of-the-art methods in terms of cooperative performance and communication efficiency, but also exhibits impressive generalization.

cs.MA↗

arXiv2024

Semantic-Guided Generative Image Augmentation Method with Diffusion Models for Image Classification

Existing image augmentation methods consist of two categories: perturbation-based methods and generative methods. Perturbation-based methods apply pre-defined perturbations to augment an original image, but only locally vary the image, thus lacking image diversity. In contrast, generative methods bring more image diversity in the augmented images but may not preserve semantic consistency, thus incorrectly changing the essential semantics of the original image. To balance image diversity and semantic consistency in augmented images, we propose SGID, a Semantic-guided Generative Image augmentation method with Diffusion models for image classification. Specifically, SGID employs diffusion models to generate augmented images with good image diversity. More importantly, SGID takes image labels and captions as guidance to maintain semantic consistency between the augmented and original images. Experimental results show that SGID outperforms the best augmentation baseline by 1.72% on ResNet-50 (from scratch), 0.33% on ViT (ImageNet-21k), and 0.14% on CLIP-ViT (LAION-2B). Moreover, SGID can be combined with other image augmentation baselines and further improves the overall performance. We demonstrate the semantic consistency and image diversity of SGID through quantitative human and automated evaluations, as well as qualitative case studies.

cs.CV↗

arXiv2024

Incorporating Feature Signal Transmission with Block-based Haptic Data Reduction for Time-delayed Teleoperation

This paper presents an innovative feature signal transmission approach incorpo-rating block-based haptic data reduction to address time-delayed teleoperation. Numerous data reduction techniques rely on perceptual deadband (DB). In the preceding block-based approaches, the whole block within the DB is discarded. However, disregarding all signals within the DB loses too much information and hinders effective haptic signal tracking, as these signals contain valuable infor-mation for signal reconstruction. Consequently, we propose a feature signal transmission approach based on the block algorithm that aggregates samples as a unit, enabling high-quality haptic data reduction. In our proposed approach, we employ max-pooling to extract feature signals from the signals within the DB. These feature signals are then transmitted by adjusting the content of the trans-mission block. This methodology enables the transmission of more useful infor-mation without introducing additional delay, aside from the inherent algorithmic delay. Experimental results demonstrate the superiority of our approach over oth-er state-of-the-art (SOTA) methods on various assessment measures under dis-tinct channel delays.

cs.HC↗

arXiv2023

Unsupervised Social Event Detection via Hybrid Graph Contrastive Learning and Reinforced Incremental Clustering

Detecting events from social media data streams is gradually attracting researchers. The innate challenge for detecting events is to extract discriminative information from social media data thereby assigning the data into different events. Due to the excessive diversity and high updating frequency of social data, using supervised approaches to detect events from social messages is hardly achieved. To this end, recent works explore learning discriminative information from social messages by leveraging graph contrastive learning (GCL) and embedding clustering in an unsupervised manner. However, two intrinsic issues exist in benchmark methods: conventional GCL can only roughly explore partial attributes, thereby insufficiently learning the discriminative information of social messages; for benchmark methods, the learned embeddings are clustered in the latent space by taking advantage of certain specific prior knowledge, which conflicts with the principle of unsupervised learning paradigm. In this paper, we propose a novel unsupervised social media event detection method via hybrid graph contrastive learning and reinforced incremental clustering (HCRC), which uses hybrid graph contrastive learning to comprehensively learn semantic and structural discriminative information from social messages and reinforced incremental clustering to perform efficient clustering in a solidly unsupervised manner. We conduct comprehensive experiments to evaluate HCRC on the Twitter and Maven datasets. The experimental results demonstrate that our approach yields consistent significant performance boosts. In traditional incremental setting, semi-supervised incremental setting and solidly unsupervised setting, the model performance has achieved maximum improvements of 53%, 45%, and 37%, respectively.

cs.SI↗

arXiv2023

A Novel Deep Clustering Framework for Fine-Scale Parcellation of Amygdala Using dMRI Tractography

The amygdala plays a vital role in emotional processing and exhibits structural diversity that necessitates fine-scale parcellation for a comprehensive understanding of its anatomico-functional correlations. Diffusion MRI tractography is an advanced imaging technique that can estimate the brain's white matter structural connectivity to potentially reveal the topography of the amygdala for studying its subdivisions. In this work, we present a deep clustering pipeline to perform automated, fine-scale parcellation of the amygdala using diffusion MRI tractography. First, we incorporate a newly proposed deep learning approach to enable accurate segmentation of the amygdala directly on the dMRI data. Next, we design a novel streamline clustering-based structural connectivity feature for a robust representation of voxels within the amygdala. Finally, we improve the popular joint dimensionality reduction and k-means clustering approach to enable amygdala parcellation at a finer scale. With the proposed method, we obtain nine unique amygdala parcels. Experiments show that these parcels can be consistently identified across subjects and have good correspondence to the widely used coarse-scale amygdala parcellation.

eess.IV↗

arXiv2023

Defect Regulation by Palladium Incorporation towards Grain Boundaries of Kesterite solar cells

Kesterite Cu2ZnSn(S, Se)4 (CZTSSe) solar cell has emerged as one of the most promising candidates for thin-film photovoltaics. However, severe charge losses occurring at the grain boundaries (GBs) of Kesterite polycrystalline absorbers has hindered the improvement of cell performance. Herein, we report a redox reaction strategy involving palladium (Pd) to eliminate atomic vacancy defects such as VSn and VSe in GBs of the Kesterite absorbers. We demonstrate that PdSex compounds could form during the selenization process and distribute at the GBs and the absorber surfaces; thereby aid in the suppression of Sn and Se volatilization loss and inhibiting the formation of VSn and VSe defects. Furthermore, Pd(II)/Pd(IV) serves as a redox shuttle, i.e., on one hand, Pd(II) captures Se vapor from the reaction environment to produce PdSe2, on the other hand, PdSe2 provides Se atoms to the Kesterite absorber by being reduced to PdSe, thus contributing to the elimination of pre-existing VSe defects within GBs. These effects collectively reduce defects and enhance the p-type characteristics of the Kesterite absorber, leading to a significant reduction in charge recombination loss within the cell. As a result, high-performance Kesterite solar cells with a total-area efficiency of 14.5% have been achieved. This remarkable efficiency increase benefited from the redox reaction strategy offers a promising avenue for the precise regulation of defects in Kesterite solar cells and holds generally significant implications for the exploration of various other photovoltaic devices.

cond-mat.mtrl-sci↗

arXiv2023

Attention-Based Acoustic Feature Fusion Network for Depression Detection

Depression, a common mental disorder, significantly influences individuals and imposes considerable societal impacts. The complexity and heterogeneity of the disorder necessitate prompt and effective detection, which nonetheless, poses a difficult challenge. This situation highlights an urgent requirement for improved detection methods. Exploiting auditory data through advanced machine learning paradigms presents promising research directions. Yet, existing techniques mainly rely on single-dimensional feature models, potentially neglecting the abundance of information hidden in various speech characteristics. To rectify this, we present the novel Attention-Based Acoustic Feature Fusion Network (ABAFnet) for depression detection. ABAFnet combines four different acoustic features into a comprehensive deep learning model, thereby effectively integrating and blending multi-tiered features. We present a novel weight adjustment module for late fusion that boosts performance by efficaciously synthesizing these features. The effectiveness of our approach is confirmed via extensive validation on two clinical speech databases, CNRAC and CS-NRAC, thereby outperforming previous methods in depression detection and subtype classification. Further in-depth analysis confirms the key role of each feature and highlights the importance of MFCCrelated features in speech-based depression detection.

cs.SD↗

arXiv2023

Multinary Alloying Suppresses Defect Formation in Emerging Inorganic Solar Cells

The Cu2ZnSn(S, Se)4 (CZTSSe) emerging inorganic solar cell is highly promising for accelerating the large-scale and low-cost applications of thin-film photovoltaics. It possesses distinct advantages such as abundant and non-toxic constituent elements, high material stability, and excellent compatibility with industrial processes. However, CZTSSe solar cells still face challenges related to complex defects and charge losses. To overcome these limitations and improve the efficiency of CZTSSe solar cells, it is crucial to experimentally identify and mitigate deep defects. In this study, we reveal that the dominant deep defect in CZTSSe materials exhibits donor characteristics. We propose that incomplete cation exchange during the multi-step crystallization reactions of CZTSSe is the kinetics mechanism responsible for the defect formation. To address this issue, we introduce an elemental synergistic alloying approach aimed at weakening the metal-chalcogen bond strength and the stability of intermediate phases. This alloying strategy has facilitated the kinetics of cation exchange, leading to a significant reduction in charge losses within the CZTSSe absorber. As a result, we have achieved a cell efficiency of over 14.5%. These results represent a significant advancement for emerging inorganic solar cells and additionally bring more opportunities for the precise identification and regulation of defects in a wider range of multinary inorganic compounds.

cond-mat.mtrl-sci↗

arXiv2023

ManagerTower: Aggregating the Insights of Uni-Modal Experts for Vision-Language Representation Learning

Two-Tower Vision-Language (VL) models have shown promising improvements on various downstream VL tasks. Although the most advanced work improves performance by building bridges between encoders, it suffers from ineffective layer-by-layer utilization of uni-modal representations and cannot flexibly exploit different levels of uni-modal semantic knowledge. In this work, we propose ManagerTower, a novel VL model architecture that gathers and combines the insights of pre-trained uni-modal experts at different levels. The managers introduced in each cross-modal layer can adaptively aggregate uni-modal semantic knowledge to facilitate more comprehensive cross-modal alignment and fusion. ManagerTower outperforms previous strong baselines both with and without Vision-Language Pre-training (VLP). With only 4M VLP data, ManagerTower achieves superior performances on various downstream VL tasks, especially 79.15% accuracy on VQAv2 Test-Std, 86.56% IR@1 and 95.64% TR@1 on Flickr30K. Code and checkpoints are available at https://github.com/LooperXX/ManagerTower.

cs.CV↗

arXiv2023

OpenSLU: A Unified, Modularized, and Extensible Toolkit for Spoken Language Understanding

Spoken Language Understanding (SLU) is one of the core components of a task-oriented dialogue system, which aims to extract the semantic meaning of user queries (e.g., intents and slots). In this work, we introduce OpenSLU, an open-source toolkit to provide a unified, modularized, and extensible toolkit for spoken language understanding. Specifically, OpenSLU unifies 10 SLU models for both single-intent and multi-intent scenarios, which support both non-pretrained and pretrained models simultaneously. Additionally, OpenSLU is highly modularized and extensible by decomposing the model architecture, inference, and learning process into reusable modules, which allows researchers to quickly set up SLU experiments with highly flexible configurations. OpenSLU is implemented based on PyTorch, and released at \url{https://github.com/LightChen233/OpenSLU}.

cs.CL↗

arXiv2023

Heterojunction interface regulation to realize high-performance flexible Kesterite solar cells

Flexible Cu2ZnSn(S, Se)4 (CZTSSe) solar cells take the advantages of environmental friendliness, low cost, and multi-scenario applications, and have drawn extensive attention in recent years. Compared with rigid devices, the lack of alkali metal elements in the flexible substrate is the main factor limiting the performance of flexible CZTSSe solar cells. This work proposes a Rb ion additive strategy to simultaneously regulate the CZTSSe film surface properties and the CdS chemical bath deposition (CBD) processes. Material and chemical characterization reveals that Rb ions can passivate the detrimental Se0 cluster defect and additionally provide a more active surface for the CdS epitaxial growth. Furthermore, Rb can also coordinate with thiourea (TU) in the CBD solution and improve the ion-by-ion deposition of the CdS layer. Finally, the flexible CZTSSe cell fabricated by this strategy has reached a high total-area efficiency of 12.63% (active-area efficiency of 13.2%), with its VOC and FF reaching 538 mV and 0.70, respectively. This work enriches the alkali metal passivation strategies and provides new ideas for further improving flexible CZTSSe solar cells in the future.

physics.app-ph↗

arXiv2023

A Preliminary Evaluation of ChatGPT for Zero-shot Dialogue Understanding

Zero-shot dialogue understanding aims to enable dialogue to track the user's needs without any training data, which has gained increasing attention. In this work, we investigate the understanding ability of ChatGPT for zero-shot dialogue understanding tasks including spoken language understanding (SLU) and dialogue state tracking (DST). Experimental results on four popular benchmarks reveal the great potential of ChatGPT for zero-shot dialogue understanding. In addition, extensive analysis shows that ChatGPT benefits from the multi-turn interactive prompt in the DST task but struggles to perform slot filling for SLU. Finally, we summarize several unexpected behaviors of ChatGPT in dialogue understanding tasks, hoping to provide some insights for future research on building zero-shot dialogue understanding systems with Large Language Models (LLMs).

cs.CL↗

arXiv2023

Controlling selenization equilibrium enables high-quality Cu2ZnSn(S, Se)4 absorbers for efficient solar cells

Cu2ZnSn(S, Se)4 (CZTSSe) is one of most competitive photovoltaic materials for its earth-abundant reserves, environmental friendliness, and high stability.The quality of CZTSSe absorber determines the power-conversion efficiency (PCE) of CZTSSe solar cells. The absorber's quality lies on post-selenization process, which is the reaction of Cu-Zn-Sn precursor and selenium vapor. And the post-selenization is dependent on various factors (e.g. temperature, precursor composition, reaction atmosphere, etc).However, synergistic regulation of these factors cannot be realized under a widely-used single-temperature zone selenization condition.Here, in our dual-temperature zone selenization scheme, a solid-liquid and solid-gas (solid precursor and liquid/gas phase Se) synergistic reaction strategy has been developed to precisely regulate the selenization. Pre-deposited excess liquid Se provides high Se chemical potential to drive a direct and fast formation of the CZTSSe phase, significantly reducing the amount of binary and ternary compounds within phase evolution. And organics removal can be accomplished via a synergistic optimization of Se condensation and subsequent volatilization. We achieve a high-performance CZTSSe solar cell with a remarkable PCE of 13.6%, and the highest large-area PCE of 12.0% (over 1cm2). Our strategy will provide a new idea for further improving efficiency of CZTSSe solar cells via phase evolution regulation, and also for other complicated multi-compound synthesis.

cond-mat.mtrl-sci↗

arXiv2023

Monotone Splitting SQP Algorithms for Two-block Nonconvex Optimization Problems with General Linear Constraints and Applications

In this work, based on the ideas of alternating direction method with multipliers (ADMM) and sequential quadratic programming (SQP), as well as Armijo line search technology, monotone splitting SQP algorithms for two-block nonconvex optimization problems with linear equality, inequality and box constraints are discussed. Firstly, the discussed problem is transformed into an optimization problem with only linear equality and box constraints by introducing slack variables. Secondly, we use the idea of ADMM to decompose the quadratic programming (QP) subproblem. Especially, the QP subproblem corresponding to the introducing slack variable is simple, and it has an explicit optimal solution without increasing computational cost. Thirdly, the search direction is generated by the optimal solutions of the subproblems, and the new iteration point is yielded by Armijo line search with augmented Lagrange function. And the global convergence of the algorithm is analyzed under weaker assumptions. In addition, box constraints are extended to general nonempty closed convex sets, moreover, the global convergence of the corresponding algorithm is also proved. Finally, some preliminary numerical experiments and applications in the mid-to-large-scale economic dispatch problems for power systems are reported, and these show that our proposed algorithm is promising.

math.OC↗