arXiv subjects

Wei Peng

Publications and source records attributed to Wei Peng.

At least 109 records · Page 6Linked to original sources

arXiv2023

Geometric Scaling of the Current-Phase Relation of Niobium Nano-Bridge Junctions

The nano-bridge junction (NBJ) is a type of Josephson junction that is advantageous for the miniaturization of superconducting circuits. However, the current-phase relation (CPR) of the NBJ usually deviates from a sinusoidal function which has been explained by a simplified model with correlation only to its effective length. Here, we investigated both measured and calculated CPRs of niobium NBJs of a cuboidal shape with a three-dimensional bank structure. From a sine-wave to a saw-tooth-like form, we showed that deviated CPRs of NBJs can be described quantitatively by its skewness Δθ. Furthermore, the measured dependency of Δθ on the critical current {I_0} from 108 NBJs turned out to be consistent with the calculated ones derived from the change in geometric dimensions. It suggested that the CPRs of NBJs can be tuned by their geometric dimensions. In addition, the calculated scaling behavior of Δθ versus {I_0} in three-dimensional space was provided for the future design of superconducting circuits of a high integration level by using niobium NBJs.

cond-mat.mes-hall↗

arXiv2023

Generative AI for Medical Imaging: extending the MONAI Framework

Recent advances in generative AI have brought incredible breakthroughs in several areas, including medical imaging. These generative models have tremendous potential not only to help safely share medical data via synthetic datasets but also to perform an array of diverse applications, such as anomaly detection, image-to-image translation, denoising, and MRI reconstruction. However, due to the complexity of these models, their implementation and reproducibility can be difficult. This complexity can hinder progress, act as a use barrier, and dissuade the comparison of new methods with existing works. In this study, we present MONAI Generative Models, a freely available open-source platform that allows researchers and developers to easily train, evaluate, and deploy generative models and related applications. Our platform reproduces state-of-art studies in a standardised way involving different architectures (such as diffusion models, autoregressive transformers, and GANs), and provides pre-trained models for the community. We have implemented these models in a generalisable fashion, illustrating that their results can be extended to 2D or 3D scenarios, including medical images with different modalities (like CT, MRI, and X-Ray data) and from different anatomical areas. Finally, we adopt a modular and extensible approach, ensuring long-term maintainability and the extension of current applications for future features.

eess.IV↗

arXiv2023

Quasiparticle Dynamics in Superconducting Quantum-Classical Hybrid Circuits

Single flux quantum (SFQ) circuitry is a promising candidate for a scalable and integratable cryogenic quantum control system. However, the operation of SFQ circuits introduces non-equilibrium quasiparticles (QPs), which are a significant source of qubit decoherence. In this study, we investigate QP behavior in a superconducting quantum-classical hybrid chip that comprises an SFQ circuit and a qubit circuit. By monitoring qubit relaxation time, we explore the dynamics of SFQ-circuit-induced QPs. Our findings reveal that the QP density near the qubit reaches its peak after several microseconds of SFQ circuit operation, which corresponds to the phonon-mediated propagation time of QPs in the hybrid circuits. This suggests that phonon-mediated propagation dominates the spreading of QPs in the hybrid circuits. Our results lay the foundation to suppress QP poisoning in quantum-classical hybrid systems.

quant-ph↗

arXiv2023

Neural-Symbolic Recommendation with Graph-Enhanced Information

The recommendation system is not only a problem of inductive statistics from data but also a cognitive task that requires reasoning ability. The most advanced graph neural networks have been widely used in recommendation systems because they can capture implicit structured information from graph-structured data. However, like most neural network algorithms, they only learn matching patterns from a perception perspective. Some researchers use user behavior for logic reasoning to achieve recommendation prediction from the perspective of cognitive reasoning, but this kind of reasoning is a local one and ignores implicit information on a global scale. In this work, we combine the advantages of graph neural networks and propositional logic operations to construct a neuro-symbolic recommendation model with both global implicit reasoning ability and local explicit logic reasoning ability. We first build an item-item graph based on the principle of adjacent interaction and use graph neural networks to capture implicit information in global data. Then we transform user behavior into propositional logic expressions to achieve recommendations from the perspective of cognitive reasoning. Extensive experiments on five public datasets show that our proposed model outperforms several state-of-the-art methods, source code is avaliable at [https://github.com/hanzo2020/GNNLR].

cs.AI↗

arXiv2023

Superconducting nanowire diode

Semiconducting diode with nonreciprocal transport effect underlies the cornerstone of contemporary integrated circuits (ICs) technology. Due to isotropic superconducting properties and the lack of breaking of inversion symmetry for conventional s-wave superconductors, such a superconducting peer is absent. Recently, a series of superconducting structures, including superconducting superlattice and quantum-material-based superconducting Josephson junction, have exhibited a superconducting diode effect in terms of polarity-dependent critical current. However, due to complex structures, these composite systems are not able to construct large-scale integrated superconducting circuits. Here, we demonstrated the minimal superconducting electric component-superconducting nanowire-based diode with a nonreciprocal transport effect under a perpendicular magnetic field, in which the superconducting to normal metallic phase transition relies on the polarity and amplitude of the bias current. Our nanowire diodes can be reliably operated nearly at all temperatures below the critical temperature, and the rectification efficiency at 2 K can be more than 24%. Moreover, the superconducting nanowire diode is able to rectify both square wave and sine wave signals without any distortion. Combining the superconducting nanowire-based diodes and transistors, superconducting nanowires hold the possibility to construct novel low-dissipation superconducting ICs.

cond-mat.supr-con↗

arXiv2023

Chiral magnetism and ordering of oxygen vacancies in SrTiO$_{2.5}$

Oxygen vacancies in the perovskite insulator SrTiO$_3$ free electrons that couple with other physical degrees of freedom such as lattice, orbital, and spin. This leads to the emergence of exotic quantum states such as superconductivity and unusual ferromagnetism. We perform density-functional theory and dynamical mean-field theory calculations and demonstrate that the orientation and ordering of the TiO$_5$ pentahedra plays a crucial role. Specifically, for vacancy-rich SrTiO$_{3-δ}$ ($δ\sim$0.5), we find a chiral ordering of the TiO$_5$ pentahedra in a sixfold superlattice. This chiral structure is accompanied by a chiral magnetic state with a net moment in the (111) direction at room temperature, which can explain several experimental observations.

cond-mat.str-el↗

arXiv2023

Hyperbolic Uncertainty Aware Semantic Segmentation

Semantic segmentation (SS) aims to classify each pixel into one of the pre-defined classes. This task plays an important role in self-driving cars and autonomous drones. In SS, many works have shown that most misclassified pixels are commonly near object boundaries with high uncertainties. However, existing SS loss functions are not tailored to handle these uncertain pixels during training, as these pixels are usually treated equally as confidently classified pixels and cannot be embedded with arbitrary low distortion in Euclidean space, thereby degenerating the performance of SS. To overcome this problem, this paper designs a "Hyperbolic Uncertainty Loss" (HyperUL), which dynamically highlights the misclassified and high-uncertainty pixels in Hyperbolic space during training via the hyperbolic distances. The proposed HyperUL is model agnostic and can be easily applied to various neural architectures. After employing HyperUL to three recent SS models, the experimental results on Cityscapes and UAVid datasets reveal that the segmentation performance of existing SS models can be consistently improved.

cs.CV↗

arXiv2023

Learning Homographic Disambiguation Representation for Neural Machine Translation

Homographs, words with the same spelling but different meanings, remain challenging in Neural Machine Translation (NMT). While recent works leverage various word embedding approaches to differentiate word sense in NMT, they do not focus on the pivotal components in resolving ambiguities of homographs in NMT: the hidden states of an encoder. In this paper, we propose a novel approach to tackle homographic issues of NMT in the latent space. We first train an encoder (aka "HDR-encoder") to learn universal sentence representations in a natural language inference (NLI) task. We further fine-tune the encoder using homograph-based synset sentences from WordNet, enabling it to learn word-level homographic disambiguation representations (HDR). The pre-trained HDR-encoder is subsequently integrated with a transformer-based NMT in various schemes to improve translation accuracy. Experiments on four translation directions demonstrate the effectiveness of the proposed method in enhancing the performance of NMT systems in the BLEU scores (up to +2.3 compared to a solid baseline). The effects can be verified by other metrics (F1, precision, and recall) of translation accuracy in an additional disambiguation task. Visualization methods like heatmaps, T-SNE and translation examples are also utilized to demonstrate the effects of the proposed method.

cs.CL↗

arXiv2023

Thin film aluminum nitride surface acoustic wave resonators for quantum acoustodynamics

The quantum excitations of macroscopic surface acoustic waves (SAWs) have been tailored to control, communicate and transduce stationary and flying quantum states. However, the limited lifetime of this hybrid quantum systems remains critical obstacles to extend their applications in quantum information processing. Here we present the potentials of thin film aluminum nitride to on-chip integrate phonons with superconducting qubits over previous bulk piezoelectric substrates. We have reported high-quality thin film GHz-SAW resonators with the highest internal quality factor Qi of 5 e4 at the single-phonon level. The internal loss of SAW resonators are systematically investigated with tuning the parameters of sample layout, power and temperature. Our results manifest that SAWs on piezoelectric films are readily integrable with standard fabrication of Josephson junction quantum circuits, and offer excellent acoustic platforms for the high-coherence quantum acoustodynamics architectures.

quant-ph↗

arXiv2023

Knowledge-augmented Frame Semantic Parsing with Hybrid Prompt-tuning

Frame semantics-based approaches have been widely used in semantic parsing tasks and have become mainstream. It remains challenging to disambiguate frame representations evoked by target lexical units under different contexts. Pre-trained Language Models (PLMs) have been used in semantic parsing and significantly improve the accuracy of neural parsers. However, the PLMs-based approaches tend to favor collocated patterns presented in the training data, leading to inaccurate outcomes. The intuition here is to design a mechanism to optimally use knowledge captured in semantic frames in conjunction with PLMs to disambiguate frames. We propose a novel Knowledge-Augmented Frame Semantic Parsing Architecture (KAF-SPA) to enhance semantic representation by incorporating accurate frame knowledge into PLMs during frame semantic parsing. Specifically, a Memory-based Knowledge Extraction Module (MKEM) is devised to select accurate frame knowledge and construct the continuous templates in the high dimensional vector space. Moreover, we design a Task-oriented Knowledge Probing Module (TKPM) using hybrid prompts (in terms of continuous and discrete prompts) to incorporate the selected knowledge into the PLMs and adapt PLMs to the tasks of frame and argument identification. Experimental results on two public FrameNet datasets demonstrate that our method significantly outperforms strong baselines (by more than +3$\%$ in F1), achieving state-of-art results on the current benchmark. Ablation studies verify the effectiveness of KAF-SPA.

cs.CL↗

arXiv2023

Improving Table Structure Recognition with Visual-Alignment Sequential Coordinate Modeling

Table structure recognition aims to extract the logical and physical structure of unstructured table images into a machine-readable format. The latest end-to-end image-to-text approaches simultaneously predict the two structures by two decoders, where the prediction of the physical structure (the bounding boxes of the cells) is based on the representation of the logical structure. However, the previous methods struggle with imprecise bounding boxes as the logical representation lacks local visual information. To address this issue, we propose an end-to-end sequential modeling framework for table structure recognition called VAST. It contains a novel coordinate sequence decoder triggered by the representation of the non-empty cell from the logical structure decoder. In the coordinate sequence decoder, we model the bounding box coordinates as a language sequence, where the left, top, right and bottom coordinates are decoded sequentially to leverage the inter-coordinate dependency. Furthermore, we propose an auxiliary visual-alignment loss to enforce the logical representation of the non-empty cells to contain more local visual details, which helps produce better cell bounding boxes. Extensive experiments demonstrate that our proposed method can achieve state-of-the-art results in both logical and physical structure recognition. The ablation study also validates that the proposed coordinate sequence decoder and the visual-alignment loss are the keys to the success of our method.

cs.CV↗

arXiv2023

Data Leakage and Evaluation Issues in Micro-Expression Analysis

Micro-expressions have drawn increasing interest lately due to various potential applications. The task is, however, difficult as it incorporates many challenges from the fields of computer vision, machine learning and emotional sciences. Due to the spontaneous and subtle characteristics of micro-expressions, the available training and testing data are limited, which make evaluation complex. We show that data leakage and fragmented evaluation protocols are issues among the micro-expression literature. We find that fixing data leaks can drastically reduce model performance, in some cases even making the models perform similarly to a random classifier. To this end, we go through common pitfalls, propose a new standardized evaluation protocol using facial action units with over 2000 micro-expression samples, and provide an open source library that implements the evaluation protocols in a standardized manner. Code is publicly available in \url{https://github.com/tvaranka/meb}.

cs.CV↗

arXiv2023

Geometric Graph Representation with Learnable Graph Structure and Adaptive AU Constraint for Micro-Expression Recognition

Micro-expression recognition (MER) is valuable because micro-expressions (MEs) can reveal genuine emotions. Most works take image sequences as input and cannot effectively explore ME information because subtle ME-related motions are easily submerged in unrelated information. Instead, the facial landmark is a low-dimensional and compact modality, which achieves lower computational cost and potentially concentrates on ME-related movement features. However, the discriminability of facial landmarks for MER is unclear. Thus, this paper explores the contribution of facial landmarks and proposes a novel framework to efficiently recognize MEs. Firstly, a geometric two-stream graph network is constructed to aggregate the low-order and high-order geometric movement information from facial landmarks to obtain discriminative ME representation. Secondly, a self-learning fashion is introduced to automatically model the dynamic relationship between nodes even long-distance nodes. Furthermore, an adaptive action unit loss is proposed to reasonably build the strong correlation between landmarks, facial action units and MEs. Notably, this work provides a novel idea with much higher efficiency to promote MER, only utilizing graph-based geometric features. The experimental results demonstrate that the proposed method achieves competitive performance with a significantly reduced computational cost. Furthermore, facial landmarks significantly contribute to MER and are worth further study for high-efficient ME analysis.

cs.CV↗

arXiv2023

BLiMP: The Benchmark of Linguistic Minimal Pairs for English

We introduce The Benchmark of Linguistic Minimal Pairs (shortened to BLiMP), a challenge set for evaluating what language models (LMs) know about major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each containing 1000 minimal pairs isolating specific contrasts in syntax, morphology, or semantics. The data is automatically generated according to expert-crafted grammars, and aggregate human agreement with the labels is 96.4%. We use it to evaluate n-gram, LSTM, and Transformer (GPT-2 and Transformer-XL) LMs. We find that state-of-the-art models identify morphological contrasts reliably, but they struggle with semantic restrictions on the distribution of quantifiers and negative polarity items and subtle syntactic phenomena such as extraction islands.

cs.CL↗

arXiv2023

FADO: Feedback-Aware Double COntrolling Network for Emotional Support Conversation

Emotional Support Conversation (ESConv) aims to reduce help-seekers'emotional distress with the supportive strategy and response. It is essential for the supporter to select an appropriate strategy with the feedback of the help-seeker (e.g., emotion change during dialog turns, etc) in ESConv. However, previous methods mainly focus on the dialog history to select the strategy and ignore the help-seeker's feedback, leading to the wrong and user-irrelevant strategy prediction. In addition, these approaches only model the context-to-strategy flow and pay less attention to the strategy-to-context flow that can focus on the strategy-related context for generating the strategy-constrain response. In this paper, we propose a Feedback-Aware Double COntrolling Network (FADO) to make a strategy schedule and generate the supportive response. The core module in FADO consists of a dual-level feedback strategy selector and a double control reader. Specifically, the dual-level feedback strategy selector leverages the turn-level and conversation-level feedback to encourage or penalize strategies. The double control reader constructs the novel strategy-to-context flow for generating the strategy-constrain response. Furthermore, a strategy dictionary is designed to enrich the semantic information of the strategy and improve the quality of strategy-constrain response. Experimental results on ESConv show that the proposed FADO has achieved the state-of-the-art performance in terms of both strategy selection and response generation. Our code is available at https://github.com/Thedatababbler/FADO.

cs.CL↗

arXiv2022

RBF-MGN:Solving spatiotemporal PDEs with Physics-informed Graph Neural Network

Physics-informed neural networks (PINNs) have lately received significant attention as a representative deep learning-based technique for solving partial differential equations (PDEs). Most fully connected network-based PINNs use automatic differentiation to construct loss functions that suffer from slow convergence and difficult boundary enforcement. In addition, although convolutional neural network (CNN)-based PINNs can significantly improve training efficiency, CNNs have difficulty in dealing with irregular geometries with unstructured meshes. Therefore, we propose a novel framework based on graph neural networks (GNNs) and radial basis function finite difference (RBF-FD). We introduce GNNs into physics-informed learning to better handle irregular domains with unstructured meshes. RBF-FD is used to construct a high-precision difference format of the differential equations to guide model training. Finally, we perform numerical experiments on Poisson and wave equations on irregular domains. We illustrate the generalizability, accuracy, and efficiency of the proposed algorithms on different PDE parameters, numbers of collection points, and several types of RBFs.

cs.LG↗

arXiv2022

Joint Deep Reversible Regression Model and Physics-Informed Unsupervised Learning for Temperature Field Reconstruction

Temperature monitoring during the life time of heat source components in engineering systems becomes essential to guarantee the normal work and the working life of these components. However, prior methods, which mainly use the interpolate estimation to reconstruct the temperature field from limited monitoring points, require large amounts of temperature tensors for an accurate estimation. This may decrease the availability and reliability of the system and sharply increase the monitoring cost. To solve this problem, this work develops a novel physics-informed deep reversible regression models for temperature field reconstruction of heat-source systems (TFR-HSS), which can better reconstruct the temperature field with limited monitoring points unsupervisedly. First, we define the TFR-HSS task mathematically, and numerically model the task, and hence transform the task as an image-to-image regression problem. Then this work develops the deep reversible regression model which can better learn the physical information, especially over the boundary. Finally, considering the physical characteristics of heat conduction as well as the boundary conditions, this work proposes the physics-informed reconstruction loss including four training losses and jointly learns the deep surrogate model with these losses unsupervisedly. Experimental studies have conducted over typical two-dimensional heat-source systems to demonstrate the effectiveness of the proposed method.

cs.LG↗

arXiv2022

Investigation of the Pauli paramagnetic effect in systematically tuned NbN thin films

Superconductivity and the normal-state properties of NbN films can be tuned in a wide range, supplying a suitable platform to investigate the systematical evolution of the superconducting performances. Herein, we report the upper critical field of NbN films in both the vertical ($B\perp$ film) and parallel ($B\parallel$ film) orientations over a wide temperature range. Eight samples with the superconducting critical temperature $T_c$ ranging from 2.5 K to 9.8 K are studied. Meanwhile, the normal-state resistivity is tuned by more than six times by changing the conditions of the film growth. It is found that the magnitudes of the upper critical field in both field directions ($B_{c2}^{\perp}$ and $B_{c2}^{\parallel}$) exceed the paramagnetic limiting field $B_p$. The temperature dependent $B_{c2}^{\perp}$ can be described by the extended Werthamer--Helfand--Hohenberg (WHH) model considering the Pauli spin paramagnetism. Meanwhile, the $B_{c2}^{\parallel}$-$T$ data shows the feature of two-dimensional superconductivity in the temperature range near $T_c$. The evolution of the obtained Maki parameter with other parameters, such as the slope of the upper critical field near $T_c$ and the normal-state resistivity, are discussed to reveal the characteristics of the Pauli paramagnetic effect in this system.

cond-mat.supr-con↗