arXiv subjects

Yiming Chen

Publications and source records attributed to Yiming Chen.

At least 127 records · Page 7Linked to original sources

arXiv2023

Comments on the double cone wormhole

In this paper we revisit the double cone wormhole introduced by Saad, Shenker and Stanford (SSS), which was shown to reproduce the ramp in the spectral form factor. As a first approximation we can say that this solution computes $\textrm{Tr}[e^{-iKT}]$, a trace of the "evolution" operator that generates Schwarzschild time translations on the two sided wormhole geometry. This point of view leads to a simple way to compute the normalization factor of the wormhole. When we have bulk matter fields, SSS suggested using a modified evolution $\tilde K$ which involves a slightly complex geometry, so that we are really computing $\textrm{Tr}[e^{-i\tilde{K}T}]$. We argue that, for general black holes, the spectrum of $\tilde K$ is given by quasinormal mode frequencies. We explain that this reproduces various features that were previously predicted from the spectral form factor on hydrodynamics grounds. We also give a general algebraic construction of the modified boost in terms of operators constructed from half sided modular inclusions. For the special case of JT gravity, we work out the backreaction of matter on the geometry of the double cone and find that it deforms the geometry in an undesirable direction. We finally give some comments on the possible physical interpretation of $\tilde K$.

hep-th↗

arXiv2023

Enhancing Black-Box Few-Shot Text Classification with Prompt-Based Data Augmentation

Training or finetuning large-scale language models (LLMs) such as GPT-3 requires substantial computation resources, motivating recent efforts to explore parameter-efficient adaptation to downstream tasks. One practical area of research is to treat these models as black boxes and interact with them through their inference APIs. In this paper, we investigate how to optimize few-shot text classification without accessing the gradients of the LLMs. To achieve this, we treat the black-box model as a feature extractor and train a classifier with the augmented text data. Data augmentation is performed using prompt-based finetuning on an auxiliary language model with a much smaller parameter size than the black-box model. Through extensive experiments on eight text classification datasets, we show that our approach, dubbed BT-Classifier, significantly outperforms state-of-the-art black-box few-shot learners and performs on par with methods that rely on full-model tuning.

cs.CL↗

arXiv2023

Spin-Statistics for Black Hole Microstates

The gravitational path integral can be used to compute the number of black hole states for a given energy window, or the free energy in a thermal ensemble. In this article we explain how to use the gravitational path integral to compute the separate number of bosonic and fermionic black hole microstates. We do this by comparing the partition function with and without the insertion of $(-1)^{\sf F}$. In particular we introduce a universal rotating black hole that contributes to the partition function in the presence of $(-1)^{\sf F}$. We study this problem for black holes in asymptotically flat space and in AdS, putting constraints on the high energy spectrum of holographic CFTs (not necessarily supersymmetric). Finally, we analyze wormhole contributions to related quantities.

hep-th↗

arXiv2023

Sharper Convergence Guarantees for Federated Learning with Partial Model Personalization

Partial model personalization, which encompasses both shared and personal variables in its formulation, is a critical optimization problem in federated learning. It balances individual client needs with collective knowledge utilization, and serves as a general formulation covering various key scenarios, ranging from fully shared to fully personalized federated learning. This paper introduces two effective algorithms, FedAvg-P and Scaffold-P, to solve this problem and provides sharp convergence analyses, quantifying the influence of gradient variance, local steps, and partial client sampling on their performance. Our established rates surpass existing results and, meanwhile, are based on more relaxed assumptions. Additionally, our analyses are also applicable to fully shared or fully personalized federated learning, matching or even outperforming their best known convergence rates. Numerical experiments corroborate our theoretical findings.

math.OC↗

arXiv2023

Influence of shear waves on transcranial ultrasound propagation in cortical brain regions

Transcranial ultrasound applications require accurate simulations to predict intracranial acoustic pressure fields. The current gold standard typically consists of calculating a longitudinal ultrasound wave propagation using a fluid skull model, which is based on full head CT images for retrieving the skull's geometry and elastic constants. Although this approach has extensively been validated for deep brain targets and routinely used in transcranial ultrasound ablation procedures, its accuracy in shallow cortical regions remains unexplored. In this study, we explore the shear wave effects associated with transcranial focused ultrasound propagation, both numerically and experimentally. The intracranial acoustic pressure was measured at different incidence angles at the parietal and frontal regions in an ex vivo human skull. The fluid-like skull model was then compared to the solid model comprising both longitudinal and shear waves. The results consistently show a larger error and variability for both models when considering an oblique incidence, reaching a maximum of 125% mean deviation of the focal area when employing the fluid skull model. Statistical assessments further revealed that ignoring shear waves results in an average ~40% overestimation of the intracranial acoustic pressure and inability to obtain an accurate intracranial acoustic pressure distribution. Moreover, the solid model has a more stable performance, even when small variations in the skull-transducer relative position are introduced. Our results could contribute to the refinement of the transcranial ultrasound propagation modeling methods thus help improving the safety and outcome of transcranial ultrasound therapy in the cortical brain areas.

physics.med-ph↗

arXiv2023

On Talagrand's functional and generic chaining

In the study of the supremum of stochastic processes, Talagrand's chaining functionals and his generic chaining method are heavily related to the distribution of stochastic processes. In the present paper, we construct Talagrand's type functionals in the general distribution case and obtain the upper bound for the suprema of all $p$-th moments of the stochastic process using the generic chaining method. As applications, we obtained the Johnson-Lindenstrauss lemma, the upper bound for the supremum of all $p$-th moment of order 2 Gaussian chaos, and convex signal recovery in our setting.

math.PR↗

arXiv2023

Probing Supersymmetric Black Holes with Surface Defects

It has long been conjectured that the large $N$ deconfinement phase transition of $\mathcal{N}=4$ ${\rm SU}(N)$ super-Yang-Mills corresponds via AdS/CFT to the Hawking-Page transition in which black holes dominate the thermal ensemble, and quantitative evidence of this has come through the recent matching of the superconformal index of ${1\over 16}$-BPS states to the supersymmetric black hole entropy. We introduce the half-BPS Gukov-Witten surface defect as a probe of the superconformal index, which also serves as an order parameter for the deconfinement transition. This can be studied directly in field theory as a modification of the usual unitary matrix model or in the dual description as a D3-brane probe in the background of a (complex) supersymmetric black hole. Using a saddle point approximation, we determine our defect index in the large $N$ limit as a simple function of the chemical potentials and show independently that it is reproduced by the renormalized action of the brane in the black hole background. Along the way, we also comment on the Cardy limit and the thermodynamics of the D3-brane in the generalized ensemble. The defect index sharply distinguishes between the confining and the deconfining phases of the gauge theory and thus is a supersymmetric non-perturbative order parameter for these large $N$ phase transitions which deserves further investigation. Finally, our work provides an example where the properties of a black hole coupled to an external system can be analyzed precisely.

hep-th↗

arXiv2023

Association of stroke lesion distributions with atrial fibrillation detected after stroke

Background Atrial fibrillation is often missed by traditional intermittent electrocardiogram monitoring after ischemic stroke due to its paroxysmal and asymptomatic nature. The knowledge of the unique characteristics of the population with atrial fibrillation detected after stroke (AFDAS) enables more ischemic stroke patients to benefit from more aggressive anticoagulation therapy and AF management. Method This is an observational, retrospective, MRI imaging-based single-center study. Patients with AFDAS were matched in 1:3 ratio with patients without AF (NoAF)and patients with known AF before stroke(KAF) in PSM model based on age, gender, and time from stroke onset to admission. Multivariate logistic models were used to test the association of MRI-based stroke lesion distribution, other clinical parameters and AF. A backward stepwise elimination regression was conducted to identify the most important variables. Results Compared to the NoAF group(n=103), the patients with AFDAS (n=42) had more cortical involvement(p=0.016), as well as temporal(p<0.001) and insular lobes(p=0.018) infraction. After performing a backward stepwise elimination model in regression analysis, the temporal lobe infraction(OR 0.274, 95%CI 0.090-0.838, p=0.023) remained independently associated with the detection of AF. Compared to the KAF group(n=89), LAD(OR 1.113, 95%CI 1.022-1.211, p=0.014), Number of lobes infarction(p=0.012), 3-lobes involvement(OR 0.177, 95%CI 0.056-0.559, p=0.003), and left hemisphere lobe involvement(OR 5.966, 95%CI 2.273-15.817, p<0.001)) were independently associated with AFDAS and KAF. Conclusions Ischemic stroke patients with AF detected after stroke present more temporal lobe infraction and cortical involvement. These lesion distribution characteristics with clinical characteristics together may help in stratifying patients with long-term cardiac monitoring after stroke.

q-bio.NC↗

arXiv2023

Dynamic Transformers Provide a False Sense of Efficiency

Despite much success in natural language processing (NLP), pre-trained language models typically lead to a high computational cost during inference. Multi-exit is a mainstream approach to address this issue by making a trade-off between efficiency and accuracy, where the saving of computation comes from an early exit. However, whether such saving from early-exiting is robust remains unknown. Motivated by this, we first show that directly adapting existing adversarial attack approaches targeting model accuracy cannot significantly reduce inference efficiency. To this end, we propose a simple yet effective attacking framework, SAME, a novel slowdown attack framework on multi-exit models, which is specially tailored to reduce the efficiency of the multi-exit models. By leveraging the multi-exit models' design characteristics, we utilize all internal predictions to guide the adversarial sample generation instead of merely considering the final prediction. Experiments on the GLUE benchmark show that SAME can effectively diminish the efficiency gain of various multi-exit models by 80% on average, convincingly validating its effectiveness and generalization ability.

cs.CL↗

arXiv2023

Low-intensity pulsed ultrasound promotes mesenchymal stem cell transplantation-based articular cartilage regeneration via inhibiting the TNF signaling pathway

Background: Mesenchymal stem cell (MSC) transplantation therapy is highly investigated for the regenerative repair of cartilage defects. Low-intensity pulsed ultrasound (LIPUS) has the potential to promote chondrogenic differentiation of MSCs. However, its underlying mechanism remains unclear. Here, we investigated the promoting effects and mechanisms underlying LIPUS stimulation on the chondrogenic differentiation of human umbilical cord mesenchymal stem cells (hUC-MSCs) and further evaluated its regenerative application value in articular cartilage defects in rats. Methods: LIPUS was applied to stimulate cultured hUC-MSCs and C28/I2 cells in vitro. Immunofluorescence staining, qPCR analysis, and transcriptome sequencing were used to detect mature cartilage-related markers of gene and protein expression for a comprehensive evaluation of differentiation. Injured articular cartilage rat models were established for further hUC-MSC transplantation and LIPUS stimulation in vivo. Histopathology and H&E staining were used to evaluate the repair effects of the injured articular cartilage with LIPUS stimulation. Results: The results showed that LIPUS stimulation with specific parameters effectively promoted the expression of mature cartilage-related genes and proteins, inhibited TNF-α gene expression in hUC-MSCs, and exhibited anti-inflammation in C28/I2 cells. In addition, the articular cartilage defects of rats were significantly repaired after hUC-MSC transplantation and LIPUS stimulation. Conclusions: Taken together, LIPUS stimulation could realize articular cartilage regeneration based on hUC-MSC transplantation due to the inhibition of the TNF signaling pathway, which is of clinical value for the relief of osteoarthritis.

physics.med-ph↗

arXiv2023

Effective Ambiguity Attack Against Passport-based DNN Intellectual Property Protection Schemes through Fully Connected Layer Substitution

Since training a deep neural network (DNN) is costly, the well-trained deep models can be regarded as valuable intellectual property (IP) assets. The IP protection associated with deep models has been receiving increasing attentions in recent years. Passport-based method, which replaces normalization layers with passport layers, has been one of the few protection solutions that are claimed to be secure against advanced attacks. In this work, we tackle the issue of evaluating the security of passport-based IP protection methods. We propose a novel and effective ambiguity attack against passport-based method, capable of successfully forging multiple valid passports with a small training dataset. This is accomplished by inserting a specially designed accessory block ahead of the passport parameters. Using less than 10% of training data, with the forged passport, the model exhibits almost indistinguishable performance difference (less than 2%) compared with that of the authorized passport. In addition, it is shown that our attack strategy can be readily generalized to attack other IP protection methods based on watermark embedding. Directions for potential remedy solutions are also given.

cs.CR↗

arXiv2023

Estimating global charge violating amplitudes from wormholes

We consider the scattering of high energy and ultra relativistic spherically symmetric shells in asymptotically AdS$_D$ spacetimes. We analyze an exclusive amplitude where a single spherically symmetric shell goes in and a single one comes out, such that the two have different global symmetry charges of the effective gravity theory. We study a simple wormhole configuration that computes the square of the amplitude and analyze its properties.

hep-th↗

arXiv2022

SEVGGNet-LSTM: a fused deep learning model for ECG classification

This paper presents a fused deep learning algorithm for ECG classification. It takes advantages of the combined convolutional and recurrent neural network for ECG classification, and the weight allocation capability of attention mechanism. The input ECG signals are firstly segmented and normalized, and then fed into the combined VGG and LSTM network for feature extraction and classification. An attention mechanism (SE block) is embedded into the core network for increasing the weight of important features. Two databases from different sources and devices are employed for performance validation, and the results well demonstrate the effectiveness and robustness of the proposed algorithm.

cs.LG↗

arXiv2022

Generate, Discriminate and Contrast: A Semi-Supervised Sentence Representation Learning Framework

Most sentence embedding techniques heavily rely on expensive human-annotated sentence pairs as the supervised signals. Despite the use of large-scale unlabeled data, the performance of unsupervised methods typically lags far behind that of the supervised counterparts in most downstream tasks. In this work, we propose a semi-supervised sentence embedding framework, GenSE, that effectively leverages large-scale unlabeled data. Our method include three parts: 1) Generate: A generator/discriminator model is jointly trained to synthesize sentence pairs from open-domain unlabeled corpus; 2) Discriminate: Noisy sentence pairs are filtered out by the discriminator to acquire high-quality positive and negative sentence pairs; 3) Contrast: A prompt-based contrastive approach is presented for sentence representation learning with both annotated and synthesized data. Comprehensive experiments show that GenSE achieves an average correlation score of 85.19 on the STS datasets and consistent performance improvement on four domain adaptation tasks, significantly surpassing the state-of-the-art methods and convincingly corroborating its effectiveness and generalization ability.Code, Synthetic data and Models available at https://github.com/MatthewCYM/GenSE.

cs.CL↗

arXiv2022

Visual-based Kinematics and Pose Estimation for Skid-Steering Robots

To build commercial robots, skid-steering mechanical design is of increased popularity due to its manufacturing simplicity and unique mechanism. However, these also cause significant challenges on software and algorithm design, especially for the pose estimation (i.e., determining the robot's rotation and position) of skid-steering robots, since they change their orientation with an inevitable skid. To tackle this problem, we propose a probabilistic sliding-window estimator dedicated to skid-steering robots, using measurements from a monocular camera, the wheel encoders, and optionally an inertial measurement unit (IMU). Specifically, we explicitly model the kinematics of skid-steering robots by both track instantaneous centers of rotation (ICRs) and correction factors, which are capable of compensating for the complexity of track-to-terrain interaction, the imperfectness of mechanical design, terrain conditions and smoothness, etc. To prevent performance reduction in robots' long-term missions, the time- and location- varying kinematic parameters are estimated online along with pose estimation states in a tightly-coupled manner. More importantly, we conduct in-depth observability analysis for different sensors and design configurations in this paper, which provides us with theoretical tools in making the correct choice when building real commercial robots. In our experiments, we validate the proposed method by both simulation tests and real-world experiments, which demonstrate that our method outperforms competing methods by wide margins.

cs.RO↗

arXiv2022

Analyzing and Evaluating Faithfulness in Dialogue Summarization

Dialogue summarization is abstractive in nature, making it suffer from factual errors. The factual correctness of summaries has the highest priority before practical applications. Many efforts have been made to improve faithfulness in text summarization. However, there is a lack of systematic study on dialogue summarization systems. In this work, we first perform the fine-grained human analysis on the faithfulness of dialogue summaries and observe that over 35% of generated summaries are faithfully inconsistent respective the source dialogues. Furthermore, we present a new model-level faithfulness evaluation method. It examines generation models with multi-choice questions created by rule-based transformations. Experimental results show that our evaluation schema is a strong proxy for the factual correctness of summarization models. The human-annotated faithfulness samples and the evaluation toolkit are released to facilitate future research toward faithful dialogue summarization.

cs.CL↗

arXiv2022

Revisiting Optimal Convergence Rate for Smooth and Non-convex Stochastic Decentralized Optimization

Decentralized optimization is effective to save communication in large-scale machine learning. Although numerous algorithms have been proposed with theoretical guarantees and empirical successes, the performance limits in decentralized optimization, especially the influence of network topology and its associated weight matrix on the optimal convergence rate, have not been fully understood. While (Lu and Sa, 2021) have recently provided an optimal rate for non-convex stochastic decentralized optimization with weight matrices defined over linear graphs, the optimal rate with general weight matrices remains unclear. This paper revisits non-convex stochastic decentralized optimization and establishes an optimal convergence rate with general weight matrices. In addition, we also establish the optimal rate when non-convex loss functions further satisfy the Polyak-Lojasiewicz (PL) condition. Following existing lines of analysis in literature cannot achieve these results. Instead, we leverage the Ring-Lattice graph to admit general weight matrices while maintaining the optimal relation between the graph diameter and weight matrix connectivity. Lastly, we develop a new decentralized algorithm to nearly attain the above two optimal rates under additional mild conditions.

cs.LG↗

arXiv2022

DNA Scaffold Carrier Assisted Protein Translocation Through Solid-State Nanopore

The detection of biomolecules at the single molecular level have important applications in the fields of biosensing and biomedical diagnosis. Solid state nanopore (SS-nanopore) is an effective tool to perform the single molecular detection, due to its unique properties of label-free and less sample consumption. The current SS-nanopore translocations of small biomolecules are driven by the electronic field force, thus easily influenced by the charges, shapes and sizes of the target molecules. Therefore, it remains a great challenge to control biomolecules to translocate through SS-nanopore, particularly for the protein with complex conformations and different charges. Towards this problem, we developed a DNA scaffold carrier assisted strategy to help protein translocation through SS-nanopore, thus facilitating the target protein detection. Taking advantages of a DNA carrier loading effect, the current signal to noise ratios are significantly improved. Our proposed method is sensitive, convenient and can detect real-time sample nanopore translocations. This method opens up a wide range of applications for SS-nanopore detection and promote the development of single molecular detections.

physics.bio-ph↗