arXiv subjects

Yu Tian

Publications and source records attributed to Yu Tian.

At least 253 records · Page 14Linked to original sources

arXiv2023

Curvature-based Clustering on Graphs

Unsupervised node clustering (or community detection) is a classical graph learning task. In this paper, we study algorithms, which exploit the geometry of the graph to identify densely connected substructures, which form clusters or communities. Our method implements discrete Ricci curvatures and their associated geometric flows, under which the edge weights of the graph evolve to reveal its community structure. We consider several discrete curvature notions and analyze the utility of the resulting algorithms. In contrast to prior literature, we study not only single-membership community detection, where each node belongs to exactly one community, but also mixed-membership community detection, where communities may overlap. For the latter, we argue that it is beneficial to perform community detection on the line graph, i.e., the graph's dual. We provide both theoretical and empirical evidence for the utility of our curvature-based clustering algorithms. In addition, we give several results on the relationship between the curvature of a graph and that of its dual, which enable the efficient implementation of our proposed mixed-membership community detection approach and which may be of independent interest for curvature-based network analysis.

cs.SI↗

arXiv2023

Nonlinear dynamics of hot, cold and bald Einstein-Maxwell-scalar black holes in AdS spacetime

We investigate the dynamical transition processes of an Einstein-Maxwell-scalar gravitational system between two local ground states and an excited state in the anti-de Sitter spacetime. From the linear perturbation theory, only the excited state possesses a single unstable mode, indicating the dynamical instability. Such an instability is associated with the tachyonic instability due to the presence of an effective potential well near the event horizon. From the nonlinear dynamics simulation, through the scalar field accretion mechanism, the critical phenomena in the transition process of the gravitational system between the two local ground states are revealed. The threshold of the accretion strength indicates the existence of a dynamical barrier in this transition process, which depends on the coupling strength between the scalar and Maxwell fields. On the other hand, for the unstable excited state, there exists a special kind of critical dynamics with a zero threshold for the perturbation strength. The perturbations of different signs push the gravitational system to fall into different local ground states. Interestingly, in an extended parameter space, there exist specific parameters such that the perturbations of non-zero amplitude fail to trigger the single unstable mode of the excited state.

gr-qc↗

arXiv2023

Structural Balance and Random Walks on Complex Networks with Complex Weights

Complex numbers define the relationship between entities in many situations. A canonical example would be the off-diagonal terms in a Hamiltonian matrix in quantum physics. Recent years have seen an increasing interest to extend the tools of network science when the weight of edges are complex numbers. Here, we focus on the case when the weight matrix is Hermitian, a reasonable assumption in many applications, and investigate both structural and dynamical properties of the complex-weighted networks. Building on concepts from signed graphs, we introduce a classification of complex-weighted networks based on the notion of structural balance, and illustrate the shared spectral properties within each type. We then apply the results to characterise the dynamics of random walks on complex-weighted networks, where local consensus can be achieved asymptotically when the graph is structurally balanced, while global consensus will be obtained when it is strictly unbalanced. Finally, we explore potential applications of our findings by generalising the notion of cut, and propose an associated spectral clustering algorithm. We also provide further characteristics of the magnetic Laplacian, associating directed networks to complex-weighted ones. The performance of the algorithm is verified on both synthetic and real networks.

cs.SI↗

arXiv2023

Multi-Scenario Ranking with Adaptive Feature Learning

Recently, Multi-Scenario Learning (MSL) is widely used in recommendation and retrieval systems in the industry because it facilitates transfer learning from different scenarios, mitigating data sparsity and reducing maintenance cost. These efforts produce different MSL paradigms by searching more optimal network structure, such as Auxiliary Network, Expert Network, and Multi-Tower Network. It is intuitive that different scenarios could hold their specific characteristics, activating the user's intents quite differently. In other words, different kinds of auxiliary features would bear varying importance under different scenarios. With more discriminative feature representations refined in a scenario-aware manner, better ranking performance could be easily obtained without expensive search for the optimal network structure. Unfortunately, this simple idea is mainly overlooked but much desired in real-world systems.Further analysis also validates the rationality of adaptive feature learning under a multi-scenario scheme. Moreover, our A/B test results on the Alibaba search advertising platform also demonstrate that Maria is superior in production environments.

cs.IR↗

arXiv2023

Clustered Federated Learning via Generalized Total Variation Minimization

We study optimization methods to train local (or personalized) models for decentralized collections of local datasets with an intrinsic network structure. This network structure arises from domain-specific notions of similarity between local datasets. Examples for such notions include spatio-temporal proximity, statistical dependencies or functional relations. Our main conceptual contribution is to formulate federated learning as generalized total variation (GTV) minimization. This formulation unifies and considerably extends existing federated learning methods. It is highly flexible and can be combined with a broad range of parametric models, including generalized linear models or deep neural networks. Our main algorithmic contribution is a fully decentralized federated learning algorithm. This algorithm is obtained by applying an established primal-dual method to solve GTV minimization. It can be implemented as message passing and is robust against inexact computations that arise from limited computational resources including processing time or bandwidth. Our main analytic contribution is an upper bound on the deviation between the local model parameters learnt by our algorithm and an oracle-based clustered federated learning method. This upper bound reveals conditions on the local models and the network structure of local datasets such that GTV minimization is able to pool (nearly) homogeneous local datasets.

cs.LG↗

arXiv2023

Type I critical dynamical scalarization and descalarization in Einstein-Maxwell-scalar theory

We investigated the critical dynamical scalarization and descalarization of black holes within the framework of the Einstein-Maxwell-scalar theory featuring higher-order coupling functions. Both the critical scalarization and descalarization displayed first-order phase transitions. When examining the nonlinear dynamics near the threshold, we always observed critical solutions that are linearly unstable static scalarized black holes. The critical dynamical scalarization and descalarization share certain similarities with the type I critical gravitational collapse. However, their initial configurations, critical solutions, and final outcomes differ significantly. To provide further insights into the dynamical results, we conducted a comparative analysis involving static solutions and perturbative analysis.

gr-qc↗

arXiv2023

Dynamic and Thermodynamic Stability of Charged Perfect Fluid Stars

We perform a thorough analysis of the dynamic and thermodynamic stability for the charged perfect fluid star by applying the Wald formalism to the Lagrangian formulation of Einstein-Maxwell-charged fluid system. As a result, we find that neither the presence of the additional electromagnetic field nor the Lorentz force experienced by the charged fluid makes any obstruction to the key steps towards the previous results obtained for the neutral perfect fluid star. Therefore, the criterion for the dynamic stability of our charged star in dynamic equilibrium within the symplectic complement of the trivial perturbaions with the ADM $3$-momentum unchanged is given by the non-negativity of the canonical energy associated with the timelike Killing field, where it is further shown for both non-axisymmetric and axisymmetric perturbations that the dynamic stability against these restricted perturbations also implies the dynamic stability against more generic perturbations. On the other hand, the necessary condition for the thermodynamic stability of our charged star in thermodynamic equilibrium is given by the positivity of the canonical energy of all the linear on-shell perturbations with the ADM angular momentum unchanged in the comoving frame, which is equivalent to the positivity of the canonical energy associated with the timelike Killing field when restricted onto the axisymmetric perturbations. As a by-product, we further establish the equivalence of the dynamic and thermodynamic stability with respect to the spherically symmetric perturbations of the static, spherically symmetric isentropic charged star.

gr-qc↗

arXiv2023

Holographic dissipation prefers the Landau over the Keldysh form

Although holographic duality has been regarded as a complementary tool in helping understand the non-equilibrium dynamics of strongly coupled many-body systems, it still remains a remarkable challenge how to confront its predictions quantitatively with the real experimental scenarios. By matching the holographic vortex dynamics with the phenomenological dissipative Gross-Pitaeviskii models, we find that the holographic dissipation mechanism can be well captured by the Landau form rather than the Keldysh one, although the latter is much more widely used in numerical simulations. Our finding is expected to open up novel avenues for facilitating the quantitative test of the holographic predictions against the upcoming experimental data. Our result also provides a prime example how holographic duality can help select proper phenomenological models to describe far-from-equilibrium nonlinear dynamics beyond the hydrodynamic regime.

hep-th↗

arXiv2023

Splitting of doubly quantized vortices in holographic superfluid of finite temperature

The temperature effect on the linear instability and the splitting process of a doubly quantized vortex is studied. Using the linear perturbation theory to calculate out the quasi-normal modes of the doubly quantized vortex, we find that the imaginary part of the unstable mode increases with the temperature till some turning temperature, after which the imaginary part of the unstable mode decreases with the temperature. On the other hand, by the fully non-linear numerical simulations, we also examine the real time splitting process of the doubly quantized vortex, where not only do the split singly quantized vortex pair depart from each other, but also revolve around each other. In particular, the characteristic time scale for the splitting process is identified and its temperature dependence is found to be in good agreement with the linear instability analysis in the sense that the larger the imaginary part of the unstable mode is, the longer the splitting time is. Such a temperature effect is expected to be verified in the cold atom experiments in the near future.

hep-th↗

arXiv2023

Optimal TDI2.0 of sensitive curve for main space GW detector

Time-delay interferometry (TDI) is a crucial technology for space-based gravitational wave detectors. Previous studies have identified the optimal TDI configuration for the first-generation. In this research, we used an Algebraic approach theory to describe the TDI space and employed a method to maximize the signal-to-noise ratio (SNR) to derive the optimal TDI combination for the second-generation. When this combination is used in the sensitivity curve, we observed enhancements of up to 1.91 times in the low-frequency domain and 2 to 3.5 times in the high-frequency domain compared to the Michelson combination. Furthermore, changes in the detector index significantly affect the optimization effect. We also present detection scenarios for several low-frequency gravitational wave sources. Compared to the first-generation TDI optimization, the SNR value for verification double white dwarfs (DWD) and the detection rate for DWD increase by 16.5%.

astro-ph.IM↗

arXiv2023

Opportunities and challenges of ChatGPT for design knowledge management

Recent advancements in Natural Language Processing have opened up new possibilities for the development of large language models like ChatGPT, which can facilitate knowledge management in the design process by providing designers with access to a vast array of relevant information. However, integrating ChatGPT into the design process also presents new challenges. In this paper, we provide a concise review of the classification and representation of design knowledge, and past efforts to support designers in acquiring knowledge. We analyze the opportunities and challenges that ChatGPT presents for knowledge management in design and propose promising future research directions. A case study is conducted to validate the advantages and drawbacks of ChatGPT, showing that designers can acquire targeted knowledge from various domains, but the quality of the acquired knowledge is highly dependent on the prompt.

cs.IR↗

arXiv2023

Hierarchically Self-Supervised Transformer for Human Skeleton Representation Learning

Despite the success of fully-supervised human skeleton sequence modeling, utilizing self-supervised pre-training for skeleton sequence representation learning has been an active field because acquiring task-specific skeleton annotations at large scales is difficult. Recent studies focus on learning video-level temporal and discriminative information using contrastive learning, but overlook the hierarchical spatial-temporal nature of human skeletons. Different from such superficial supervision at the video level, we propose a self-supervised hierarchical pre-training scheme incorporated into a hierarchical Transformer-based skeleton sequence encoder (Hi-TRS), to explicitly capture spatial, short-term, and long-term temporal dependencies at frame, clip, and video levels, respectively. To evaluate the proposed self-supervised pre-training scheme with Hi-TRS, we conduct extensive experiments covering three skeleton-based downstream tasks including action recognition, action detection, and motion prediction. Under both supervised and semi-supervised evaluation protocols, our method achieves the state-of-the-art performance. Additionally, we demonstrate that the prior knowledge learned by our model in the pre-training stage has strong transfer capability for different downstream tasks.

cs.CV↗

arXiv2023

Revisiting Multimodal Representation in Contrastive Learning: From Patch and Token Embeddings to Finite Discrete Tokens

Contrastive learning-based vision-language pre-training approaches, such as CLIP, have demonstrated great success in many vision-language tasks. These methods achieve cross-modal alignment by encoding a matched image-text pair with similar feature embeddings, which are generated by aggregating information from visual patches and language tokens. However, direct aligning cross-modal information using such representations is challenging, as visual patches and text tokens differ in semantic levels and granularities. To alleviate this issue, we propose a Finite Discrete Tokens (FDT) based multimodal representation. FDT is a set of learnable tokens representing certain visual-semantic concepts. Both images and texts are embedded using shared FDT by first grounding multimodal inputs to FDT space and then aggregating the activated FDT representations. The matched visual and semantic concepts are enforced to be represented by the same set of discrete tokens by a sparse activation constraint. As a result, the granularity gap between the two modalities is reduced. Through both quantitative and qualitative analyses, we demonstrate that using FDT representations in CLIP-style models improves cross-modal alignment and performance in visual recognition and vision-language downstream tasks. Furthermore, we show that our method can learn more comprehensive representations, and the learned FDT capture meaningful cross-modal correspondence, ranging from objects to actions and attributes.

cs.CV↗

arXiv2023

HiCLIP: Contrastive Language-Image Pretraining with Hierarchy-aware Attention

The success of large-scale contrastive vision-language pretraining (CLIP) has benefited both visual recognition and multimodal content understanding. The concise design brings CLIP the advantage in inference efficiency against other vision-language models with heavier cross-attention fusion layers, making it a popular choice for a wide spectrum of downstream tasks. However, CLIP does not explicitly capture the hierarchical nature of high-level and fine-grained semantics conveyed in images and texts, which is arguably critical to vision-language understanding and reasoning. To this end, we equip both the visual and language branches in CLIP with hierarchy-aware attentions, namely Hierarchy-aware CLIP (HiCLIP), to progressively discover semantic hierarchies layer-by-layer from both images and texts in an unsupervised manner. As a result, such hierarchical aggregation significantly improves the cross-modal alignment. To demonstrate the advantages of HiCLIP, we conduct qualitative analysis on its unsupervised hierarchy induction during inference, as well as extensive quantitative experiments on both visual recognition and vision-language downstream tasks.

cs.CV↗

arXiv2023

Supersolidity-related phenomena in holographic superfluid: cnoidal wave

The candidate of supersolid-like state, cnoidal wave, is investigated in finite temperature holographic superfluid model for the first time. We find by giving different source $a_x$ for the particle current density $\langle j^{x}\rangle$, different kinds of superflow states can be obtained numerically. And based on $a_x$, three limiting cases of cnoidal waves can be found easily as well as the general cnoidal wave solution. The chemical potential $μ$ and particle current density $\langle j^x \rangle$, as functions of source $a_x$, are calculated for these superflow states and are compared with homogeneous superflow. We find as we increasing $a_x$, cnoidal waves will enter into the uniform limit, which reflects in the confluence of the behavior of $μ(a_x)$ and $\langle j^x(a_x) \rangle$ between cnoidal wave and homogeneous superflow. Based on the quasi-normal modes, we show the cnodial waves are always dynamically unstable due to the finite temperature, while the energetic stability is influenced by the particle current density. All these evidences manifest that the cnoidal wave can be seen as an \textcolor{black}{unstable excited states} with supersolidity in finite temperature superfluid system.

hep-th↗

arXiv2023

Knowledge Distillation to Ensemble Global and Interpretable Prototype-Based Mammogram Classification Models

State-of-the-art (SOTA) deep learning mammogram classifiers, trained with weakly-labelled images, often rely on global models that produce predictions with limited interpretability, which is a key barrier to their successful translation into clinical practice. On the other hand, prototype-based models improve interpretability by associating predictions with training image prototypes, but they are less accurate than global models and their prototypes tend to have poor diversity. We address these two issues with the proposal of BRAIxProtoPNet++, which adds interpretability to a global model by ensembling it with a prototype-based model. BRAIxProtoPNet++ distills the knowledge of the global model when training the prototype-based model with the goal of increasing the classification accuracy of the ensemble. Moreover, we propose an approach to increase prototype diversity by guaranteeing that all prototypes are associated with different training images. Experiments on weakly-labelled private and public datasets show that BRAIxProtoPNet++ has higher classification accuracy than SOTA global and prototype-based models. Using lesion localisation to assess model interpretability, we show BRAIxProtoPNet++ is more effective than other prototype-based models and post-hoc explanation of global models. Finally, we show that the diversity of the prototypes learned by BRAIxProtoPNet++ is superior to SOTA prototype-based approaches.

cs.CV↗

arXiv2022

Descalarization by Quenching Charged Hairy Black Hole in asymptotically AdS spacetime

In this work, we study the real-time dynamics of the charged hairy black hole with the time-dependent source of scalar field in asymptotically anti-de Sitter (AdS) spacetime. The numerical results reveal a novel descalarization mechanism. In order to obtain the hairy black hole as the initial data for the quench process, we first analyze the quasi-normal modes of the massive complex scalar field on the Reissner-Nordström anti-de Sitter (RN-AdS) black hole background. We find the dominant unstable modes for large and small RN-AdS black holes come from the zero-damped modes and AdS modes, respectively. Then, the unstable RN-AdS black holes are perturbed to trigger the transition to hairy black holes. With the hairy black hole in hand, we specify a time dependent scalar source for the system. As the source is turned on, the electric charge, energy and scalar condensation of the system start to oscillate with the entropy increasing monotonically. Finally, with the decay of the scalar source, the system gradually settles down to a new state. Interestingly, the final state of the evolution could be a hairy black hole with less scalar condensation, a RN-AdS black hole or a Schwarzschild-AdS black hole, which depends on the quench strength. However, as long as the quench strength is large enough, the system always loses all the electric charge and converges to the Schwarzschild-AdS black hole.

hep-th↗

arXiv2022

Critical Dynamics in Holographic First-Order Phase Transition

We study the critical phenomena of the dynamical transition from a metastable state to a stable state in the model of first-order phase transition via two different triggering mechanisms. Three universal stages during the fully nonlinear evolution are extracted. On the one side, by perturbing the scalar source, an isolated seed nucleus is injected into an initial homogeneous state in the supercooled region. For critical parameters of the seed nucleus, the real-time dynamics reveal that the system will converge to a critically unstable state. For supercritical parameters, the system exhibits a phase separation, while for subcritical parameters falls back to homogeneous. The shape independence of the seed nucleus is also investigated, which implies that the critical phenomena are universal. On the other side, we propose a novel mechanism to render the critical phenomena via a collision of two gravitational shock waves on the dual geometries. Specifying a collision velocity, the initial system can be also attracted to a critically unstable state. Aside from these dynamical constructions, we also quantitatively analyze the critical nucleus preventing the system from reaching the final phase separation. We find the depth of the critical nucleus increases almost linearly with the temperature, which implies that the hotter the supercooled state is, the harder for it to trigger phase separation.

hep-th↗