arXiv subjects

Bo Xiong

Publications and source records attributed to Bo Xiong.

At least 55 records · Page 3Linked to original sources

arXiv2024

Predictive Multiplicity of Knowledge Graph Embeddings in Link Prediction

Knowledge graph embedding (KGE) models are often used to predict missing links for knowledge graphs (KGs). However, multiple KG embeddings can perform almost equally well for link prediction yet give conflicting predictions for unseen queries. This phenomenon is termed \textit{predictive multiplicity} in the literature. It poses substantial risks for KGE-based applications in high-stake domains but has been overlooked in KGE research. We define predictive multiplicity in link prediction, introduce evaluation metrics and measure predictive multiplicity for representative KGE methods on commonly used benchmark datasets. Our empirical study reveals significant predictive multiplicity in link prediction, with $8\%$ to $39\%$ testing queries exhibiting conflicting predictions. We address this issue by leveraging voting methods from social choice theory, significantly mitigating conflicts by $66\%$ to $78\%$ in our experiments.

cs.AI↗

arXiv2024

Geometric Relational Embeddings

Relational representation learning transforms relational data into continuous and low-dimensional vector representations. However, vector-based representations fall short in capturing crucial properties of relational data that are complex and symbolic. We propose geometric relational embeddings, a paradigm of relational embeddings that respect the underlying symbolic structures. Specifically, this dissertation introduces various geometric relational embedding models capable of capturing: 1) complex structured patterns like hierarchies and cycles in networks and knowledge graphs; 2) logical structures in ontologies and logical constraints applicable for constraining machine learning model outputs; and 3) high-order structures between entities and relations. Our results obtained from benchmark and real-world datasets demonstrate the efficacy of geometric relational embeddings in adeptly capturing these discrete, symbolic, and structured properties inherent in relational data.

cs.LG↗

arXiv2024

Generating $SROI^-$ Ontologies via Knowledge Graph Query Embedding Learning

Query embedding approaches answer complex logical queries over incomplete knowledge graphs (KGs) by computing and operating on low-dimensional vector representations of entities, relations, and queries. However, current query embedding models heavily rely on excessively parameterized neural networks and cannot explain the knowledge learned from the graph. We propose a novel query embedding method, AConE, which explains the knowledge learned from the graph in the form of $SROI^-$ description logic axioms while being more parameter-efficient than most existing approaches. AConE associates queries to a $SROI^-$ description logic concept. Every $SROI^-$ concept is embedded as a cone in complex vector space, and each $SROI^-$ relation is embedded as a transformation that rotates and scales cones. We show theoretically that AConE can learn $SROI^-$ axioms, and defines an algebra whose operations correspond one to one to $SROI^-$ description logic concept constructs. Our empirical study on multiple query datasets shows that AConE achieves superior results over previous baselines with fewer parameters. Notably on the WN18RR dataset, AConE achieves significant improvement over baseline models. We provide comprehensive analyses showing that the capability to represent axioms positively impacts the results of query answering.

cs.AI↗

arXiv2024

Room-Temperature Multiferroic Skyrmions in LiNbO3 with enhancement in electric-optical property

LiNbO3 (LN) is renowned for its exceptional ferroelectric properties, particularly its notable linear electro-optical (EO) effect, which is highly advantageous for various applications such as high-speed communication, optical computation, and quantum information processing. Compared to its ferroelectric properties, the magnetism of LN is not attractive enough due to its weak ferromagnetic nature. Theoretical studies suggest that LN may exhibit a novel magnetoelectric coupling via ferroelectrically-induced ferromagnetism. However, this mechanism has not yet been experimentally validated in any materials, presenting significant challenges for research. In this study, we provide the first experimental evidence supporting the mechanism of ferroelectrically-induced ferromagnetism in LN, including observations of the Dzyaloshinskii-Moriya interaction (DMI) and magnetoelectric coupling. Additionally, we have identified various multiferroic skyrmions, within which ferroelectric polarization signals are detectable. These signals can be influenced by the magnetic vortex structures, indicating a magnetoelectric coupling nature. Currently, they are the only multiferroic skyrmions that can keep stable at room temperature. Moreover, these magnetic textures significantly affect the ferroelectric properties, as demonstrated by an enhancement of the linear electro-optic effect of LN by over 200%. Given the novel magnetoelectric coupling mechanism, the potential of multiferroic skyrmions in spintronics and advanced data storage, and the extensive use of LN EO modulators, our research has significant implications for condensed matter physics, multiferroic materials, and optoelectronics.

cond-mat.mtrl-sci↗

arXiv2024

Alleviating Over-Smoothing via Aggregation over Compact Manifolds

Graph neural networks (GNNs) have achieved significant success in various applications. Most GNNs learn the node features with information aggregation of its neighbors and feature transformation in each layer. However, the node features become indistinguishable after many layers, leading to performance deterioration: a significant limitation known as over-smoothing. Past work adopted various techniques for addressing this issue, such as normalization and skip-connection of layer-wise output. After the study, we found that the information aggregations in existing work are all contracted aggregations, with the intrinsic property that features will inevitably converge to the same single point after many layers. To this end, we propose the aggregation over compacted manifolds method (ACM) that replaces the existing information aggregation with aggregation over compact manifolds, a special type of manifold, which avoids contracted aggregations. In this work, we theoretically analyze contracted aggregation and its properties. We also provide an extensive empirical evaluation that shows ACM can effectively alleviate over-smoothing and outperforms the state-of-the-art. The code can be found in https://github.com/DongzhuoranZhou/ACM.git.

cs.LG↗

arXiv2024

Stable room-temperature multiferroic skyrmions in lithium niobate with enhanced Pockels effect

Lithium Niobate (LN) is a ferroelectric material with exceptional electrical characteristics, including high piezoelectricity, high Pockels effect, etc. These properties make it a promising platform for numerous fields such as high-speed communication, optical computation, and quantum information processing. Besides these, the introduction of magnetic structures to LN holds significant potential to achieve magnetoelectric coupling, which can be applied in magnetic memory and data-processing devices with high efficiency. Here, for the first time, we observe a special topological magnetic structure called magnetic skyrmion in LN (SK-LN) by the combination of magnetic field annealing and rapid annealing processes . Compared to the magnetic skyrmions reported in magnetic systems, SK-LN exhibit exceptionally high stability. Additionally, the center of the magnetic vortex exhibits spontaneous ferroelectric polarization, indicating its multiferroic characteristic. With the excitation of these multiferroic skyrmions, the modulation efficiency of the electro-optical (EO) modulator fabricated on thin film lithium niobate on insulator (LNOI) wafer was found to be enhanced from 1.98 V*cm to 0.63 V*cm. It is considered that the multiferroic skyrmions significantly enhance the Pockels coefficient of LN to 101 pm/V, nearly three times the result (32pm/V) reported previously.

cond-mat.mtrl-sci↗

arXiv2024

Dynamical Generation of Spin Current and Phase Slip in Exciton-Polariton Condensates

We show that how to generate propagation of spin degree in spin-symmetric exciton-polariton condensates in a semiconductor microcavity. Due to the stimulated spin-dependent scattering between hot excitons and condensates, exciton polaritons form a circular polarized condensate with spontaneous breaking of the spin rotation symmetry. The spin antiferromagnetic state is developed evidently from the density and spin flow pumped by localized laser source. The low energy spin current is identified where the steady state is characterized by the oscillating spin pattern. Finally, we predict via simulation how to dynamical generation of phase slip where ring-shape phase jump shows the behavior of splitting and joining together.

cond-mat.mes-hall↗

arXiv2024

zrLLM: Zero-Shot Relational Learning on Temporal Knowledge Graphs with Large Language Models

Modeling evolving knowledge over temporal knowledge graphs (TKGs) has become a heated topic. Various methods have been proposed to forecast links on TKGs. Most of them are embedding-based, where hidden representations are learned to represent knowledge graph (KG) entities and relations based on the observed graph contexts. Although these methods show strong performance on traditional TKG forecasting (TKGF) benchmarks, they face a strong challenge in modeling the unseen zero-shot relations that have no prior graph context. In this paper, we try to mitigate this problem as follows. We first input the text descriptions of KG relations into large language models (LLMs) for generating relation representations, and then introduce them into embedding-based TKGF methods. LLM-empowered representations can capture the semantic information in the relation descriptions. This makes the relations, whether seen or unseen, with similar semantic meanings stay close in the embedding space, enabling TKGF models to recognize zero-shot relations even without any observed graph context. Experimental results show that our approach helps TKGF models to achieve much better performance in forecasting the facts with previously unseen relations, while still maintaining their ability in link forecasting regarding seen relations.

cs.AI↗

arXiv2024

Multi-Scale Semantic Segmentation with Modified MBConv Blocks

Recently, MBConv blocks, initially designed for efficiency in resource-limited settings and later adapted for cutting-edge image classification performances, have demonstrated significant potential in image classification tasks. Despite their success, their application in semantic segmentation has remained relatively unexplored. This paper introduces a novel adaptation of MBConv blocks specifically tailored for semantic segmentation. Our modification stems from the insight that semantic segmentation requires the extraction of more detailed spatial information than image classification. We argue that to effectively perform multi-scale semantic segmentation, each branch of a U-Net architecture, regardless of its resolution, should possess equivalent segmentation capabilities. By implementing these changes, our approach achieves impressive mean Intersection over Union (IoU) scores of 84.5% and 84.0% on the Cityscapes test and validation datasets, respectively, demonstrating the efficacy of our proposed modifications in enhancing semantic segmentation performance.

cs.CV↗

arXiv2024

ChatRule: Mining Logical Rules with Large Language Models for Knowledge Graph Reasoning

Logical rules are essential for uncovering the logical connections between relations, which could improve reasoning performance and provide interpretable results on knowledge graphs (KGs). Although there have been many efforts to mine meaningful logical rules over KGs, existing methods suffer from computationally intensive searches over the rule space and a lack of scalability for large-scale KGs. Besides, they often ignore the semantics of relations which is crucial for uncovering logical connections. Recently, large language models (LLMs) have shown impressive performance in the field of natural language processing and various applications, owing to their emergent ability and generalizability. In this paper, we propose a novel framework, ChatRule, unleashing the power of large language models for mining logical rules over knowledge graphs. Specifically, the framework is initiated with an LLM-based rule generator, leveraging both the semantic and structural information of KGs to prompt LLMs to generate logical rules. To refine the generated rules, a rule ranking module estimates the rule quality by incorporating facts from existing KGs. Last, the ranked rules can be used to conduct reasoning over KGs. ChatRule is evaluated on four large-scale KGs, w.r.t. different rule quality metrics and downstream tasks, showing the effectiveness and scalability of our method.

cs.AI↗

arXiv2023

NestE: Modeling Nested Relational Structures for Knowledge Graph Reasoning

Reasoning with knowledge graphs (KGs) has primarily focused on triple-shaped facts. Recent advancements have been explored to enhance the semantics of these facts by incorporating more potent representations, such as hyper-relational facts. However, these approaches are limited to \emph{atomic facts}, which describe a single piece of information. This paper extends beyond \emph{atomic facts} and delves into \emph{nested facts}, represented by quoted triples where subjects and objects are triples themselves (e.g., ((\emph{BarackObama}, \emph{holds\_position}, \emph{President}), \emph{succeed\_by}, (\emph{DonaldTrump}, \emph{holds\_position}, \emph{President}))). These nested facts enable the expression of complex semantics like \emph{situations} over time and \emph{logical patterns} over entities and relations. In response, we introduce NestE, a novel KG embedding approach that captures the semantics of both atomic and nested factual knowledge. NestE represents each atomic fact as a $1\times3$ matrix, and each nested relation is modeled as a $3\times3$ matrix that rotates the $1\times3$ atomic fact matrix through matrix multiplication. Each element of the matrix is represented as a complex number in the generalized 4D hypercomplex space, including (spherical) quaternions, hyperbolic quaternions, and split-quaternions. Through thorough analysis, we demonstrate the embedding's efficacy in capturing diverse logical patterns over nested facts, surpassing the confines of first-order logic-like expressions. Our experimental results showcase NestE's significant performance gains over current baselines in triple prediction and conditional link prediction. The code and pre-trained models are open available at https://github.com/xiongbo010/NestE.

cs.AI↗

arXiv2023

TD-Net: A Tri-domain network for sparse-view CT reconstruction

Sparse-view CT reconstruction, aimed at reducing X-ray radiation risks, frequently suffers from image quality degradation, manifested as noise and artifacts. Existing post-processing and dual-domain techniques, although effective in radiation reduction, often lead to over-smoothed results, compromising diagnostic clarity. Addressing this, we introduce TD-Net, a pioneering tri-domain approach that unifies sinogram, image, and frequency domain optimizations. By incorporating Frequency Supervision Module(FSM), TD-Net adeptly preserves intricate details, overcoming the prevalent over-smoothing issue. Extensive evaluations demonstrate TD-Net's superior performance in reconstructing high-quality CT images from sparse views, efficiently balancing radiation safety and image fidelity. The enhanced capabilities of TD-Net in varied noise scenarios highlight its potential as a breakthrough in medical imaging.

eess.IV↗

arXiv2023

INeAT: Iterative Neural Adaptive Tomography

Computed Tomography (CT) with its remarkable capability for three-dimensional imaging from multiple projections, enjoys a broad range of applications in clinical diagnosis, scientific observation, and industrial detection. Neural Adaptive Tomography (NeAT) is a recently proposed 3D rendering method based on neural radiance field for CT, and it demonstrates superior performance compared to traditional methods. However, it still faces challenges when dealing with the substantial perturbations and pose shifts encountered in CT scanning processes. Here, we propose a neural rendering method for CT reconstruction, named Iterative Neural Adaptive Tomography (INeAT), which incorporates iterative posture optimization to effectively counteract the influence of posture perturbations in data, particularly in cases involving significant posture variations. Through the implementation of a posture feedback optimization strategy, INeAT iteratively refines the posture corresponding to the input images based on the reconstructed 3D volume. We demonstrate that INeAT achieves artifact-suppressed and resolution-enhanced reconstruction in scenarios with significant pose disturbances. Furthermore, we show that our INeAT maintains comparable reconstruction performance to stable-state acquisitions even using data from unstable-state acquisitions, which significantly reduces the time required for CT scanning and relaxes the stringent requirements on imaging hardware systems, underscoring its immense potential for applications in short-time and low-cost CT technology.

eess.IV↗

arXiv2023

Path-dependent correlations in dynamically tuned Ising models and its short-time behavior: application of Magnus expansion

We study the buildup of antiferromagnetic (AF) correlation in the dynamically tuned Ising models which are realized by the Rydberg atomic system. In short-time scale, we apply Magnus expansion (ME) to derive the high-order analytic expression of the connected correlation functions and compare it with exactly numerical results for the different lattice geometries, e.g., 1D chain, $2 \times n$ lattice, and $n \times n$ lattice. It is shown that the high-order expansion is required to describe accurately the buildup of AF correlation in the quench dynamics. Moreover, through a 2D square lattice, we find that the magnitude of AF correlation for the same Manhattan distance is proportional to the number of the shortest paths in a sufficiently long time until long and distinct paths are involved significantly with the buildup of the correlation. Finally, we propose an applicable experimental setup to realize our findings.

cond-mat.quant-gas↗

arXiv2023

PC-bzip2: a phase-space continuity enhanced lossless compression algorithm for light field microscopy data

Light-field fluorescence microscopy (LFM) is a powerful elegant compact method for long-term high-speed imaging of complex biological systems, such as neuron activities and rapid movements of organelles. LFM experiments typically generate terabytes image data and require a huge number of storage space. Some lossy compression algorithms have been proposed recently with good compression performance. However, since the specimen usually only tolerates low power density illumination for long-term imaging with low phototoxicity, the image signal-to-noise ratio (SNR) is relative-ly low, which will cause the loss of some efficient position or intensity information by using such lossy compression al-gorithms. Here, we propose a phase-space continuity enhanced bzip2 (PC-bzip2) lossless compression method for LFM data as a high efficiency and open-source tool, which combines GPU-based fast entropy judgement and multi-core-CPU-based high-speed lossless compression. Our proposed method achieves almost 10% compression ratio improvement while keeping the capability of high-speed compression, compared with original bzip2. We evaluated our method on fluorescence beads data and fluorescence staining cells data with different SNRs. Moreover, by introducing the temporal continuity, our method shows the superior compression ratio on time series data of zebrafish blood vessels.

eess.IV↗

arXiv2023

A Survey on Temporal Knowledge Graph Completion: Taxonomy, Progress, and Prospects

Temporal characteristics are prominently evident in a substantial volume of knowledge, which underscores the pivotal role of Temporal Knowledge Graphs (TKGs) in both academia and industry. However, TKGs often suffer from incompleteness for three main reasons: the continuous emergence of new knowledge, the weakness of the algorithm for extracting structured information from unstructured data, and the lack of information in the source dataset. Thus, the task of Temporal Knowledge Graph Completion (TKGC) has attracted increasing attention, aiming to predict missing items based on the available information. In this paper, we provide a comprehensive review of TKGC methods and their details. Specifically, this paper mainly consists of three components, namely, 1)Background, which covers the preliminaries of TKGC methods, loss functions required for training, as well as the dataset and evaluation protocol; 2)Interpolation, that estimates and predicts the missing elements or set of elements through the relevant available information. It further categorizes related TKGC methods based on how to process temporal information; 3)Extrapolation, which typically focuses on continuous TKGs and predicts future events, and then classifies all extrapolation methods based on the algorithms they utilize. We further pinpoint the challenges and discuss future research directions of TKGC.

cs.AI↗

arXiv2023

Structure and dynamics of binary Bose-Einstein condensates with vortex phase imprinting

The combination of multi-component Bose-Einstein condensates (BECs) and phase imprinting techniques provides an ideal platform for exploring nonlinear dynamics and investigating the quantum transport properties of superfluids. In this paper, we study abundant density structures and corresponding dynamics of phase-separated binary Bose-Einstein condensates with phase-imprinted single vortex or vortex dipole. By adjusting the ratio between the interspecies and intraspecies interactions, and the locations of the phase singularities, the typical density profiles such as ball-shell structures, crescent-gibbous structures, Matryoshka-like structures, sector-sector structures and sandwich-type structures appear, and the phase diagrams are obtained. The dynamics of these structures exhibit diverse properties, including the penetration of vortex dipoles, emergence of half-vortex dipoles, co-rotation of sectors, and oscillation between sectors. The pinning effects induced by a potential defect are also discussed, which is useful for controlling and manipulating individual quantum states.

cond-mat.quant-gas↗

arXiv2023

Shrinking Embeddings for Hyper-Relational Knowledge Graphs

Link prediction on knowledge graphs (KGs) has been extensively studied on binary relational KGs, wherein each fact is represented by a triple. A significant amount of important knowledge, however, is represented by hyper-relational facts where each fact is composed of a primal triple and a set of qualifiers comprising a key-value pair that allows for expressing more complicated semantics. Although some recent works have proposed to embed hyper-relational KGs, these methods fail to capture essential inference patterns of hyper-relational facts such as qualifier monotonicity, qualifier implication, and qualifier mutual exclusion, limiting their generalization capability. To unlock this, we present \emph{ShrinkE}, a geometric hyper-relational KG embedding method aiming to explicitly model these patterns. ShrinkE models the primal triple as a spatial-functional transformation from the head into a relation-specific box. Each qualifier ``shrinks'' the box to narrow down the possible answer set and, thus, realizes qualifier monotonicity. The spatial relationships between the qualifier boxes allow for modeling core inference patterns of qualifiers such as implication and mutual exclusion. Experimental results demonstrate ShrinkE's superiority on three benchmarks of hyper-relational KGs.

cs.AI↗