arXiv subjects

Bo Liu

Publications and source records attributed to Bo Liu.

At least 415 records · Page 23Linked to original sources

arXiv2023

A Syntactic Adaptive Problem Solver Learning Landscape Structures for Scheduling in Clinical Laboratory

This paper attempts to derive a mathematical formulation for real-practice clinical laboratory schedul-ing, and to present a syntactic adaptive problem solver by leveraging landscape structures. After formulating scheduling of medical tests as a distributed scheduling problem in heterogeneous, flexible job shop environment, we establish a mixed integer programming model to minimize mean test turn-around time. Preliminary landscape analysis sustains that these clinics-orientated scheduling instances are difficult to solve. The search difficulty motivates the search for an adaptive problem solver to reduce repetitive algorithm-tuning work, but with a guaranteed convergence. Yet, under a search strategy, relatedness from exploitation competence to landscape topology is not transparent. Under strategies that impose different-magnitude perturbations, we investigate changes in landscape struc-ture and find that disturbance amplitude, local-global optima connectivity, landscape's ruggedness and plateau size fairly predict strategies' efficacy. Medium-size instances of 100 tasks are easier un-der smaller-perturbation strategies that lead to smoother landscapes with smaller plateaus. For large-size instances of 200-500 tasks, existing strategies at hand, having either larger or smaller perturba-tions, face more rugged landscapes with larger plateaus that impede search. Our hypothesis that me-dium perturbations may generate smoother landscapes with smaller plateaus drives our design of this new strategy and its verification by experiments. Composite neighborhoods managed by meta-Lamarckian learning show beyond average performance, implying reliability when prior knowledge of landscape is unknown.

math.OC↗

arXiv2023

Multi-hop Commonsense Knowledge Injection Framework for Zero-Shot Commonsense Question Answering

Commonsense question answering (QA) research requires machines to answer questions based on commonsense knowledge. However, this research requires expensive labor costs to annotate data as the basis of research, and models that rely on fine-tuning paradigms only apply to specific tasks, rather than learn a general commonsense reasoning ability. As a more robust method, zero-shot commonsense question answering shows a good prospect. The current zero-shot framework tries to convert triples in commonsense knowledge graphs (KGs) into QA-form samples as the pre-trained data source to incorporate commonsense knowledge into the model. However, this method ignores the multi-hop relationship in the KG, which is also an important central problem in commonsense reasoning. In this paper, we propose a novel multi-hop commonsense knowledge injection framework. Specifically, it explores multi-hop reasoning paradigm in KGs that conform to linguistic logic, and we further propose two multi-hop QA generation methods based on KGs. Then, we utilize contrastive learning to pre-train the model with the synthetic QA dataset to inject multi-hop commonsense knowledge. Extensive experiments on five commonsense question answering benchmarks demonstrate that our framework achieves state-of-art performance.

cs.CL↗

arXiv2023

Dealing With Heterogeneous 3D MR Knee Images: A Federated Few-Shot Learning Method With Dual Knowledge Distillation

Federated Learning has gained popularity among medical institutions since it enables collaborative training between clients (e.g., hospitals) without aggregating data. However, due to the high cost associated with creating annotations, especially for large 3D image datasets, clinical institutions do not have enough supervised data for training locally. Thus, the performance of the collaborative model is subpar under limited supervision. On the other hand, large institutions have the resources to compile data repositories with high-resolution images and labels. Therefore, individual clients can utilize the knowledge acquired in the public data repositories to mitigate the shortage of private annotated images. In this paper, we propose a federated few-shot learning method with dual knowledge distillation. This method allows joint training with limited annotations across clients without jeopardizing privacy. The supervised learning of the proposed method extracts features from limited labeled data in each client, while the unsupervised data is used to distill both feature and response-based knowledge from a national data repository to further improve the accuracy of the collaborative model and reduce the communication cost. Extensive evaluations are conducted on 3D magnetic resonance knee images from a private clinical dataset. Our proposed method shows superior performance and less training time than other semi-supervised federated learning methods. Codes and additional visualization results are available at https://github.com/hexiaoxiao-cs/fedml-knee.

eess.IV↗

arXiv2023

Self-referenced Spectral Interferometry for Single-shot Characterization of Ultrashort Free-electron Laser Pulses

Attosecond x-ray pulse with known spectro-temporal information is an essential tool for the investigation of ultrafast electron dynamics in quantum systems. Ultrafast free-electron lasers (FELs) have the unique advantage on unprecedented high-intensity at x-ray wavelengths. However, no suitable method has been established so far for the spectro-temporal characterization of these ultrashort x-ray pulses. In this letter, a simple method has been proposed based on self-referenced spectral interferometry for reconstructing ultrashort FEL pulses both in temporal and spectral domains. We have demonstrated that the proposed method is reliable to reconstruct the temporal profile and phase of attosecond x-ray FEL pulses with an error of only a few-percent-level. Moreover, the first proof-of-principle experiment has been performed to achieve single-shot spectro-temporal characterization of ultrashort pulses from a high-gain FEL. The precision of the proposed method will be enhanced with the decrease of the pulse duration, paving a new way for complete attosecond pulse characterization at x-ray FELs.

physics.acc-ph↗

arXiv2023

PStrata: An R Package for Principal Stratification

Post-treatment confounding is a common problem in causal inference, including special cases of noncompliance, truncation by death, surrogate endpoint, etc. Principal stratification (Frangakis and Rubin 2002) is a general framework for defining and estimating causal effects in the presence of post-treatment confounding. A prominent special case is the instrumental variable approach to noncompliance in randomized experiments (Angrist, Imbens, and Rubin 1996). Despite its versatility, principal stratification is not accessible to the vast majority of applied researchers because its inherent latent mixture structure requires complex inference tools and highly customized programming. We develop the R package PStrata to automatize statistical analysis of principal stratification for several common scenarios. PStrata supports both Bayesian and frequentist paradigms. For the Bayesian paradigm, the computing architecture combines R, C++, Stan, where R provides user-interface, Stan automatizes posterior sampling, and C++ bridges the two by automatically generating Stan code. For the Frequentist paradigm, PStrata implements a triply-robust weighting estimator. PStrata accommodates regular outcomes and time-to-event outcomes with both unstructured and clustered data.

stat.CO↗

arXiv2023

Practical Lessons on Optimizing Sponsored Products in eCommerce

In this paper, we study multiple problems from sponsored product optimization in ad system, including position-based de-biasing, click-conversion multi-task learning, and calibration on predicted click-through-rate (pCTR). We propose a practical machine learning framework that provides the solutions to such problems without structural change to existing machine learning models, thus can be combined with most machine learning models including shallow models (e.g. gradient boosting decision trees, support vector machines). In this paper, we first propose data and feature engineering techniques to handle the aforementioned problems in ad system; after that, we evaluate the benefit of our practical framework on real-world data sets from our traffic logs from online shopping site. We show that our proposed practical framework with data and feature engineering can also handle the perennial problems in ad systems and bring increments to multiple evaluation metrics.

cs.IR↗

arXiv2023

No Place to Hide: Dual Deep Interaction Channel Network for Fake News Detection based on Data Augmentation

Online Social Network (OSN) has become a hotbed of fake news due to the low cost of information dissemination. Although the existing methods have made many attempts in news content and propagation structure, the detection of fake news is still facing two challenges: one is how to mine the unique key features and evolution patterns, and the other is how to tackle the problem of small samples to build the high-performance model. Different from popular methods which take full advantage of the propagation topology structure, in this paper, we propose a novel framework for fake news detection from perspectives of semantic, emotion and data enhancement, which excavates the emotional evolution patterns of news participants during the propagation process, and a dual deep interaction channel network of semantic and emotion is designed to obtain a more comprehensive and fine-grained news representation with the consideration of comments. Meanwhile, the framework introduces a data enhancement module to obtain more labeled data with high quality based on confidence which further improves the performance of the classification model. Experiments show that the proposed approach outperforms the state-of-the-art methods.

cs.CL↗

arXiv2023

Deformable Kernel Expansion Model for Efficient Arbitrary-shaped Scene Text Detection

Scene text detection is a challenging computer vision task due to the high variation in text shapes and ratios. In this work, we propose a scene text detector named Deformable Kernel Expansion (DKE), which incorporates the merits of both segmentation and contour-based detectors. DKE employs a segmentation module to segment the shrunken text region as the text kernel, then expands the text kernel contour to obtain text boundary by regressing the vertex-wise offsets. Generating the text kernel by segmentation enables DKE to inherit the arbitrary-shaped text region modeling capability of segmentation-based detectors. Regressing the kernel contour with some sampled vertices enables DKE to avoid the complicated pixel-level post-processing and better learn contour deformation as the contour-based detectors. Moreover, we propose an Optimal Bipartite Graph Matching Loss (OBGML) that measures the matching error between the predicted contour and the ground truth, which efficiently minimizes the global contour matching distance. Extensive experiments on CTW1500, Total-Text, MSRA-TD500, and ICDAR2015 demonstrate that DKE achieves a good tradeoff between accuracy and efficiency in scene text detection.

cs.CV↗

arXiv2023

Low-frequency Image Deep Steganography: Manipulate the Frequency Distribution to Hide Secrets with Tenacious Robustness

Image deep steganography (IDS) is a technique that utilizes deep learning to embed a secret image invisibly into a cover image to generate a container image. However, the container images generated by convolutional neural networks (CNNs) are vulnerable to attacks that distort their high-frequency components. To address this problem, we propose a novel method called Low-frequency Image Deep Steganography (LIDS) that allows frequency distribution manipulation in the embedding process. LIDS extracts a feature map from the secret image and adds it to the cover image to yield the container image. The container image is not directly output by the CNNs, and thus, it does not contain high-frequency artifacts. The extracted feature map is regulated by a frequency loss to ensure that its frequency distribution mainly concentrates on the low-frequency domain. To further enhance robustness, an attack layer is inserted to damage the container image. The retrieval network then retrieves a recovered secret image from a damaged container image. Our experiments demonstrate that LIDS outperforms state-of-the-art methods in terms of robustness, while maintaining high fidelity and specificity. By avoiding high-frequency artifacts and manipulating the frequency distribution of the embedded feature map, LIDS achieves improved robustness against attacks that distort the high-frequency components of container images.

cs.CR↗

arXiv2023

A Critical Review of Inductive Logic Programming Techniques for Explainable AI

Despite recent advances in modern machine learning algorithms, the opaqueness of their underlying mechanisms continues to be an obstacle in adoption. To instill confidence and trust in artificial intelligence systems, Explainable Artificial Intelligence has emerged as a response to improving modern machine learning algorithms' explainability. Inductive Logic Programming (ILP), a subfield of symbolic artificial intelligence, plays a promising role in generating interpretable explanations because of its intuitive logic-driven framework. ILP effectively leverages abductive reasoning to generate explainable first-order clausal theories from examples and background knowledge. However, several challenges in developing methods inspired by ILP need to be addressed for their successful application in practice. For example, existing ILP systems often have a vast solution space, and the induced solutions are very sensitive to noises and disturbances. This survey paper summarizes the recent advances in ILP and a discussion of statistical relational learning and neural-symbolic algorithms, which offer synergistic views to ILP. Following a critical review of the recent advances, we delineate observed challenges and highlight potential avenues of further ILP-motivated research toward developing self-explanatory artificial intelligence systems.

cs.LG↗

arXiv2023

Enhance Local Consistency in Federated Learning: A Multi-Step Inertial Momentum Approach

Federated learning (FL), as a collaborative distributed training paradigm with several edge computing devices under the coordination of a centralized server, is plagued by inconsistent local stationary points due to the heterogeneity of the local partial participation clients, which precipitates the local client-drifts problems and sparks off the unstable and slow convergence, especially on the aggravated heterogeneous dataset. To address these issues, we propose a novel federated learning algorithm, named FedMIM, which adopts the multi-step inertial momentum on the edge devices and enhances the local consistency for free during the training to improve the robustness of the heterogeneity. Specifically, we incorporate the weighted global gradient estimations as the inertial correction terms to guide both the local iterates and stochastic gradient estimation, which can reckon the global objective optimization on the edges' heterogeneous dataset naturally and maintain the demanding consistent iteration locally. Theoretically, we show that FedMIM achieves the $\mathcal{O}(\frac{1}{\sqrt{SKT}})$ convergence rate with a linear speedup property with respect to the number of selected clients $S$ and proper local interval $K$ in communication round $T$ without convex assumption. Empirically, we conduct comprehensive experiments on various real-world datasets and demonstrate the efficacy of the proposed FedMIM against several state-of-the-art baselines.

eess.SY↗

arXiv2023

Metric Residual Networks for Sample Efficient Goal-Conditioned Reinforcement Learning

Goal-conditioned reinforcement learning (GCRL) has a wide range of potential real-world applications, including manipulation and navigation problems in robotics. Especially in such robotics tasks, sample efficiency is of the utmost importance for GCRL since, by default, the agent is only rewarded when it reaches its goal. While several methods have been proposed to improve the sample efficiency of GCRL, one relatively under-studied approach is the design of neural architectures to support sample efficiency. In this work, we introduce a novel neural architecture for GCRL that achieves significantly better sample efficiency than the commonly-used monolithic network architecture. The key insight is that the optimal action-value function Q^*(s, a, g) must satisfy the triangle inequality in a specific sense. Furthermore, we introduce the metric residual network (MRN) that deliberately decomposes the action-value function Q(s,a,g) into the negated summation of a metric plus a residual asymmetric component. MRN provably approximates any optimal action-value function Q^*(s,a,g), thus making it a fitting neural architecture for GCRL. We conduct comprehensive experiments across 12 standard benchmark environments in GCRL. The empirical results demonstrate that MRN uniformly outperforms other state-of-the-art GCRL neural architectures in terms of sample efficiency.

cs.LG↗

arXiv2023

Principal Stratification with Time-to-Event Outcomes

Post-randomization events, also known as intercurrent events, such as treatment noncompliance and censoring due to a terminal event, are common in clinical trials. Principal stratification is a framework for causal inference in the presence of intercurrent events. Despite the extensive existing literature, there lacks generally applicable and accessible methods for principal stratification analysis with time-to-event outcomes. In this paper, we specify two causal estimands for time-to-event outcomes in principal stratification. For estimation, we adopt the general strategy of latent mixture modeling and derive the corresponding likelihood function. For computational convenience, we illustrate the general strategy with a mixture of Bayesian parametric Weibull-Cox proportional model for the outcome. We utilize the Stan programming language to obtain automatic posterior sampling of the model parameters via the Hamiltonian Monte Carlo. We provide the analytical forms of the causal estimands as functions of the model parameters and an alternative numerical method when analytical forms are not available. We apply the proposed method to the ADAPTABLE trial to evaluate the causal effect of taking 81 mg versus 325 mg aspirin on the risk of major adverse cardiovascular events.

stat.ME↗

arXiv2023

Async-fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS Level

In-memory key-value stores (IMKVSes) serve many online applications because of their efficiency. To support data backup, popular industrial IMKVSes periodically take a point-in-time snapshot of the in-memory data with the system call fork. However, this mechanism can result in latency spikes for queries arriving during the snapshot period because fork leads the engine into the kernel mode in which the engine is out-of-service for queries. In contrast to existing research focusing on optimizing snapshot algorithms, we optimize the fork operation to address the latency spikes problem from the operating system (OS) level, while keeping the data persistent mechanism in IMKVSes unchanged. Specifically, we first conduct an in-depth study to reveal the impact of the fork operation as well as the optimization techniques on query latency. Based on findings in the study, we propose Async-fork to offload the work of copying the page table from the engine (the parent process) to the child process as copying the page table dominates the execution time of fork. To keep data consistent between the parent and the child, we design the proactive synchronization strategy. Async-fork is implemented in the Linux kernel and deployed into the online Redis database in public clouds. Our experiment results show that compared with the default fork method in OS, Async-fork reduces the tail latency of queries arriving during the snapshot period by 81.76% on an 8GB instance and 99.84% on a 64GB instance.

cs.DB↗

arXiv2023

Self-supervised Hypergraph Representation Learning for Sociological Analysis

Modern sociology has profoundly uncovered many convincing social criteria for behavioural analysis. Unfortunately, many of them are too subjective to be measured and presented in online social networks. On the other hand, data mining techniques can better find data patterns but many of them leave behind unnatural understanding. In this paper, we propose a fundamental methodology to support the further fusion of data mining techniques and sociological behavioral criteria. Our highlights are three-fold: First, we propose an effective hypergraph awareness and a fast line graph construction framework. The hypergraph can more profoundly indicate the interactions between individuals and their environments because each edge in the hypergraph (a.k.a hyperedge) contains more than two nodes, which is perfect to describe social environments. A line graph treats each social environment as a super node with the underlying influence between different environments. In this way, we go beyond traditional pair-wise relations and explore richer patterns under various sociological criteria; Second, we propose a novel hypergraph-based neural network to learn social influence flowing from users to users, users to environments, environment to users, and environments to environments. The neural network can be learned via a task-free method, making our model very flexible to support various data mining tasks and sociological analysis; Third, we propose both qualitative and quantitive solutions to effectively evaluate the most common sociological criteria like social conformity, social equivalence, environmental evolving and social polarization. Our extensive experiments show that our framework can better support both data mining tasks for online user behaviours and sociological analysis.

cs.SI↗

arXiv2022

Tunable van Hove singularity without structural instability in Kagome metal CsTi$_3$Bi$_5$

In Kagome metal CsV$_3$Sb$_5$, multiple intertwined orders are accompanied by both electronic and structural instabilities. These exotic orders have attracted much recent attention, but their origins remain elusive. The newly discovered CsTi$_3$Bi$_5$ is a Ti-based Kagome metal to parallel CsV$_3$Sb$_5$. Here, we report angle-resolved photoemission experiments and first-principles calculations on pristine and Cs-doped CsTi$_3$Bi$_5$ samples. Our results reveal that the van Hove singularity (vHS) in CsTi$_3$Bi$_5$ can be tuned in a large energy range without structural instability, different from that in CsV$_3$Sb$_5$. As such, CsTi$_3$Bi$_5$ provides a complementary platform to disentangle and investigate the electronic instability with a tunable vHS in Kagome metals.

cond-mat.str-el↗

arXiv2022

Complete cavity map of the C. elegans connectome

Network structure or topology is the basis for understanding complex systems. Recently, higher-order structures have been considered as a new research direction that can provide new perspectives and phenomena. However, most existing studies have focused on simple 1-cycles and triangles, and few have explored the higher-order and non-trivial cycles. The current study focused on the cavity, which is a non-trivial cycle. We proposed a method to compute cavities with different orders based on pruning in the boundary matrix and calculated all cavities of the neural network of Caenorhabditis elegans (\emph{C. elegans}) neural network. This study reports for the first time a complete cavity map of C. elegans neural network, developing a new method for mining higher-order structures that can be applied by researchers in neuroscience, network science and other interdisciplinary fields to explore higher-order structural markers of complex systems.

q-bio.NC↗

arXiv2022

The Extreme Super-Eddington NLS1 RX J0134.2-4258 -- II. A Weak-Line Seyfert Linking to the Weak-Line Quasar

RX J0134.2-4258 is one of the most super-Eddington narrow-line Seyfert 1 (NLS1) galaxies, on which we conducted a monitoring campaign from radio to X-rays. In this paper, we present a detailed analysis of its optical/UV spectra and broadband spectral energy distribution (SED). Our study shows that the preferred black hole mass of RX J0134.2-4258 is $M_{\rm BH} \sim 2 \times 10^{7}~M_{\odot}$, giving a mass accretion rate through the outer disc of $\dot{m}_{\rm out} \sim 20$ (assuming zero spin), compared to the observed luminosity ratio $L_{\rm bol}/L_{\rm Edd} \sim 6$. This reduction in radiative efficiency is expected for super-Eddington flows, as power can be lost via advection and/or disc winds. We find that the optical/UV lines of RX J0134.2-4258 resemble those from weak-like quasars (WLQs), as it has notably weak C IV and N V emission lines. It also has drastic X-ray variability, again similar to that recently observed in some other WLQs. However, WLQs have systematically higher masses ($\gtrsim 10^8~M_{\odot}$), and lower Eddington ratios ($\dot{m}_{\rm out} \sim 1$) than RX J0134.2-4258. We compare instead to the most extreme NLS1s, with similarly large $\dot{m}_{\rm out}$ but smaller masses. These show similarly large reductions in radiative efficiency but their UV lines are not similarly wind-dominated. We suggest a new category of weak-line Seyfert (WLS) galaxies to describe sources like RX J0134.2-4258, and interpret its (so far unique) properties in a model, where the lower-disc-temperature in the higher-mass black holes leads to the UV-line-driving mechanism, which enhances the super-Eddington radiation-pressure-driven wind.

astro-ph.HE↗