Searcharxiv⌕ Search

arXiv subjects

Ziyu Zhou

Publications and source records attributed to Ziyu Zhou.

54 records · Page 3Linked to original sources
arXiv2024

Time-SSM: Simplifying and Unifying State Space Models for Time Series Forecasting

State Space Models (SSMs) have emerged as a potent tool in sequence modeling tasks in recent years. These models approximate continuous systems using a set of basis functions and discretize them to handle input data, making them well-suited for modeling time series data collected at specific frequencies from continuous systems. Despite its potential, the application of SSMs in time series forecasting remains underexplored, with most existing models treating SSMs as a black box for capturing temporal or channel dependencies. To address this gap, this paper proposes a novel theoretical framework termed Dynamic Spectral Operator, offering more intuitive and general guidance on applying SSMs to time series data. Building upon our theory, we introduce Time-SSM, a novel SSM-based foundation model with only one-seventh of the parameters compared to Mamba. Various experiments validate both our theoretical framework and the superior performance of Time-SSM.

cs.LG↗
arXiv2024

Time-optimal Flight in Cluttered Environments via Safe Reinforcement Learning

This paper addresses the problem of guiding a quadrotor through a predefined sequence of waypoints in cluttered environments, aiming to minimize the flight time while avoiding collisions. Previous approaches either suffer from prolonged computational time caused by solving complex non-convex optimization problems or are limited by the inherent smoothness of polynomial trajectory representations, thereby restricting the flexibility of movement. In this work, we present a safe reinforcement learning approach for autonomous drone racing with time-optimal flight in cluttered environments. The reinforcement learning policy, trained using safety and terminal rewards specifically designed to enforce near time-optimal and collision-free flight, outperforms current state-of-the-art algorithms. Additionally, experimental results demonstrate the efficacy of the proposed approach in achieving both minimum flight time and obstacle avoidance objectives in complex environments, with a commendable $66.7\%$ success rate in unseen, challenging settings.

cs.RO↗
arXiv2024

Learning Anatomically Consistent Embedding for Chest Radiography

Self-supervised learning (SSL) approaches have recently shown substantial success in learning visual representations from unannotated images. Compared with photographic images, medical images acquired with the same imaging protocol exhibit high consistency in anatomy. To exploit this anatomical consistency, this paper introduces a novel SSL approach, called PEAC (patch embedding of anatomical consistency), for medical image analysis. Specifically, in this paper, we propose to learn global and local consistencies via stable grid-based matching, transfer pre-trained PEAC models to diverse downstream tasks, and extensively demonstrate that (1) PEAC achieves significantly better performance than the existing state-of-the-art fully/self-supervised methods, and (2) PEAC captures the anatomical structure consistency across views of the same patient and across patients of different genders, weights, and healthy statuses, which enhances the interpretability of our method for medical image analysis.

cs.CV↗
arXiv2024

A Demographic-Conditioned Variational Autoencoder for fMRI Distribution Sampling and Removal of Confounds

Objective: fMRI and derived measures such as functional connectivity (FC) have been used to predict brain age, general fluid intelligence, psychiatric disease status, and preclinical neurodegenerative disease. However, it is not always clear that all demographic confounds, such as age, sex, and race, have been removed from fMRI data. Additionally, many fMRI datasets are restricted to authorized researchers, making dissemination of these valuable data sources challenging. Methods: We create a variational autoencoder (VAE)-based model, DemoVAE, to decorrelate fMRI features from demographics and generate high-quality synthetic fMRI data based on user-supplied demographics. We train and validate our model using two large, widely used datasets, the Philadelphia Neurodevelopmental Cohort (PNC) and Bipolar and Schizophrenia Network for Intermediate Phenotypes (BSNIP). Results: We find that DemoVAE recapitulates group differences in fMRI data while capturing the full breadth of individual variations. Significantly, we also find that most clinical and computerized battery fields that are correlated with fMRI data are not correlated with DemoVAE latents. An exception are several fields related to schizophrenia medication and symptom severity. Conclusion: Our model generates fMRI data that captures the full distribution of FC better than traditional VAE or GAN models. We also find that most prediction using fMRI data is dependent on correlation with, and prediction of, demographics. Significance: Our DemoVAE model allows for generation of high quality synthetic data conditioned on subject demographics as well as the removal of the confounding effects of demographics. We identify that FC-based prediction tasks are highly influenced by demographic confounds.

q-bio.QM↗
arXiv2024

Lightweight Facial Attractiveness Prediction Using Dual Label Distribution

Facial attractiveness prediction (FAP) aims to assess facial attractiveness automatically based on human aesthetic perception. Previous methods using deep convolutional neural networks have improved the performance, but their large-scale models have led to a deficiency in flexibility. In addition, most methods fail to take full advantage of the dataset. In this paper, we present a novel end-to-end FAP approach that integrates dual label distribution and lightweight design. The manual ratings, attractiveness score, and standard deviation are aggregated explicitly to construct a dual-label distribution to make the best use of the dataset, including the attractiveness distribution and the rating distribution. Such distributions, as well as the attractiveness score, are optimized under a joint learning framework based on the label distribution learning (LDL) paradigm. The data processing is simplified to a minimum for a lightweight design, and MobileNetV2 is selected as our backbone. Extensive experiments are conducted on two benchmark datasets, where our approach achieves promising results and succeeds in balancing performance and efficiency. Ablation studies demonstrate that our delicately designed learning modules are indispensable and correlated. Additionally, the visualization indicates that our approach can perceive facial attractiveness and capture attractive facial regions to facilitate semantic predictions. The code is available at https://github.com/enquan/2D_FAP.

cs.CV↗
arXiv2024

Consisaug: A Consistency-based Augmentation for Polyp Detection in Endoscopy Image Analysis

Colorectal cancer (CRC), which frequently originates from initially benign polyps, remains a significant contributor to global cancer-related mortality. Early and accurate detection of these polyps via colonoscopy is crucial for CRC prevention. However, traditional colonoscopy methods depend heavily on the operator's experience, leading to suboptimal polyp detection rates. Besides, the public database are limited in polyp size and shape diversity. To enhance the available data for polyp detection, we introduce Consisaug, an innovative and effective methodology to augment data that leverages deep learning. We utilize the constraint that when the image is flipped the class label should be equal and the bonding boxes should be consistent. We implement our Consisaug on five public polyp datasets and at three backbones, and the results show the effectiveness of our method.

cs.CV↗
arXiv2024

DeViDe: Faceted medical knowledge for improved medical vision-language pre-training

Vision-language pre-training for chest X-rays has made significant strides, primarily by utilizing paired radiographs and radiology reports. However, existing approaches often face challenges in encoding medical knowledge effectively. While radiology reports provide insights into the current disease manifestation, medical definitions (as used by contemporary methods) tend to be overly abstract, creating a gap in knowledge. To address this, we propose DeViDe, a novel transformer-based method that leverages radiographic descriptions from the open web. These descriptions outline general visual characteristics of diseases in radiographs, and when combined with abstract definitions and radiology reports, provide a holistic snapshot of knowledge. DeViDe incorporates three key features for knowledge-augmented vision language alignment: First, a large-language model-based augmentation is employed to homogenise medical knowledge from diverse sources. Second, this knowledge is aligned with image information at various levels of granularity. Third, a novel projection layer is proposed to handle the complexity of aligning each image with multiple descriptions arising in a multi-label setting. In zero-shot settings, DeViDe performs comparably to fully supervised models on external datasets and achieves state-of-the-art results on three large-scale datasets. Additionally, fine-tuning DeViDe on four downstream tasks and six segmentation tasks showcases its superior performance across data from diverse distributions.

cs.CV↗
arXiv2024

An Interpretable Cross-Attentive Multi-modal MRI Fusion Framework for Schizophrenia Diagnosis

Both functional and structural magnetic resonance imaging (fMRI and sMRI) are widely used for the diagnosis of mental disorder. However, combining complementary information from these two modalities is challenging due to their heterogeneity. Many existing methods fall short of capturing the interaction between these modalities, frequently defaulting to a simple combination of latent features. In this paper, we propose a novel Cross-Attentive Multi-modal Fusion framework (CAMF), which aims to capture both intra-modal and inter-modal relationships between fMRI and sMRI, enhancing multi-modal data representation. Specifically, our CAMF framework employs self-attention modules to identify interactions within each modality while cross-attention modules identify interactions between modalities. Subsequently, our approach optimizes the integration of latent features from both modalities. This approach significantly improves classification accuracy, as demonstrated by our evaluations on two extensive multi-modal brain imaging datasets, where CAMF consistently outperforms existing methods. Furthermore, the gradient-guided Score-CAM is applied to interpret critical functional networks and brain regions involved in schizophrenia. The bio-markers identified by CAMF align with established research, potentially offering new insights into the diagnosis and pathological endophenotypes of schizophrenia.

eess.IV↗
arXiv2023

ImageNomer: description of a functional connectivity and omics analysis tool and case study identifying a race confound

Most packages for the analysis of fMRI-based functional connectivity (FC) and genomic data are used with a programming language interface, lacking an easy-to-navigate GUI frontend. This exacerbates two problems found in these types of data: demographic confounds and quality control in the face of high dimensionality of features. The reason is that it is too slow and cumbersome to use a programming interface to create all the necessary visualizations required to identify all correlations, confounding effects, or quality control problems in a dataset. To remedy this situation, we have developed ImageNomer, a data visualization and analysis tool that allows inspection of both subject-level and cohort-level demographic, genomic, and imaging features. The software is Python-based, runs in a self-contained Docker image, and contains a browser-based GUI frontend. We demonstrate the usefulness of ImageNomer by identifying an unexpected race confound when predicting achievement scores in the Philadelphia Neurodevelopmental Cohort (PNC) dataset. In the past, many studies have attempted to use FC to identify achievement-related features in fMRI. Using ImageNomer, we find a clear potential for confounding effects of race. Using correlation analysis in the ImageNomer software, we show that FCs correlated with Wide Range Achievement Test (WRAT) score are in fact more highly correlated with race. Investigating further, we find that whereas both FC and SNP (genomic) features can account for 10-15\% of WRAT score variation, this predictive ability disappears when controlling for race. In this work, we demonstrate the advantage of our ImageNomer GUI tool in data exploration and confound detection. Additionally, this work identifies race as a strong confound in FC data and casts doubt on the possibility of finding unbiased achievement-related features in fMRI and SNP data of healthy adolescents.

q-bio.PE↗
arXiv2023

Nonlinear perturbation of a high-order exceptional point: skin discrete breathers and the hierarchical power-law scaling

We study the nonlinear perturbation of a high-order exceptional point (EP) of the order equal to the system site number $L$ in a Hatano-Nelson model with unidirectional hopping and Kerr nonlinearity. Notably, We find a class of discrete breathers that aggregate to one boundary, here named as skin discrete breathers (SDBs). The nonlinear spectrum of these SDBs shows a hierarchical power-law scaling near the EP. Specifically, the response of nonlinear energy to the perturbation is given by $E_m\propto \varGamma^{α_{m}}$, where $α_m=3^{m-1}$ is the power with $m=1,\cdots,L$ labeling the nonlinear energy bands. This is in sharp contrast to the $L$-th root of a linear perturbation in general. These SDBs decay in a double-exponential manner, unlike the edge states or skin modes in linear systems, which decay exponentially. Furthermore, these SDBs can survive over the full range of nonlinearity strength and are continuously connected to the self-trapped states in the limit of large nonlinearity. They are also stable, as confirmed by a defined nonlinear fidelity of an adiabatic evolution from the stability analysis. As nonreciprocal nonlinear models may be experimentally realized in various platforms, such as the classical platform of optical waveguides, where Kerr nonlinearity is naturally present, and the quantum platform of optical lattices with Bose-Einstein condensates, our analytical results may inspire further exploration of the interplay between nonlinearity and non-Hermiticity, particularly on high-order EPs, and benchmark the relevant simulations.

quant-ph↗
arXiv2023

CoC-GAN: Employing Context Cluster for Unveiling a New Pathway in Image Generation

Image generation tasks are traditionally undertaken using Convolutional Neural Networks (CNN) or Transformer architectures for feature aggregating and dispatching. Despite the frequent application of convolution and attention structures, these structures are not fundamentally required to solve the problem of instability and the lack of interpretability in image generation. In this paper, we propose a unique image generation process premised on the perspective of converting images into a set of point clouds. In other words, we interpret an image as a set of points. As such, our methodology leverages simple clustering methods named Context Clustering (CoC) to generate images from unordered point sets, which defies the convention of using convolution or attention mechanisms. Hence, we exclusively depend on this clustering technique, combined with the multi-layer perceptron (MLP) in a generative model. Furthermore, we implement the integration of a module termed the 'Point Increaser' for the model. This module is just an MLP tasked with generating additional points for clustering, which are subsequently integrated within the paradigm of the Generative Adversarial Network (GAN). We introduce this model with the novel structure as the Context Clustering Generative Adversarial Network (CoC-GAN), which offers a distinctive viewpoint in the domain of feature aggregating and dispatching. Empirical evaluations affirm that our CoC-GAN, devoid of convolution and attention mechanisms, exhibits outstanding performance. Its interpretability, endowed by the CoC module, also allows for visualization in our experiments. The promising results underscore the feasibility of our method and thus warrant future investigations of applying Context Clustering to more novel and interpretable image generation.

cs.CV↗
arXiv2023

New insights into tackling large amplitude oscillatory shear (LAOS): an analytic LAOS approach (aLAOS)

Large amplitude oscillatory shear (LAOS) has been widely applied for performing rheological analysis of complex fluids, and the Fourier transform (FT) rheology is considered one of the mainstays in LAOS since FT is an essential mathematic tool that is applied in numerous fields of signal analysis. However, the challenge of understanding FT, diverse mathematical frameworks, and complicated data processing render existing LAOS methods hard to be effectively used. As a result, their accessibility and implementation are limited in practice. Thus, the development of novel LAOS methods remains an unmet need. In this context, a newly analytic LAOS (aLAOS) approach was deduced here to tackle LAOS by the reverse use of the methodology of the FT rheology. More specifically, the rheological signals and measures can be precisely reconstructed based on the established equations involving Fourier coefficients instead of processing numerous discrete points of the Lissajous curves. Furthermore, considering the acquired results from the LAOS tests on the various typical yield stress fluids, it was demonstrated that the aLAOS could unify the mainstream LAOS methods into one Fourier coefficient-based framework and visually distinguish the contribution of arbitrary higher harmonics. Consequently, the proposed approach is arising as a promising candidate for the convenient treatment of LAOS, which could also highly promote the multi-field applications of LAOS.

physics.flu-dyn↗
arXiv2023

Source-Free Domain Adaptation for Medical Image Segmentation via Prototype-Anchored Feature Alignment and Contrastive Learning

Unsupervised domain adaptation (UDA) has increasingly gained interests for its capacity to transfer the knowledge learned from a labeled source domain to an unlabeled target domain. However, typical UDA methods require concurrent access to both the source and target domain data, which largely limits its application in medical scenarios where source data is often unavailable due to privacy concern. To tackle the source data-absent problem, we present a novel two-stage source-free domain adaptation (SFDA) framework for medical image segmentation, where only a well-trained source segmentation model and unlabeled target data are available during domain adaptation. Specifically, in the prototype-anchored feature alignment stage, we first utilize the weights of the pre-trained pixel-wise classifier as source prototypes, which preserve the information of source features. Then, we introduce the bi-directional transport to align the target features with class prototypes by minimizing its expected cost. On top of that, a contrastive learning stage is further devised to utilize those pixels with unreliable predictions for a more compact target feature distribution. Extensive experiments on a cross-modality medical segmentation task demonstrate the superiority of our method in large domain discrepancy settings compared with the state-of-the-art SFDA approaches and even some UDA methods. Code is available at https://github.com/CSCYQJ/MICCAI23-ProtoContra-SFDA.

cs.CV↗
arXiv2023

Angle Basis: a Generative Model and Decomposition for Functional Connectivity

Functional connectivity (FC) is one of the most common inputs to fMRI-based predictive models, due to a combination of its simplicity and robustness. However, there may be a lack of theoretical models for the generation of FC. In this work, we present a straightforward decomposition of FC into a set of basis states of sine waves with an additional jitter component. We show that the decomposition matches the predictive ability of FC after including 5-10 bases. We also find that both the decomposition and its residual have approximately equal predictive value, and when combined into an ensemble, exceed the AUC of FC-based prediction by up to 5%. Additionally, we find the residual can be used for subject fingerprinting, with 97.3% same-subject, different-scan identifiability, compared to 62.5% for FC. Unlike PCA or Factor Analysis methods, our method does not require knowledge of a population to perform its decomposition; a single subject is enough. Our decomposition of FC into two equally-predictive components may lead to a novel appreciation of group differences in patient populations. Additionally, we generate synthetic patient FC based on user-specified characteristics such as age, sex, and disease diagnosis. By creating synthetic datasets or augmentations we may reduce the high financial burden associated with fMRI data acquisition.

q-bio.NC↗
arXiv2023

Efficient and Robust Time-Optimal Trajectory Planning and Control for Agile Quadrotor Flight

Agile quadrotor flight relies on rapidly planning and accurately tracking time-optimal trajectories, a technology critical to their application in the wild. However, the computational burden of computing time-optimal trajectories based on the full quadrotor dynamics (typically on the order of minutes or even hours) can hinder its ability to respond quickly to changing scenarios. Additionally, modeling errors and external disturbances can lead to deviations from the desired trajectory during tracking in real time. This letter proposes a novel approach to computing time-optimal trajectories, by fixing the nodes with waypoint constraints and adopting separate sampling intervals for trajectories between waypoints, which significantly accelerates trajectory planning. Furthermore, the planned paths are tracked via a time-adaptive model predictive control scheme whose allocated tracking time can be adaptively adjusted on-the-fly, therefore enhancing the tracking accuracy and robustness. We evaluate our approach through simulations and experimentally validate its performance in dynamic waypoint scenarios for time-optimal trajectory replanning and trajectory tracking.

cs.RO↗
arXiv2023

Fair Notification Optimization: An Auction Approach

Notifications are important for the user experience in mobile apps and can influence their engagement. However, too many notifications can be disruptive for users. A typical mobile app usually has several types of notification, managed by distinct teams with objectives that are possibly conflicting with each other, or even with the overall platform objective. Therefore, there is a need for careful curation of notifications sent to users of these different types. In this work, we study a novel centralized approach for notification optimization, where we view the opportunities to send user notifications as items and types of notifications as buyers in an auction market. Furthermore, the auction setup is unique, and the platform has the ability to subsidize the bids from the notification types. Using tools from fair division, we study the application of competitive equilibrium for addressing this problem. We show that an Eisenberg-Gale-style convex program allows us to find an allocation that is fair to all notification types in hindsight. Using the dual of the formulation, we present an online algorithm that allocates notifications via first-price auctions using a pacing-multiplier approach. Secondly, we introduce an approach based on second-price auctions and pacing, which has the benefit of working well with existing advertising systems built for second-price auctions. Through an A/B test in production, we show that the second price-based auction system improves over a decentralized notification optimization system, leading to its launch in production for some Instagram notifications. Further, through simulations on Instagram notification data and a subsequent production A/B test, we compare the outcomes of first-price and second-price auctions and show that the former has more stable pacing multipliers.

cs.GT↗
arXiv2022

Coarse Retinal Lesion Annotations Refinement via Prototypical Learning

Deep-learning-based approaches for retinal lesion segmentation often require an abundant amount of precise pixel-wise annotated data. However, coarse annotations such as circles or ellipses for outlining the lesion area can be six times more efficient than pixel-level annotation. Therefore, this paper proposes an annotation refinement network to convert a coarse annotation into a pixel-level segmentation mask. Our main novelty is the application of the prototype learning paradigm to enhance the generalization ability across different datasets or types of lesions. We also introduce a prototype weighing module to handle challenging cases where the lesion is overly small. The proposed method was trained on the publicly available IDRiD dataset and then generalized to the public DDR and our real-world private datasets. Experiments show that our approach substantially improved the initial coarse mask and outperformed the non-prototypical baseline by a large margin. Moreover, we demonstrate the usefulness of the prototype weighing module in both cross-dataset and cross-class settings.

cs.CV↗
arXiv2022

Gain/loss effects on spin-orbit coupled ultracold atoms in two-dimensional optical lattices

Due to the fundamental position of spin-orbit coupled ultracold atoms in the simulation of topological insulators, the gain/loss effects on these systems should be evaluated when considering the measurement or the coupling to the environment. Here, incorporating the mature gain/loss techniques into the experimentally realized spin-orbit coupled ultracold atoms in two-dimensional optical lattices, we investigate the corresponding non-Hermitian tight-binding model and evaluate the gain/loss effects on various properties of the system, revealing the interplay of the non-Hermiticity and the spin-orbit coupling. Under periodic boundary conditions, we analytically obtain the topological phase diagram, which undergoes a non-Hermitian gapless interval instead of a point that the Hermitian counterpart encounters for a topological phase transition. We also unveil that the band inversion is just a necessary but not sufficient condition for a topological phase in two-level spin-orbit coupled non-Hermitian systems. Because the nodal loops of the upper or lower two dressed bands of the Hermitian counterpart can be split into exceptional loops in this non-Hermitian model, a gauge-independent Wilson-loop method is developed for numerically calculating the Chern number of multiple degenerate complex bands. Under open boundary conditions, we find that the conventional bulk-boundary correspondence does not break down with only on-site gain/loss due to the lack of non-Hermitian skin effect, but the dissipation of chiral edge states depends on the boundary selection, which may be used in the control of edge-state dynamics. Given the technical accessibility of state-dependent atom loss, this model could be realized in current cold-atom experiments.

cond-mat.quant-gas↗