Searcharxiv⌕ Search

arXiv subjects

Yun Liu

Publications and source records attributed to Yun Liu.

At least 91 records · Page 5Linked to original sources

Towards Better Health Conversations: The Benefits of Context-seeking

Navigating health questions can be daunting in the modern information landscape. Large language models (LLMs) may provide tailored, accessible information, but also risk being inaccurate, biased or misleading. We present insights from 4 mixed-methods studies (total N=163), examining how people interact with LLMs for their own health questions. Qualitative studies revealed the importance of context-seeking in conversational AIs to elicit specific details a person may not volunteer or know to share. Context-seeking by LLMs was valued by participants, even if it meant deferring an answer for several turns. Incorporating these insights, we developed a "Wayfinding AI" to proactively solicit context. In a randomized, blinded study, participants rated the Wayfinding AI as more helpful, relevant, and tailored to their concerns compared to a baseline AI. These results demonstrate the strong impact of proactive context-seeking on conversational dynamics, and suggest design patterns for conversational AI to help navigate health topics.

cs.HC↗

Transforming Wearable Data into Personal Health Insights using Large Language Model Agents

Deriving personalized insights from popular wearable trackers requires complex numerical reasoning that challenges standard LLMs, necessitating tool-based approaches like code generation. Large language model (LLM) agents present a promising yet largely untapped solution for this analysis at scale. We introduce the Personal Health Insights Agent (PHIA), a system leveraging multistep reasoning with code generation and information retrieval to analyze and interpret behavioral health data. To test its capabilities, we create and share two benchmark datasets with over 4000 health insights questions. A 650-hour human expert evaluation shows that PHIA significantly outperforms a strong code generation baseline, achieving 84% accuracy on objective, numerical questions and, for open-ended ones, earning 83% favorable ratings while being twice as likely to achieve the highest quality rating. This work can advance behavioral health by empowering individuals to understand their data, enabling a new era of accessible, personalized, and data-driven wellness for the wider population.

cs.AI↗

Constraining interacting dark energy models with the halo concentration-mass relation

The interacting dark energy (IDE) model is a promising alternative cosmological model which has the potential to solve the fine-tuning and coincidence problems by considering the interaction between dark matter and dark energy. Previous studies have shown that the energy exchange between the dark sectors in this model can significantly affect the dark matter halo properties. In this study, utilising a large set of cosmological $N$-body simulations, we analyse the redshift evolution of the halo concentration-mass ($c$-$M$) relation in the IDE model, and show that the $c$-$M$ relation is a sensitive proxy of the interaction strength parameter $ξ_2$, especially at lower redshifts. Furthermore, we construct parametrized formulae to quantify the dependence of the $c$-$M$ relation on $ξ_2$ at redshifts ranging from $z=0$ to $0.6$. Our parametrized formulae provide a useful tool in constraining $ξ_2$ with the observational $c$-$M$ relation. As a first attempt, we use the data from X-ray, gravitational lensing, and galaxy rotational curve observations and obtain a tight constraint on $ξ_2$, i.e. $ξ_2 = 0.071 \pm 0.034$. Our work demonstrates that the halo $c$-$M$ relation, which reflects the halo assembly history, is a powerful probe to constrain the IDE model.

astro-ph.CO↗

LLMs on Trial: Evaluating Judicial Fairness for Large Language Models

Large Language Models (LLMs) are increasingly used in high-stakes fields where their decisions impact rights and equity. However, LLMs' judicial fairness and implications for social justice remain underexplored. When LLMs act as judges, the ability to fairly resolve judicial issues is a prerequisite to ensure their trustworthiness. Based on theories of judicial fairness, we construct a comprehensive framework to measure LLM fairness, leading to a selection of 65 labels and 161 corresponding values. Applying this framework to the judicial system, we compile an extensive dataset, JudiFair, comprising 177,100 unique case facts. To achieve robust statistical inference, we develop three evaluation metrics, inconsistency, bias, and imbalanced inaccuracy, and introduce a method to assess the overall fairness of multiple LLMs across various labels. Through experiments with 16 LLMs, we uncover pervasive inconsistency, bias, and imbalanced inaccuracy across models, underscoring severe LLM judicial unfairness. Particularly, LLMs display notably more pronounced biases on demographic labels, with slightly less bias on substance labels compared to procedure ones. Interestingly, increased inconsistency correlates with reduced biases, but more accurate predictions exacerbate biases. While we find that adjusting the temperature parameter can influence LLM fairness, model size, release date, and country of origin do not exhibit significant effects on judicial fairness. Accordingly, we introduce a publicly available toolkit containing all datasets and code, designed to support future research in evaluating and improving LLM fairness.

cs.CL↗

SyncDiff: Synchronized Motion Diffusion for Multi-Body Human-Object Interaction Synthesis

Synthesizing realistic human-object interaction motions is a critical problem in VR/AR and human animation. Unlike the commonly studied scenarios involving a single human or hand interacting with one object, we address a more generic multi-body setting with arbitrary numbers of humans, hands, and objects. This complexity introduces significant challenges in synchronizing motions due to the high correlations and mutual influences among bodies. To address these challenges, we introduce SyncDiff, a novel method for multi-body interaction synthesis using a synchronized motion diffusion strategy. SyncDiff employs a single diffusion model to capture the joint distribution of multi-body motions. To enhance motion fidelity, we propose a frequency-domain motion decomposition scheme. Additionally, we introduce a new set of alignment scores to emphasize the synchronization of different body motions. SyncDiff jointly optimizes both data sample likelihood and alignment likelihood through an explicit synchronization strategy. Extensive experiments across four datasets with various multi-body configurations demonstrate the superiority of SyncDiff over existing state-of-the-art motion synthesis methods.

cs.CV↗

Cardiac-CLIP: A Vision-Language Foundation Model for 3D Cardiac CT Images

Foundation models have demonstrated remarkable potential in medical domain. However, their application to complex cardiovascular diagnostics remains underexplored. In this paper, we present Cardiac-CLIP, a multi-modal foundation model designed for 3D cardiac CT images. Cardiac-CLIP is developed through a two-stage pre-training strategy. The first stage employs a 3D masked autoencoder (MAE) to perform self-supervised representation learning from large-scale unlabeled volumetric data, enabling the visual encoder to capture rich anatomical and contextual features. In the second stage, contrastive learning is introduced to align visual and textual representations, facilitating cross-modal understanding. To support the pre-training, we collect 16641 real clinical CT scans, supplemented by 114k publicly available data. Meanwhile, we standardize free-text radiology reports into unified templates and construct the pathology vectors according to diagnostic attributes, based on which the soft-label matrix is generated to supervise the contrastive learning process. On the other hand, to comprehensively evaluate the effectiveness of Cardiac-CLIP, we collect 6,722 real-clinical data from 12 independent institutions, along with the open-source data to construct the evaluation dataset. Specifically, Cardiac-CLIP is comprehensively evaluated across multiple tasks, including cardiovascular abnormality classification, information retrieval and clinical analysis. Experimental results demonstrate that Cardiac-CLIP achieves state-of-the-art performance across various downstream tasks in both internal and external data. Particularly, Cardiac-CLIP exhibits great effectiveness in supporting complex clinical tasks such as the prospective prediction of acute coronary syndrome, which is notoriously difficult in real-world scenarios.

eess.IV↗

Towards physician-centered oversight of conversational diagnostic AI

Recent work has demonstrated the promise of conversational AI systems for diagnostic dialogue. However, real-world assurance of patient safety means that providing individual diagnoses and treatment plans is considered a regulated activity by licensed professionals. Furthermore, physicians commonly oversee other team members in such activities, including nurse practitioners (NPs) or physician assistants/associates (PAs). Inspired by this, we propose a framework for effective, asynchronous oversight of the Articulate Medical Intelligence Explorer (AMIE) AI system. We propose guardrailed-AMIE (g-AMIE), a multi-agent system that performs history taking within guardrails, abstaining from individualized medical advice. Afterwards, g-AMIE conveys assessments to an overseeing primary care physician (PCP) in a clinician cockpit interface. The PCP provides oversight and retains accountability of the clinical decision. This effectively decouples oversight from intake and can thus happen asynchronously. In a randomized, blinded virtual Objective Structured Clinical Examination (OSCE) of text consultations with asynchronous oversight, we compared g-AMIE to NPs/PAs or a group of PCPs under the same guardrails. Across 60 scenarios, g-AMIE outperformed both groups in performing high-quality intake, summarizing cases, and proposing diagnoses and management plans for the overseeing PCP to review. This resulted in higher quality composite decisions. PCP oversight of g-AMIE was also more time-efficient than standalone PCP consultations in prior work. While our study does not replicate existing clinical practices and likely underestimates clinicians' capabilities, our results demonstrate the promise of asynchronous oversight as a feasible paradigm for diagnostic AI systems to operate under expert human oversight for enhancing real-world care.

cs.AI↗

Exploring the anisotropic gravitational wave background from all-sky mock gravitational wave event catalogues

Anisotropic stochastic gravitational wave background (SGWB) serves as a potential probe of the large-scale structure (LSS) of the universe. In this work, we explore the anisotropic SGWB from local ($z < \sim 0.085$) merging stellar mass compact binaries, specifically focusing on merging stellar binary black holes, merging neutron-star-black-hole binaries, and merging binary neutron stars. The analysis employs seven all-sky mock lightcone gravitational wave event catalogues, which are derived from the Millennium simulation combined with a semi-analytic model of galaxy formation and a binary population synthesis model. We calculate the angular power spectra $\mathrm{C}_\ell$ at multipole moments $\ell$, expressed as $\text{log}_{10} [\ell(\ell+1)\mathrm{C}_\ell/(2π)]$, based on the skymaps of the overdensity $δ_\mathrm{GW}$ in the anisotropic SGWB. The spectra for all three source types exhibit an approximately linear increase with $\text{log}_{10} \ell$ at higher $\ell$ (e.g., $\ell > \sim 30 - 300$) in seven catalogues, with a characteristic slope of $\sim 2$. The spectra of seven catalogues exhibit considerable variations, arising from fluctuations in spatial distribution, primarily in the radial distribution, of nearby sources (e.g., $< 50$ Mpc/h). After subtracting these nearby sources, the variations become much smaller and the spectra for the three source types become closely aligned (within discrepancies of a factor of $\sim 2$ across $\ell = 1 - 1000$ for all catalogues). We also find that including further sources results in a rapid decrease in the anisotropy.

astro-ph.HE↗

A Kaleidoscope of Topological Structures in Dipolar Bose-Einstein Condensates with Weyl-Like Spin-Orbit Coupling in Anharmonic Trap

Dipole-dipole interaction (DDI) possesses characteristics different from the conventional isotropic s-wave interaction in Bose-Einstein condensates (BECs), the interplay of DDI with spin-orbit coupling (SOC) and rotation may induce novel quantum properties. We systematically analyze the effects of the DDI, Weyl-like SOC, rotation and trap anharmonicity in the ground state of two-componen BECs. The interplay of these factors leads to a kaleidoscope of quantum states of quantum defects and quantum droplets in lattice, wheel and ring forms of distributions, with transitions of topology of density and a critical behavior in varying the parameters. We also show a bunch of exotic spin topological structures, including centric vortex surrounded by layers of spin flows, compound topological structure of edge defect, and various coexistence states of skyrmions with different topological charge. In particular, we find quarter skyrmions and other possible fractional skyrmions. Rashba-type SOC and Weyl-like SOC are compared as well. Our study implies that one can manipulate both the density topology and the spin topological structure via these tunable parameters in BECs. The abundant variations of the topological structures and particularly the revealed critical behavior may provide various quantum resources for potential applications in quantum metrology.

cond-mat.quant-gas↗

AutoSAS: a new human-aside-the-loop paradigm for automated SAS fitting for high throughput and autonomous experimentation

The advancement of artificial-intelligence driven autonomous experiments demands physics-based modeling and decision-making processes, not only to improve the accuracy of the experimental trajectory but also to increase trust by allowing transparent human-machine collaboration. High-quality structural characterization techniques (e.g., X-ray, neutron, or static light scattering) are a particularly relevant example of this need: they provide invaluable information but are challenging to analyze without expert oversight. Here, we introduce AutoSAS, a novel framework for human-aside-the-loop automated data classification. AutoSAS leverages human-defined candidate models, high-throughput combinatorial fitting, and information-theoretic model selection to generate both classification results and quantitative structural descriptors. We implement AutoSAS in an open-source package designed for use with the Autonomous Formulation Laboratory (AFL) for X-ray and neutron scattering-based optimization of multicomponent liquid formulations. In a first application, we leveraged a set of expert defined candidate models to classify, refine the structure, and track transformations in a model injectable drug carrier system. We evaluated four model selection methods and benchmarked them against an optimized machine learning classifier and the best approach was one that balanced quality of the fit and complexity of the model. AutoSAS not only corroborated the critical micelle concentration boundary identified in previous experiments but also discovered a second structural transition boundary not identified by the previous methods. These results demonstrate the potential of AutoSAS to enhance autonomous experimental workflows by providing robust, interpretable model selection, paving the way for more reliable and insightful structural characterization in complex formulations.

cond-mat.soft↗

PDCNet: a benchmark and general deep learning framework for activity prediction of peptide-drug conjugates

Peptide-drug conjugates (PDCs) represent a promising therapeutic avenue for human diseases, particularly in cancer treatment. Systematic elucidation of structure-activity relationships (SARs) and accurate prediction of the activity of PDCs are critical for the rational design and optimization of these conjugates. To this end, we carefully design and construct a benchmark PDCs dataset compiled from literature-derived collections and PDCdb database, and then develop PDCNet, the first unified deep learning framework for forecasting the activity of PDCs. The architecture systematically captures the complex factors underlying anticancer decisions of PDCs in real-word scenarios through a multi-level feature fusion framework that collaboratively characterizes and learns the features of peptides, linkers, and payloads. Leveraging a curated PDCs benchmark dataset, comprehensive evaluation results show that PDCNet demonstrates superior predictive capability, with the highest AUC, F1, MCC and BA scores of 0.9213, 0.7656, 0.7071 and 0.8388 for the test set, outperforming eight established traditional machine learning models. Multi-level validations, including 5-fold cross-validation, threshold testing, ablation studies, model interpretability analysis and external independent testing, further confirm the superiority, robustness, and usability of the PDCNet architecture. We anticipate that PDCNet represents a novel paradigm, incorporating both a benchmark dataset and advanced models, which can accelerate the design and discovery of new PDC-based therapeutic agents.

cs.LG↗

SensorLM: Learning the Language of Wearable Sensors

We present SensorLM, a family of sensor-language foundation models that enable wearable sensor data understanding with natural language. Despite its pervasive nature, aligning and interpreting sensor data with language remains challenging due to the lack of paired, richly annotated sensor-text descriptions in uncurated, real-world wearable data. We introduce a hierarchical caption generation pipeline designed to capture statistical, structural, and semantic information from sensor data. This approach enabled the curation of the largest sensor-language dataset to date, comprising over 59.7 million hours of data from more than 103,000 people. Furthermore, SensorLM extends prominent multimodal pretraining architectures (e.g., CLIP, CoCa) and recovers them as specific variants within a generic architecture. Extensive experiments on real-world tasks in human activity analysis and healthcare verify the superior performance of SensorLM over state-of-the-art in zero-shot recognition, few-shot learning, and cross-modal retrieval. SensorLM also demonstrates intriguing capabilities including scaling behaviors, label efficiency, sensor captioning, and zero-shot generalization to unseen tasks.

cs.LG↗

A Hybrid Iterative Neural Solver Based on Spectral Analysis for Parametric PDEs

Deep learning-based hybrid iterative methods (DL-HIM) have emerged as a promising approach for designing fast neural solvers to tackle large-scale sparse linear systems. DL-HIM combine the smoothing effect of simple iterative methods with the spectral bias of neural networks, which allows them to effectively eliminate both high-frequency and low-frequency error components. However, their efficiency may decrease if simple iterative methods can not provide effective smoothing, making it difficult for the neural network to learn mid-frequency and high-frequency components. This paper first conducts a convergence analysis for general DL-HIM from a spectral viewpoint, concluding that under reasonable assumptions, DL-HIM exhibit a convergence rate independent of grid size $h$ and physical parameters $\boldsymbolμ$. To meet these assumptions, we design a neural network from an eigen perspective, focusing on learning the eigenvalues and eigenvectors corresponding to error components that simple iterative methods struggle to eliminate. Specifically, the eigenvalues are learned by a meta subnet, while the eigenvectors are approximated using Fourier modes with a transition matrix provided by another meta subnet. The resulting DL-HIM, termed the Fourier Neural Solver (FNS), can be trained to achieve a convergence rate independent of PDE parameters and grid size within a local neighborhood of the training scale by designing a loss function that ensures the neural network complements the smoothing effect of the damped Jacobi iterative methods. We verify the performance of FNS on five types of linear parametric PDEs.

math.NA↗

Runtime Analysis of Evolutionary NAS for Multiclass Classification

Evolutionary neural architecture search (ENAS) is a key part of evolutionary machine learning, which commonly utilizes evolutionary algorithms (EAs) to automatically design high-performing deep neural architectures. During past years, various ENAS methods have been proposed with exceptional performance. However, the theory research of ENAS is still in the infant. In this work, we step for the runtime analysis, which is an essential theory aspect of EAs, of ENAS upon multiclass classification problems. Specifically, we first propose a benchmark to lay the groundwork for the analysis. Furthermore, we design a two-level search space, making it suitable for multiclass classification problems and consistent with the common settings of ENAS. Based on both designs, we consider (1+1)-ENAS algorithms with one-bit and bit-wise mutations, and analyze their upper and lower bounds on the expected runtime. We prove that the algorithm using both mutations can find the optimum with the expected runtime upper bound of $O(rM\ln{rM})$ and lower bound of $Ω(rM\ln{M})$. This suggests that a simple one-bit mutation may be greatly considered, given that most state-of-the-art ENAS methods are laboriously designed with the bit-wise mutation. Empirical studies also support our theoretical proof.

cs.NE↗

LSM-2: Learning from Incomplete Wearable Sensor Data

Foundation models, a cornerstone of recent advancements in machine learning, have predominantly thrived on complete and well-structured data. Wearable sensor data frequently suffers from significant missingness, posing a substantial challenge for self-supervised learning (SSL) models that typically assume complete data inputs. This paper introduces the second generation of Large Sensor Model (LSM-2) with Adaptive and Inherited Masking (AIM), a novel SSL approach that learns robust representations directly from incomplete data without requiring explicit imputation. AIM's core novelty lies in its use of learnable mask tokens to model both existing ("inherited") and artificially introduced missingness, enabling it to robustly handle fragmented real-world data during inference. Pre-trained on an extensive dataset of 40M hours of day-long multimodal sensor data, our LSM-2 with AIM achieves the best performance across a diverse range of tasks, including classification, regression and generative modeling. Furthermore, LSM-2 with AIM exhibits superior scaling performance, and critically, maintains high performance even under targeted missingness scenarios, reflecting clinically coherent patterns, such as the diagnostic value of nighttime biosignals for hypertension prediction. This makes AIM a more reliable choice for real-world wearable data applications.

cs.LG↗

Low-Resolution Self-Attention for Semantic Segmentation

Semantic segmentation tasks naturally require high-resolution information for pixel-wise segmentation and global context information for class prediction. While existing vision transformers demonstrate promising performance, they often utilize high-resolution context modeling, resulting in a computational bottleneck. In this work, we challenge conventional wisdom and introduce the Low-Resolution Self-Attention (LRSA) mechanism to capture global context at a significantly reduced computational cost, i.e., FLOPs. Our approach involves computing self-attention in a fixed low-resolution space regardless of the input image's resolution, with additional 3x3 depth-wise convolutions to capture fine details in the high-resolution space. We demonstrate the effectiveness of our LRSA approach by building the LRFormer, a vision transformer with an encoder-decoder structure. Extensive experiments on the ADE20K, COCO-Stuff, and Cityscapes datasets demonstrate that LRFormer outperforms state-of-the-art models. Code is available at https://github.com/yuhuan-wu/LRFormer.

cs.CV↗

Small hole polarons in yellow phase $δ$-CsPbI$_3$

A heterophase containing both the optically active $α$-CsPbI$_3$ and non-active $δ$-CsPbI$_3$ has been demonstrated as an efficient white light emitter. This has challenged the conventional perspective that non-active phases of perovskites are undesirable in any perovskite-based optoelectronic devices. To understand the role that the yellow phase $δ$-CsPbI$_3$ plays in the light emission process, we performed a systematic computational study on its electronic and optical properties, which are relatively unexplored in the literature. Using the Fröhlich model we showed that the electron and hole both exhibit moderate coupling to longitudinal optical phonons. Explicit density functional theory calculations show that small hole polarons exist with a formation energy of -96 meV, corresponding to the contraction of the Pb-I bonds within a [PbI$_6$] octahedra and wavefunction localization. Molecular dynamics simulations showed that the small hole polaron is stable against thermal disorder, and exhibit periodic localization and delocalization behavior similar to carrier hopping with a characteristic lifetime of 0.3 ps. Our results might have elucidated the role that $δ$-CsPbI$_3$ play in the self-trapped emission in perovskite-based white light emitting diodes by supporting the presence of a localized small hole polaron.

cond-mat.mtrl-sci↗

Generalized Few-shot 3D Point Cloud Segmentation with Vision-Language Model

Generalized few-shot 3D point cloud segmentation (GFS-PCS) adapts models to new classes with few support samples while retaining base class segmentation. Existing GFS-PCS methods enhance prototypes via interacting with support or query features but remain limited by sparse knowledge from few-shot samples. Meanwhile, 3D vision-language models (3D VLMs), generalizing across open-world novel classes, contain rich but noisy novel class knowledge. In this work, we introduce a GFS-PCS framework that synergizes dense but noisy pseudo-labels from 3D VLMs with precise yet sparse few-shot samples to maximize the strengths of both, named GFS-VL. Specifically, we present a prototype-guided pseudo-label selection to filter low-quality regions, followed by an adaptive infilling strategy that combines knowledge from pseudo-label contexts and few-shot samples to adaptively label the filtered, unlabeled areas. Additionally, we design a novel-base mix strategy to embed few-shot samples into training scenes, preserving essential context for improved novel class learning. Moreover, recognizing the limited diversity in current GFS-PCS benchmarks, we introduce two challenging benchmarks with diverse novel classes for comprehensive generalization evaluation. Experiments validate the effectiveness of our framework across models and datasets. Our approach and benchmarks provide a solid foundation for advancing GFS-PCS in the real world. The code is at https://github.com/ZhaochongAn/GFS-VL

cs.CV↗