arXiv subjects

Miao Li

Publications and source records attributed to Miao Li.

At least 73 records · Page 4Linked to original sources

arXiv2024

DUVET: sub-kiloparsec resolved star formation driven outflows in a sample of local starbursting disk galaxies

We measure resolved (kiloparsec-scale) outflow properties in a sample of 10 starburst galaxies from the DUVET (Deep near-UV observations of Entrained gas in Turbulent galaxies) sample, using Keck/KCWI observations of H$β$ and [OIII]~$λ$5007. We measure $\sim460$ lines-of-sight that contain outflows, and use these to study scaling relationships of outflow velocity ($v_{\rm out}$), mass-loading factor ($η$; mass outflow rate per SFR) and mass flux ($\dotΣ_{\rm out}$; mass outflow rate per area) with co-located SFR surface density ($Σ_{\rm SFR}$) and stellar mass surface density ($Σ_{\ast}$). We find strong, positive correlations of $\dotΣ_{\rm out} \propto Σ_{\rm SFR}^{1.2}$ and $\dotΣ_{\rm out} \propto Σ_{\ast}^{1.5}$. We also find shallow correlations between $v_{\rm out}$ and both $Σ_{\rm SFR}$ and $Σ_{\ast}$. Our resolved observations do not suggest a threshold in outflows with $Σ_{\rm SFR}$, but rather we find that the local specific SFR ($Σ_{\rm SFR}/Σ_\ast$) is a better predictor of where outflows are detected. We find that outflows are very common above $Σ_{\rm SFR}/Σ_\ast\gtrsim 0.1$~Gyr$^{-1}$ and rare below this value. We argue that our results are consistent with a picture in which outflows are driven by supernovae, and require more significant injected energy in higher mass surface density environments to overcome local gravity. The correlations we present here provide a statistically robust, direct comparison for simulations and higher redshift results from JWST.

astro-ph.GA↗

arXiv2024

Uni-Med: A Unified Medical Generalist Foundation Model For Multi-Task Learning Via Connector-MoE

Multi-modal large language models (MLLMs) have shown impressive capabilities as a general-purpose interface for various visual and linguistic tasks. However, building a unified MLLM for multi-task learning in the medical field remains a thorny challenge. To mitigate the tug-of-war problem of multi-modal multi-task optimization in MLLMs, recent advances primarily focus on improving the LLM components, while neglecting the connector that bridges the gap between modalities. In this paper, we introduce Uni-Med, a novel medical generalist foundation model which consists of a universal visual feature extraction module, a connector mixture-of-experts (CMoE) module, and an LLM. Benefiting from the proposed CMoE that leverages a well-designed router with a mixture of projection experts at the connector, Uni-Med achieves efficient solution to the tug-of-war problem and can perform six different medical tasks including question answering, visual question answering, report generation, referring expression comprehension, referring expression generation and image classification. To the best of our knowledge, Uni-Med is the first effort to tackle multi-task interference at the connector in MLLMs. Extensive ablation experiments validate the effectiveness of introducing CMoE under any configuration, with up to an average 8% performance gains. We further provide interpretation analysis of the tug-of-war problem from the perspective of gradient optimization and parameter statistics. Compared to previous state-of-the-art medical MLLMs, Uni-Med achieves competitive or superior evaluation metrics on diverse tasks. Code and resources are available at https://github.com/tsinghua-msiip/Uni-Med.

cs.CV↗

arXiv2024

Combinatorial Diffusion Auction Design

Diffusion auction design for combinatorial settings is a long-standing challenge. One difficulty is that we cannot directly extend the solutions for simpler settings to combinatorial settings (like extending the Vickrey auction to VCG in the traditional settings). In this paper, we propose a different approach to leverage the diffusion auctions for single-item settings. We design a combinatorial diffusion auction framework which can use any desirable single-item diffusion auction to produce a combinatorial auction to satisfy incentive compatibility (IC), individual rationality (IR), and weak budget balance (WBB).

cs.GT↗

arXiv2024

Learning Goal-oriented Bimanual Dough Rolling Using Dynamic Heterogeneous Graph Based on Human Demonstration

Soft object manipulation poses significant challenges for robots, requiring effective techniques for state representation and manipulation policy learning. State representation involves capturing the dynamic changes in the environment, while manipulation policy learning focuses on establishing the relationship between robot actions and state transformations to achieve specific goals. To address these challenges, this research paper introduces a novel approach: a dynamic heterogeneous graph-based model for learning goal-oriented soft object manipulation policies. The proposed model utilizes graphs as a unified representation for both states and policy learning. By leveraging the dynamic graph, we can extract crucial information regarding object dynamics and manipulation policies. Furthermore, the model facilitates the integration of demonstrations, enabling guided policy learning. To evaluate the efficacy of our approach, we designed a dough rolling task and conducted experiments using both a differentiable simulator and a real-world humanoid robot. Additionally, several ablation studies were performed to analyze the effect of our method, demonstrating its superiority in achieving human-like behavior.

cs.RO↗

arXiv2024

The First Competition on Resource-Limited Infrared Small Target Detection Challenge: Methods and Results

In this paper, we briefly summarize the first competition on resource-limited infrared small target detection (namely, LimitIRSTD). This competition has two tracks, including weakly-supervised infrared small target detection (Track 1) and lightweight infrared small target detection (Track 2). 46 and 60 teams successfully registered and took part in Tracks 1 and Track 2, respectively. The top-performing methods and their results in each track are described with details. This competition inspires the community to explore the tough problems in the application of infrared small target detection, and ultimately promote the deployment of this technology under limited resource.

cs.CV↗

arXiv2024

Design of a Double-joint Robotic Fish Using a Composite Linkage

Robotic fish is one of the most promising directions of the new generation of underwater vehicles. Traditional biomimetic fish often mimic fish joints using tandem components like servos, which leads to increased volume, weight and control complexity. In this paper, a new double-joint robotic fish using a composite linkage was designed, where the propulsion mechanism transforms the single-degree-of-freedom rotation of the motor into a double-degree-of-freedom coupled motion, namely caudal peduncle translation and caudal fin rotation. Motion analysis of the propulsion mechanism demonstrates its ability to closely emulate the undulating movement observed in carangiform fish. Experimental results further validate the feasibility of the proposed propulsion mechanism. To improve propulsion efficiency, an analysis is conducted to explore the influence of swing angle amplitude and swing frequency on the swimming speed of the robotic fish. This examination establishes a practical foundation for future research on such robotic fish systems.

cs.RO↗

arXiv2024

The Anisotropic Circumgalactic Medium of Sub-L$^*$ Galaxies

Using stacked emission line flux measurements of cool circumgalactic gas (CGM) in lower-mass galaxies ($10^{9.0} \le M_*/M_\odot \le 10^{10.2} $), we measure the dependence of the emission characteristics on orientation relative to the disk plane as a function of radius and compare to that we found previously for massive ($M_* > 10^{10.4} M_\odot$) early-type galaxies. Although the line ratios (the lower [N II]/H$α$ and [O III]/H$β$) suggest an overall softer ionizing source than in the more massive galaxies, consistent with previous findings, we find the same ionization hardening signature (a higher [N II]/H$α$ ratio in the inner polar region) along the polar direction at small radii that we found for the more massive galaxies. The line ratio in the inner polar bin is distinct from that measured for the inner planar bin with 99.99% confidence and with $>$ 99.9% confidence we conclude that it lies outside the star formation regime. The effective hardening of the ionization of the CGM along the polar axis, at small radii, could either indicate relic effects of AGN activity or shock ionization. In either case, this signature appears to be ubiquitous across the stellar mass range we are able to explore with our spectral stacking technique and currently available archival data.

astro-ph.GA↗

arXiv2024

A Sentiment Consolidation Framework for Meta-Review Generation

Modern natural language generation systems with Large Language Models (LLMs) exhibit the capability to generate a plausible summary of multiple documents; however, it is uncertain if they truly possess the capability of information consolidation to generate summaries, especially on documents with opinionated information. We focus on meta-review generation, a form of sentiment summarisation for the scientific domain. To make scientific sentiment summarization more grounded, we hypothesize that human meta-reviewers follow a three-layer framework of sentiment consolidation to write meta-reviews. Based on the framework, we propose novel prompting methods for LLMs to generate meta-reviews and evaluation metrics to assess the quality of generated meta-reviews. Our framework is validated empirically as we find that prompting LLMs based on the framework -- compared with prompting them with simple instructions -- generates better meta-reviews.

cs.CL↗

arXiv2024

NewsBench: A Systematic Evaluation Framework for Assessing Editorial Capabilities of Large Language Models in Chinese Journalism

We present NewsBench, a novel evaluation framework to systematically assess the capabilities of Large Language Models (LLMs) for editorial capabilities in Chinese journalism. Our constructed benchmark dataset is focused on four facets of writing proficiency and six facets of safety adherence, and it comprises manually and carefully designed 1,267 test samples in the types of multiple choice questions and short answer questions for five editorial tasks in 24 news domains. To measure performances, we propose different GPT-4 based automatic evaluation protocols to assess LLM generations for short answer questions in terms of writing proficiency and safety adherence, and both are validated by the high correlations with human evaluations. Based on the systematic evaluation framework, we conduct a comprehensive analysis of ten popular LLMs which can handle Chinese. The experimental results highlight GPT-4 and ERNIE Bot as top performers, yet reveal a relative deficiency in journalistic safety adherence in creative writing tasks. Our findings also underscore the need for enhanced ethical guidance in machine-generated journalistic content, marking a step forward in aligning LLMs with journalistic standards and safety considerations.

cs.CL↗

arXiv2024

Conditional Language Learning with Context

Language models can learn sophisticated language understanding skills from fitting raw text. They also unselectively learn useless corpus statistics and biases, especially during finetuning on domain-specific corpora. In this paper, we propose a simple modification to causal language modeling called conditional finetuning, which performs language modeling conditioned on a context. We show that a context can "explain away" certain corpus statistics and make the model avoid learning them. In this fashion, conditional finetuning achieves selective learning from a corpus, learning knowledge useful for downstream tasks while avoiding learning useless corpus statistics like topic biases. This selective learning effect leads to less forgetting and better stability-plasticity tradeoff in domain finetuning, potentially benefitting lifelong learning with language models.

cs.CL↗

arXiv2024

TinyLLaVA Factory: A Modularized Codebase for Small-scale Large Multimodal Models

We present TinyLLaVA Factory, an open-source modular codebase for small-scale large multimodal models (LMMs) with a focus on simplicity of code implementations, extensibility of new features, and reproducibility of training results. Following the design philosophy of the factory pattern in software engineering, TinyLLaVA Factory modularizes the entire system into interchangeable components, with each component integrating a suite of cutting-edge models and methods, meanwhile leaving room for extensions to more features. In addition to allowing users to customize their own LMMs, TinyLLaVA Factory provides popular training recipes to let users pretrain and finetune their models with less coding effort. Empirical experiments validate the effectiveness of our codebase. The goal of TinyLLaVA Factory is to assist researchers and practitioners in exploring the wide landscape of designing and training small-scale LMMs with affordable computational resources.

cs.LG↗

arXiv2024

DUVET: Resolved direct metallicity measurements in the outflow of starburst galaxy NGC 1569

We present the results of direct-method metallicity measurements in the disk and outflow of the low-metallicity starburst galaxy NGC 1569. We use Keck Cosmic Web Imager observations to map the galaxy across 54$\arcsec$ (800 pc) along the major axis and 48$\arcsec$ (700 pc) along the minor axis with a spatial resolution of 1$\arcsec$ ($\sim$15 pc). We detect common strong emission lines ([\ion{O}{III}] $λ$5007, H$β$, [\ion{O}{II}] $λ$3727) and the fainter [\ion{O}{III}] $λ$4363 auroral line, which allows us to measure electron temperature ($T_e$) and metallicity. Theory suggests that outflows drive metals out of the disk driving observed trends between stellar mass and gas-phase metallicity. Our main result is that the metallicity in the outflow is similar to that of the disk, $Z_{\rm out} / Z_{\rm ISM} \approx 1$. This is consistent with previous absorption line studies in higher mass galaxies. Assumption of a mass-loading factor of $\dot{M}_{\rm out}/{\rm SFR}\sim3$ makes the metal-loading of NGC 1569 consistent with expectations derived from the mass-metallicity relationship. Our high spatial resolution metallicity maps reveal a region around a supermassive star cluster (SSC-B) with distinctly higher metallicity and higher electron density, compared to the disk. Given the known properties of SSC-B the higher metallicity and density of this region are likely the result of star formation-driven feedback acting on the local scale. Overall, our results are consistent with the picture in which metal-enriched winds pollute the circumgalactic medium surrounding galaxies, and thus connect the small-scale feedback processes to large-scale properties of galaxy halos.

astro-ph.GA↗

arXiv2023

Enabling End-to-End Secure Federated Learning in Biomedical Research on Heterogeneous Computing Environments with APPFLx

Facilitating large-scale, cross-institutional collaboration in biomedical machine learning projects requires a trustworthy and resilient federated learning (FL) environment to ensure that sensitive information such as protected health information is kept confidential. In this work, we introduce APPFLx, a low-code FL framework that enables the easy setup, configuration, and running of FL experiments across organizational and administrative boundaries while providing secure end-to-end communication, privacy-preserving functionality, and identity management. APPFLx is completely agnostic to the underlying computational infrastructure of participating clients. We demonstrate the capability of APPFLx as an easy-to-use framework for accelerating biomedical studies across institutions and healthcare systems while maintaining the protection of private medical data in two case studies: (1) predicting participant age from electrocardiogram (ECG) waveforms, and (2) detecting COVID-19 disease from chest radiographs. These experiments were performed securely across heterogeneous compute resources, including a mixture of on-premise high-performance computing and cloud computing, and highlight the role of federated learning in improving model generalizability and performance when aggregating data from multiple healthcare systems. Finally, we demonstrate that APPFLx serves as a convenient and easy-to-use framework for accelerating biomedical studies across institutions and healthcare system while maintaining the protection of private medical data.

cs.DC↗

arXiv2023

DeltaScore: Fine-Grained Story Evaluation with Perturbations

Numerous evaluation metrics have been developed for natural language generation tasks, but their effectiveness in evaluating stories is limited as they are not specifically tailored to assess intricate aspects of storytelling, such as fluency and interestingness. In this paper, we introduce DELTASCORE, a novel methodology that employs perturbation techniques for the evaluation of nuanced story aspects. Our central proposition posits that the extent to which a story excels in a specific aspect (e.g., fluency) correlates with the magnitude of its susceptibility to particular perturbations (e.g., the introduction of typos). Given this, we measure the quality of an aspect by calculating the likelihood difference between pre- and post-perturbation states using pre-trained language models. We compare DELTASCORE with existing metrics on storytelling datasets from two domains in five fine-grained story aspects: fluency, coherence, relatedness, logicality, and interestingness. DELTASCORE demonstrates remarkable performance, revealing a surprising finding that a specific perturbation proves highly effective in capturing multiple aspects.

cs.CL↗

arXiv2023

Summarizing Multiple Documents with Conversational Structure for Meta-Review Generation

We present PeerSum, a novel dataset for generating meta-reviews of scientific papers. The meta-reviews can be interpreted as abstractive summaries of reviews, multi-turn discussions and the paper abstract. These source documents have rich inter-document relationships with an explicit hierarchical conversational structure, cross-references and (occasionally) conflicting information. To introduce the structural inductive bias into pre-trained language models, we introduce Rammer ( Relationship-aware Multi-task Meta-review Generator), a model that uses sparse attention based on the conversational structure and a multi-task training objective that predicts metadata features (e.g., review ratings). Our experimental results show that Rammer outperforms other strong baseline models in terms of a suite of automatic evaluation metrics. Further analyses, however, reveal that RAMMER and other models struggle to handle conflicts in source documents of PeerSum, suggesting meta-review generation is a challenging task and a promising avenue for further research.

cs.CL↗

arXiv2023

Superconductivity from Doping Symmetric Mass Generation Insulators: Application to La$_3$Ni$_2$O$_7$ under Pressure

We investigate the bilayer nickelates as a platform to realize the symmetric mass generation (SMG) insulator, a featureless Mott insulator that arises due to the Lieb-Schultz-Mattis (LSM) anomaly cancellation in bilayer spin-1/2 lattice systems. Through a single-orbital bilayer square lattice model involving intralayer hopping $t$ and interlayer superexchange interaction $J$, we demonstrate the emergence of high-temperature superconductivity (SC) upon doping the SMG insulator. The SC phase features $s$-wave interlayer spin-singlet pairing and exhibits a crossover between the BCS and BEC limits by tuning the $J/t$ ratio. We estimate the SC transition temperature $T_c$ from both the weak and strong coupling limits at the mean-field level. Our findings offer insights into the experimentally observed decrease in $T_c$ with pressure and the strange metal behavior above $T_c$. Additionally, we propose that both Ni $3d_{z^2}$ and $3d_{x^2-y^2}$ orbitals can exhibit superconductivity in La$_3$Ni$_2$O$_7$ under pressure, but their $T_c$ should vary in opposite ways under doping. This characteristic difference suggests a potential experimental pathway to identify which electronic orbital plays the principal role in the formation of superconductivity in this system.

cond-mat.str-el↗

arXiv2023

Homography matrix based trajectory planning method for robot uncalibrated visual servoing

In view of the classical visual servoing trajectory planning method which only considers the camera trajectory, this paper proposes one homography matrix based trajectory planning method for robot uncalibrated visual servoing. Taking the robot-end-effector frame as one generic case, eigenvalue decomposition is utilized to calculate the infinite homography matrix of the robot-end-effector trajectory, and then the image feature-point trajectories corresponding to the camera rotation is obtained, while the image feature-point trajectories corresponding to the camera translation is obtained by the homography matrix. According to the additional image corresponding to the robot-end-effector rotation, the relationship between the robot-end-effector rotation and the variation of the image feature-points is obtained, and then the expression of the image trajectories corresponding to the optimal robot-end-effector trajectories (the rotation trajectory of the minimum geodesic and the linear translation trajectory) are obtained. Finally, the optimal image trajectories of the uncalibrated visual servoing controller is modified to track the image trajectories. Simulation experiments show that, compared with the classical IBUVS method, the proposed trajectory planning method can obtain the shortest path of any frame and complete the robot visual servoing task with large initial pose deviation.

cs.RO↗

arXiv2023

Neural Network-Based Histologic Remission Prediction In Ulcerative Colitis

BACKGROUND & AIMS: Histological remission (HR) is advocated and considered as a new therapeutic target in ulcerative colitis (UC). Diagnosis of histologic remission currently relies on biopsy; during this process, patients are at risk for bleeding, infection, and post-biopsy fibrosis. In addition, histologic response scoring is complex and time-consuming, and there is heterogeneity among pathologists. Endocytoscopy (EC) is a novel ultra-high magnification endoscopic technique that can provide excellent in vivo assessment of glands. Based on the EC technique, we propose a neural network model that can assess histological disease activity in UC using EC images to address the above issues. The experiment results demonstrate that the proposed method can assist patients in precise treatment and prognostic assessment. METHODS: We construct a neural network model for UC evaluation. A total of 5105 images of 154 intestinal segments from 87 patients undergoing EC treatment at a center in China between March 2022 and March 2023 are scored according to the Geboes score. Subsequently, 103 intestinal segments are used as the training set, 16 intestinal segments are used as the validation set for neural network training, and the remaining 35 intestinal segments are used as the test set to measure the model performance together with the validation set. RESULTS: By treating HR as a negative category and histologic activity as a positive category, the proposed neural network model can achieve an accuracy of 0.9, a specificity of 0.95, a sensitivity of 0.75, and an area under the curve (AUC) of 0.81. CONCLUSION: We develop a specific neural network model that can distinguish histologic remission/activity in EC images of UC, which helps to accelerate clinical histological diagnosis. keywords: ulcerative colitis; Endocytoscopy; Geboes score; neural network.

cs.CV↗