arXiv subjects

Hongxin Zhang

Publications and source records attributed to Hongxin Zhang.

At least 37 records · Page 2Linked to original sources

arXiv2025

Hunyuan-Game: Industrial-grade Intelligent Game Creation Model

Intelligent game creation represents a transformative advancement in game development, utilizing generative artificial intelligence to dynamically generate and enhance game content. Despite notable progress in generative models, the comprehensive synthesis of high-quality game assets, including both images and videos, remains a challenging frontier. To create high-fidelity game content that simultaneously aligns with player preferences and significantly boosts designer efficiency, we present Hunyuan-Game, an innovative project designed to revolutionize intelligent game production. Hunyuan-Game encompasses two primary branches: image generation and video generation. The image generation component is built upon a vast dataset comprising billions of game images, leading to the development of a group of customized image generation models tailored for game scenarios: (1) General Text-to-Image Generation. (2) Game Visual Effects Generation, involving text-to-effect and reference image-based game visual effect generation. (3) Transparent Image Generation for characters, scenes, and game visual effects. (4) Game Character Generation based on sketches, black-and-white images, and white models. The video generation component is built upon a comprehensive dataset of millions of game and anime videos, leading to the development of five core algorithmic models, each targeting critical pain points in game development and having robust adaptation to diverse game video scenarios: (1) Image-to-Video Generation. (2) 360 A/T Pose Avatar Video Synthesis. (3) Dynamic Illustration Generation. (4) Generative Video Super-Resolution. (5) Interactive Game Video Generation. These image and video generation models not only exhibit high-level aesthetic expression but also deeply integrate domain-specific knowledge, establishing a systematic understanding of diverse game and anime art styles.

cs.CV↗

arXiv2025

Retrieval Augmented Decision-Making: A Requirements-Driven, Multi-Criteria Framework for Structured Decision Support

Various industries have produced a large number of documents such as industrial plans, technical guidelines, and regulations that are structurally complex and content-wise fragmented. This poses significant challenges for experts and decision-makers in terms of retrieval and understanding. Although existing LLM-based Retrieval-Augmented Generation methods can provide context-related suggestions, they lack quantitative weighting and traceable reasoning paths, making it difficult to offer multi-level and transparent decision support. To address this issue, this paper proposes the RAD method, which integrates Multi-Criteria Decision Making with the semantic understanding capabilities of LLMs. The method automatically extracts key criteria from industry documents, builds a weighted hierarchical decision model, and generates structured reports under model guidance. The RAD framework introduces explicit weight assignment and reasoning chains in decision generation to ensure accuracy, completeness, and traceability. Experiments show that in various decision-making tasks, the decision reports generated by RAD significantly outperform existing methods in terms of detail, rationality, and structure, demonstrating its application value and potential in complex decision support scenarios.

cs.AI↗

arXiv2025

TesserAct: Learning 4D Embodied World Models

This paper presents an effective approach for learning novel 4D embodied world models, which predict the dynamic evolution of 3D scenes over time in response to an embodied agent's actions, providing both spatial and temporal consistency. We propose to learn a 4D world model by training on RGB-DN (RGB, Depth, and Normal) videos. This not only surpasses traditional 2D models by incorporating detailed shape, configuration, and temporal changes into their predictions, but also allows us to effectively learn accurate inverse dynamic models for an embodied agent. Specifically, we first extend existing robotic manipulation video datasets with depth and normal information leveraging off-the-shelf models. Next, we fine-tune a video generation model on this annotated dataset, which jointly predicts RGB-DN (RGB, Depth, and Normal) for each frame. We then present an algorithm to directly convert generated RGB, Depth, and Normal videos into a high-quality 4D scene of the world. Our method ensures temporal and spatial coherence in 4D scene predictions from embodied scenarios, enables novel view synthesis for embodied environments, and facilitates policy learning that significantly outperforms those derived from prior video-based world models.

cs.CV↗

arXiv2025

COMBO: Compositional World Models for Embodied Multi-Agent Cooperation

In this paper, we investigate the problem of embodied multi-agent cooperation, where decentralized agents must cooperate given only egocentric views of the world. To effectively plan in this setting, in contrast to learning world dynamics in a single-agent scenario, we must simulate world dynamics conditioned on an arbitrary number of agents' actions given only partial egocentric visual observations of the world. To address this issue of partial observability, we first train generative models to estimate the overall world state given partial egocentric observations. To enable accurate simulation of multiple sets of actions on this world state, we then propose to learn a compositional world model for multi-agent cooperation by factorizing the naturally composable joint actions of multiple agents and compositionally generating the video conditioned on the world state. By leveraging this compositional world model, in combination with Vision Language Models to infer the actions of other agents, we can use a tree search procedure to integrate these modules and facilitate online cooperative planning. We evaluate our methods on three challenging benchmarks with 2-4 agents. The results show our compositional world model is effective and the framework enables the embodied agents to cooperate efficiently with different agents across various tasks and an arbitrary number of agents, showing the promising future of our proposed methods. More videos can be found at https://umass-embodied-agi.github.io/COMBO/.

cs.CV↗

arXiv2025

3D-Mem: 3D Scene Memory for Embodied Exploration and Reasoning

Constructing compact and informative 3D scene representations is essential for effective embodied exploration and reasoning, especially in complex environments over extended periods. Existing representations, such as object-centric 3D scene graphs, oversimplify spatial relationships by modeling scenes as isolated objects with restrictive textual relationships, making it difficult to address queries requiring nuanced spatial understanding. Moreover, these representations lack natural mechanisms for active exploration and memory management, hindering their application to lifelong autonomy. In this work, we propose 3D-Mem, a novel 3D scene memory framework for embodied agents. 3D-Mem employs informative multi-view images, termed Memory Snapshots, to represent the scene and capture rich visual information of explored regions. It further integrates frontier-based exploration by introducing Frontier Snapshots-glimpses of unexplored areas-enabling agents to make informed decisions by considering both known and potential new information. To support lifelong memory in active exploration settings, we present an incremental construction pipeline for 3D-Mem, as well as a memory retrieval technique for memory management. Experimental results on three benchmarks demonstrate that 3D-Mem significantly enhances agents' exploration and reasoning capabilities in 3D environments, highlighting its potential for advancing applications in embodied AI.

cs.CV↗

arXiv2025

A Brain-Computer Interface Data Persistence System for Multi-Scenario and Multi-Modal Data: NeuroStore

With the rapid advancement of brain-computer interface (BCI) technology, the volume of physiological data generated in related research and applications has grown significantly. Data is a critical resource in BCI research and a key factor in the development of BCI technology, making efficient storage and management of this data increasingly vital. In the realm of research, ample data can facilitate the development of novel algorithms, which can be more accurately validated. In terms of applications, well-organized data can foster the emergence of new business opportunities, thereby maximizing the commercial value of the data. Currently, there are two major challenges in the storage and management of BCI data: providing different classification storage modes for multi-modal data, and adapting to varying application scenarios while improving storage strategies. To address these challenges, this study has developed the NeuroStore BCI data persistence system, which provides a general and easily scalable data model and can effectively handle multiple types of data storage. The system has a flexible distributed framework and can be widely applied to various scenarios. It has been utilized as the core support platform for efficient data storage and management services in the "BCI Controlled Robot Contest in World Robot Contest."

cs.DB↗

arXiv2025

Dominant Role of Coplanar Inflows in Driving Disk Evolution Revealed by Gas-Phase Metallicity Gradients

Using spatially resolved spectroscopic data from the MaNGA sample, we investigate the parameters influencing the radial gradients of gas-phase metallicity ($\nabla\log(\mathrm{O/H})$), to determine whether disk formation is primarily driven by coplanar gas inflow or by the independent evolution of distinct regions within the disk. Our results show that $\nabla \log(\mathrm{O/H})$ strongly correlates with local gas-phase metallicity at a given stellar mass, with steeper gradients observed in metal-poorer disks. This trend supports the coplanar gas inflow scenario, wherein the gas is progressively enriched by in situ star formation as it flows inward. In contrast, the radial gradient of stellar mass surface density shows very weak correlations with $\nabla \log(\mathrm{O/H})$, which is inconsistent with the independent evolution mode, where gas inflow, star formation, and metal enrichment occur independently within each annulus of the disk. Furthermore, we find that $\nabla \log(\mathrm{O/H})$ is also closely correlated with an indicator of local gas turbulence $σ_{\mathrm{gas}}/R_{\mathrm{e}}$, highlighting the competing roles of turbulence and coplanar inflow in shaping metallicity gradients. Our results provide indirect observational evidence supporting coplanar gas inflow as the driving mechanism for disk evolution.

astro-ph.GA↗

arXiv2025

Dwarf Galaxy Integral-field Survey (DGIS): survey overview and the result of global mass-metallicity relation

Low-mass galaxies are the building blocks of massive galaxies in the framework of hierarchical structure formation. To enable detailed studies of galactic ecosystems in dwarf galaxies by spatially resolving different galactic components, we have carried out the Dwarf Galaxy Integral-field Survey (DGIS). This survey aims to acquire observations with spatial resolutions as high as 10 to 100 pc while maintaining reasonably high signal-to-noise ratios with VLT/MUSE and ANU-2.3m/WiFeS. The whole sample will be composed of 65 dwarf galaxies with $M_{\rm \ast}$ $<$ 10$^{9}$ $\rm M_{\odot}$, selected from the Spitzer Local Volume Legacy Survey. The overall scientific goals include studying baryonic cycles in dwarf galaxies, searching for off-nuclear (intermediate)-massive black holes, and quantifying the inner density profiles of dark matter. In this work, we describe the sample selection, data reduction, and high-level data products. By integrating the spectra over the field of view for each galaxy, we obtained the integrated gas-phase metallicity and discussed its dependence on stellar mass and SFR. We find that the overall relation between metallicity and stellar mass of our DGIS nearly follows the extrapolation from the higher mass end. Its dispersion does not decrease by invoking the dependence on SFR.

astro-ph.GA↗

arXiv2024

Size Growth on Short Timescales of Star-Forming Galaxies: Insights from Size Variation with Rest-Frame Wavelength with JADES

We investigate size variation with rest-frame wavelength for star-forming galaxies based on the second JWST Advanced Deep Extragalactic Survey data release. Star-forming galaxies are typically smaller at longer wavelength from UV-to-NIR at $z<3.5$, especially for more massive galaxies, indicating the inside-out assembly with in-situ star formation if ignoring dust attenuation. The size variation with wavelength shows strong dependence on stellar mass, and shows little or no dependence on redshift, specific star formation rate and galaxy environment. This suggests that the size growth of star-forming galaxies is a self-regulated process primarily governed by stellar mass. We model size as a function of both mass and redshift simultaneously, obtaining $R_{\rm e} \propto M_*^{0.23} (1+z)^{-1.04}$ at a wavelength of 0.45 ${μ\mathrm{m}}$, and $R_{\rm e} \propto M_*^{0.20} (1+z)^{-1.08}$ at 1.0 ${μ\mathrm{m}}$. Based on this size evolution and the star formation main sequence from the literature, we obtain the locus of typical size growth for individual galaxies of different masses on the mass-size plane. The moving trend of galaxies on the mass-size plane, which indicates the slopes of their locus, strongly correlates with the size ratio between 0.45 ${μ\mathrm{m}}$ and 1.0 ${μ\mathrm{m}}$, supporting the idea that the size variation with wavelength provides important information on size growth of galaxies on short timescales.

astro-ph.GA↗

arXiv2024

Exploring the origin of cold gas and star formation in a rare population of strongly bulge-dominated early-type Galaxies

We analyze the properties of a rare population, the strongly bulge-dominated early-type galaxies (referred to as sBDEs) with significant HI gas, using the databases from the FAST All Sky HI survey (FASHI) and the Arecibo Legacy Fast ALFA (ALFALFA) survey. We select the sBDEs from the Sloan Digital Sky Survey (SDSS) and cross-match with the FASHI-ALFALFA combined HI sample, resulting in 104 HI-rich sBDEs. These sBDEs tend to have extremely high HI reservoirs, which is rare in previous studies such as ATLAS$^{3D}$. 70% of the selected sBDEs are classified as quiescent galaxies, even though they have a large HI reservoir. We study the properties of these sBDEs from five main aspects: stellar population, gas-phase metallicity, stacked HI spectra, environment, and spatially resolved MaNGA data. The majority of HI-rich sBDEs appear to show lower gas-phase metallicity and are located in significantly lower-density environments, suggesting an external origin for their HI gas. We find that star-forming sBDEs exhibit statistically higher star formation efficiency and slightly older stellar populations compared to normal star-forming galaxies, suggesting a recent star formation on Gyr-timescale. They also show narrower and more concentrated HI profiles compared to control star-forming galaxies, which may explain their higher star formation efficiency.

astro-ph.GA↗

arXiv2024

USmorph: An Updated Framework of Automatic Classification of Galaxy Morphologies and Its Application to Galaxies in the COSMOS Field

Morphological classification conveys abundant information on the formation, evolution, and environment of galaxies. In this work, we refine the two-step galaxy morphological classification framework ({\tt\string USmorph}), which employs a combination of unsupervised machine learning (UML) and supervised machine learning (SML) techniques, along with a self-consistent and robust data preprocessing step. The updated method is applied to the galaxies with $I_{\rm mag}<25$ at $0.2<z<1.2$ in the COSMOS field. Based on their HST/ACS I-band images, we classify them into five distinct morphological types: spherical (SPH, 15,200), early-type disk (ETD, 17,369), late-type disk (LTD, 21,143), irregular disk (IRR, 28,965), and unclassified (UNC, 17,129). In addition, we have conducted both parametric and nonparametric morphological measurements. For galaxies with stellar masses exceeding $10^{9}M_{\sun}$, a gradual increase in effective radius from SPHs to IRRs is observed, accompanied by a decrease in the Sérsic index. Nonparametric morphologies reveal distinct distributions of galaxies across the $Gini-M_{20}$ and $C-A$ parameter spaces for different categories. Moreover, different categories exhibit significant dissimilarity in their $G_2$ and $Ψ$ distributions. We find morphology to be strongly correlated with redshift and stellar mass. The consistency of these classification results with expected correlations among multiple parameters underscores the validity and reliability of our classification method, rendering it a valuable tool for future studies.

astro-ph.GA↗

arXiv2024

SALMON: Self-Alignment with Instructable Reward Models

Supervised Fine-Tuning (SFT) on response demonstrations combined with Reinforcement Learning from Human Feedback (RLHF) constitutes a powerful paradigm for aligning LLM-based AI agents. However, a significant limitation of such an approach is its dependency on high-quality human annotations, making its application to intricate tasks challenging due to difficulties in obtaining consistent response demonstrations and in-distribution response preferences. This paper presents a novel approach, namely SALMON, to align base language models with minimal human supervision, using only a small set of human-defined principles, yet achieving superior performance. Central to our approach is an instructable reward model. Trained on synthetic preference data, this model can generate reward scores based on arbitrary human-defined principles. By merely adjusting these principles during the RL training phase, we gain full control over the preferences with the instructable reward model, subsequently influencing the behavior of the RL-trained policy models, and reducing the reliance on the collection of online human preferences. Applying our method to the LLaMA-2-70b base language model, we developed an AI assistant named Dromedary-2. With only 6 exemplars for in-context learning and 31 human-defined principles, Dromedary-2 significantly surpasses the performance of several state-of-the-art AI systems, including LLaMA-2-Chat-70b, on various benchmark datasets. We have open-sourced the code and model weights to encourage further research into aligning LLM-based AI agents with enhanced supervision efficiency, improved controllability, and scalable oversight.

cs.CL↗

arXiv2024

A study of the merging dwarf galaxy VCC322

Galaxy interactions and mergers can enhance or reduce star formation, but a complete understanding of the involved processes is still lacking. The effect of dwarf galaxy mergers is even less clear than their massive counterpart. We present a study on a dwarf merger remnant in the Virgo cluster, VCC322, which might form a triple system with VCC334 and VCC319. We identify a prominent long and straight tail-like substructure that has a size comparable to its host galaxy VCC322. By comparing the color-color ($g-r$ vs. $r-H$) distribution with simple stellar population models, we infer that the metallicity and stellar age of this tail are $Z_\star \sim 0.02~Z_\odot$ and $t_\star \sim 10$~Gyr, respectively. In VCC319, we find a sign of isophotal twisting. This suggests that VCC319 may be subject to tidal interaction. An analysis of the SDSS optical spectra of VCC322 indicates mass- and light-weighted ages of about 10$^{9.8}$ yr and 10$^{7.5}$ yr, respectively, indicating an ongoing star formation activity. However, the star formation in VCC322 seems suppressed when compared to other star-forming dwarfs of comparable stellar masses. Our finding of shock excitation of optical emission lines indicates that interaction-induced shock may contribute to the heating of cold gas and suppression of star formation.

astro-ph.GA↗

arXiv2024

Building Cooperative Embodied Agents Modularly with Large Language Models

In this work, we address challenging multi-agent cooperation problems with decentralized control, raw sensory observations, costly communication, and multi-objective tasks instantiated in various embodied environments. While previous research either presupposes a cost-free communication channel or relies on a centralized controller with shared observations, we harness the commonsense knowledge, reasoning ability, language comprehension, and text generation prowess of LLMs and seamlessly incorporate them into a cognitive-inspired modular framework that integrates with perception, memory, and execution. Thus building a Cooperative Embodied Language Agent CoELA, who can plan, communicate, and cooperate with others to accomplish long-horizon tasks efficiently. Our experiments on C-WAH and TDW-MAT demonstrate that CoELA driven by GPT-4 can surpass strong planning-based methods and exhibit emergent effective communication. Though current Open LMs like LLAMA-2 still underperform, we fine-tune a CoELA with data collected with our agents and show how they can achieve promising performance. We also conducted a user study for human-agent interaction and discovered that CoELA communicating in natural language can earn more trust and cooperate more effectively with humans. Our research underscores the potential of LLMs for future research in multi-agent cooperation. Videos can be found on the project website https://vis-www.cs.umass.edu/Co-LLM-Agents/.

cs.AI↗

arXiv2024

HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environments

Recent advances in high-fidelity virtual environments serve as one of the major driving forces for building intelligent embodied agents to perceive, reason and interact with the physical world. Typically, these environments remain unchanged unless agents interact with them. However, in real-world scenarios, agents might also face dynamically changing environments characterized by unexpected events and need to rapidly take action accordingly. To remedy this gap, we propose a new simulated embodied benchmark, called HAZARD, specifically designed to assess the decision-making abilities of embodied agents in dynamic situations. HAZARD consists of three unexpected disaster scenarios, including fire, flood, and wind, and specifically supports the utilization of large language models (LLMs) to assist common sense reasoning and decision-making. This benchmark enables us to evaluate autonomous agents' decision-making capabilities across various pipelines, including reinforcement learning (RL), rule-based, and search-based methods in dynamically changing environments. As a first step toward addressing this challenge using large language models, we further develop an LLM-based agent and perform an in-depth analysis of its promise and challenge of solving these challenging tasks. HAZARD is available at https://vis-www.cs.umass.edu/hazard/.

cs.CV↗

arXiv2023

Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision

Recent AI-assistant agents, such as ChatGPT, predominantly rely on supervised fine-tuning (SFT) with human annotations and reinforcement learning from human feedback (RLHF) to align the output of large language models (LLMs) with human intentions, ensuring they are helpful, ethical, and reliable. However, this dependence can significantly constrain the true potential of AI-assistant agents due to the high cost of obtaining human supervision and the related issues on quality, reliability, diversity, self-consistency, and undesirable biases. To address these challenges, we propose a novel approach called SELF-ALIGN, which combines principle-driven reasoning and the generative power of LLMs for the self-alignment of AI agents with minimal human supervision. Our approach encompasses four stages: first, we use an LLM to generate synthetic prompts, and a topic-guided method to augment the prompt diversity; second, we use a small set of human-written principles for AI models to follow, and guide the LLM through in-context learning from demonstrations (of principles application) to produce helpful, ethical, and reliable responses to user's queries; third, we fine-tune the original LLM with the high-quality self-aligned responses so that the resulting model can generate desirable responses for each query directly without the principle set and the demonstrations anymore; and finally, we offer a refinement step to address the issues of overly-brief or indirect responses. Applying SELF-ALIGN to the LLaMA-65b base language model, we develop an AI assistant named Dromedary. With fewer than 300 lines of human annotations (including < 200 seed prompts, 16 generic principles, and 5 exemplars for in-context learning). Dromedary significantly surpasses the performance of several state-of-the-art AI systems, including Text-Davinci-003 and Alpaca, on benchmark datasets with various settings.

cs.LG↗

arXiv2023

An evolutionary continuum from nucleated dwarf galaxies to star clusters

Systematic studies have revealed hundreds of ultra-compact dwarf galaxies (UCDs) in the nearby Universe. With half-light radii $r_h$ of approximately 10-100 parsecs and stellar masses $M_*$ $\approx$ $10^6-10^8$ solar masses, UCDs are among the densest known stellar systems. Although similar in appearance to massive globular clusters, the detection of extended stellar envelopes, complex star formation histories, elevated mass-to-light ratio, and supermassive black holes suggest that some UCDs are remnant nuclear star clusters of tidally-stripped dwarf galaxies, or even ancient compact galaxies. However, only a few objects have been found in the transient stage of tidal stripping, and this assumed evolutionary path has never been fully traced by observations. Here we show that 106 galaxies in the Virgo cluster have morphologies that are intermediate between normal, nucleated dwarf galaxies and single-component UCDs, revealing a continuum that fully maps this morphological transition, and fills the `size gap' between star clusters and galaxies. Their spatial distribution and redder color are also consistent with stripped satellite galaxies on their first few pericentric passages around massive galaxies. The `ultra-diffuse' tidal features around several of these galaxies directly show how UCDs are forming through tidal stripping, and that this evolutionary path can include an early phase as a nucleated ultra-diffuse galaxy (UDG). These UCDs represent substantial visible fossil remnants of ancient dwarf galaxies in galaxy clusters, and more low-mass remnants probably remain to be found.

astro-ph.GA↗

arXiv2023

Sciences with the 2.5-meter Wide Field Survey Telescope (WFST)

The Wide Field Survey Telescope (WFST) is a dedicated photometric surveying facility being built jointly by the University of Science and Technology of China and the Purple Mountain Observatory. It is equipped with a 2.5-meter diameter primary mirror, an active optics system, and a mosaic CCD camera with 0.73 gigapixels on the primary focal plane for high-quality image capture over an FOV of 6.5-square-degree. It is anticipated that WFST will be set up at the Lenghu site in the summer of 2023 and begin to observe the northern sky in four optical bands (u, g, r, and i) with a range of cadences, from hourly/daily in the Deep High-Cadence Survey (DHS) program to semiweekly in the Wide-Field Survey (WFS) program, three months later. During a photometric night, a nominal 30 s exposure in the WFS program will reach a depth of 22.27, 23.32, 22.84, and 22.31 (AB magnitudes) in these four bands, respectively, allowing for the detection of a tremendous amount of transients in the low-z universe and a systematic investigation of the variability of Galactic and extragalactic objects. In the DHS program, intranight 90 s exposures as deep as 23 (u) and 24 mag (g), in combination with target of opportunity follow-ups, will provide a unique opportunity to explore energetic transients in demand for high sensitivities, including the electromagnetic counterparts of gravitational wave events, supernovae within a few hours of their explosions, tidal disruption events and fast, luminous optical transients even beyond a redshift of unity. In addition, the final 6-year co-added images, anticipated to reach g=25.8 mag in WFS or 1.5 mags deeper in DHS, will be of fundamental importance to general Galactic and extragalactic science. The highly uniform legacy surveys of WFST will serve as an indispensable complement to those of LSST that monitor the southern sky.

astro-ph.IM↗