Searcharxiv⌕ Search

arXiv subjects

Jungang Li

Publications and source records attributed to Jungang Li.

50 records · Page 3Linked to original sources

MOSS-ChatV: Reinforcement Learning with Process Reasoning Reward for Video Temporal Reasoning

Video reasoning has emerged as a critical capability for multimodal large language models (MLLMs), requiring models to move beyond static perception toward coherent understanding of temporal dynamics in complex scenes. Yet existing MLLMs often exhibit process inconsistency, where intermediate reasoning drifts from video dynamics even when the final answer is correct, undermining interpretability and robustness. To address this issue, we introduce MOSS-ChatV, a reinforcement learning framework with a Dynamic Time Warping (DTW)-based process reward. This rule-based reward aligns reasoning traces with temporally grounded references, enabling efficient process supervision without auxiliary reward models. We further identify dynamic state prediction as a key measure of video reasoning and construct MOSS-Video, a benchmark with annotated reasoning traces, where the training split is used to fine-tune MOSS-ChatV and the held-out split is reserved for evaluation. MOSS-ChatV achieves 87.2\% on MOSS-Video (test) and improves performance on general video benchmarks such as MVBench and MMVU. The framework consistently yields gains across different architectures, including Qwen2.5-VL and Phi-2, confirming its broad applicability. Evaluations with GPT-4o-as-judge further show that MOSS-ChatV produces more consistent and stable reasoning traces.

cs.CV↗

Exploring Response Uncertainty in MLLMs: An Empirical Evaluation under Misleading Scenarios

Multimodal large language models (MLLMs) have recently achieved state-of-the-art performance on tasks ranging from visual question answering to video understanding. However, existing studies have concentrated mainly on visual-textual misalignment, leaving largely unexplored the MLLMs' ability to preserve an originally correct answer when confronted with misleading information. We reveal a response uncertainty phenomenon: across nine standard datasets, twelve state-of-the-art open-source MLLMs overturn a previously correct answer in 65% of cases after receiving a single deceptive cue. To systematically quantify this vulnerability, we propose a two-stage evaluation pipeline: (1) elicit each model's original response on unperturbed inputs; (2) inject explicit (false-answer hints) and implicit (contextual contradictions) misleading instructions, and compute the misleading rate - the fraction of correct-to-incorrect flips. Leveraging the most susceptible examples, we curate the Multimodal Uncertainty Benchmark (MUB), a collection of image-question pairs stratified into low, medium, and high difficulty based on how many of twelve state-of-the-art MLLMs they mislead. Extensive evaluation on twelve open-source and five closed-source models reveals a high uncertainty: average misleading rates exceed 86%, with explicit cues over 67.19% and implicit cues over 80.67%. To reduce the misleading rate, we then fine-tune all open-source MLLMs on a compact 2000-sample mixed-instruction dataset, reducing misleading rates to 6.97% (explicit) and 32.77% (implicit), boosting consistency by nearly 29.37% on highly deceptive inputs, and slightly improving accuracy on standard benchmarks. Our code is available at https://github.com/Yunkaidang/uncertainty

cs.LG↗

Mind the Third Eye! Benchmarking Privacy Awareness in MLLM-powered Smartphone Agents

Smartphones bring significant convenience to users but also enable devices to extensively record various types of personal information. Existing smartphone agents powered by Multimodal Large Language Models (MLLMs) have achieved remarkable performance in automating different tasks. However, as the cost, these agents are granted substantial access to sensitive users' personal information during this operation. To gain a thorough understanding of the privacy awareness of these agents, we present the first large-scale benchmark encompassing 7,138 scenarios to the best of our knowledge. In addition, for privacy context in scenarios, we annotate its type (e.g., Account Credentials), sensitivity level, and location. We then carefully benchmark seven available mainstream smartphone agents. Our results demonstrate that almost all benchmarked agents show unsatisfying privacy awareness (RA), with performance remaining below 60% even with explicit hints. Overall, closed-source agents show better privacy ability than open-source ones, and Gemini 2.0-flash achieves the best, achieving an RA of 67%. We also find that the agents' privacy detection capability is highly related to scenario sensitivity level, i.e., the scenario with a higher sensitivity level is typically more identifiable. We hope the findings enlighten the research community to rethink the unbalanced utility-privacy tradeoff about smartphone agents. Our code and benchmark are available at https://zhixin-l.github.io/SAPA-Bench.

cs.CR↗

Unveiling Instruction-Specific Neurons & Experts: An Analytical Framework for LLM's Instruction-Following Capabilities

The finetuning of Large Language Models (LLMs) has significantly advanced their instruction-following capabilities, yet the underlying computational mechanisms driving these improvements remain poorly understood. This study systematically examines how fine-tuning reconfigures LLM computations by isolating and analyzing instruction-specific sparse components, i.e., neurons in dense models and both neurons and experts in Mixture-of-Experts (MoE) architectures. In particular, we introduce HexaInst, a carefully curated and balanced instructional dataset spanning six distinct categories, and propose SPARCOM, a novel analytical framework comprising three key contributions: (1) a method for identifying these sparse components, (2) an evaluation of their functional generality and uniqueness, and (3) a systematic comparison of their alterations. Through experiments, we demonstrate functional generality, uniqueness, and the critical role of these components in instruction execution. By elucidating the relationship between fine-tuning-induced adaptations and sparse computational substrates, this work provides deeper insights into how LLMs internalize instruction-following behavior for the trustworthy LLM community.

cs.CL↗

PhysicsArena: The First Multimodal Physics Reasoning Benchmark Exploring Variable, Process, and Solution Dimensions

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in diverse reasoning tasks, yet their application to complex physics reasoning remains underexplored. Physics reasoning presents unique challenges, requiring grounding in physical conditions and the interpretation of multimodal information. Current physics benchmarks are limited, often focusing on text-only inputs or solely on problem-solving, thereby overlooking the critical intermediate steps of variable identification and process formulation. To address these limitations, we introduce PhysicsArena, the first multimodal physics reasoning benchmark designed to holistically evaluate MLLMs across three critical dimensions: variable identification, physical process formulation, and solution derivation. PhysicsArena aims to provide a comprehensive platform for assessing and advancing the multimodal physics reasoning abilities of MLLMs.

cs.CL↗

CoheMark: A Novel Sentence-Level Watermark for Enhanced Text Quality

Watermarking technology is a method used to trace the usage of content generated by large language models. Sentence-level watermarking aids in preserving the semantic integrity within individual sentences while maintaining greater robustness. However, many existing sentence-level watermarking techniques depend on arbitrary segmentation or generation processes to embed watermarks, which can limit the availability of appropriate sentences. This limitation, in turn, compromises the quality of the generated response. To address the challenge of balancing high text quality with robust watermark detection, we propose CoheMark, an advanced sentence-level watermarking technique that exploits the cohesive relationships between sentences for better logical fluency. The core methodology of CoheMark involves selecting sentences through trained fuzzy c-means clustering and applying specific next sentence selection criteria. Experimental evaluations demonstrate that CoheMark achieves strong watermark strength while exerting minimal impact on text quality.

cs.CL↗

The Method of Moving Spheres on the Hyperbolic Space and the Classification of Solutions and the prescribed Q-curvature problem

The classification of solutions to semilinear partial differential equations, as well as the classification of critical points of the corresponding functionals, have wide applications in the study of partial differential equations and differential geometry. The classical moving plane method and the method of moving sphere on the Euclidean space $\mathbb{R}^n$ provide an effective approach to capture the symmetry of solutions. As far as we know, the moving sphere method has yet to be developed on the hyperbolic space $\mathbb{H}^n$. In the present paper, we focus on the following equation \begin{equation*} P_k u = f(u) \end{equation*} on hyperbolic spaces $\mathbb{H}^n$, where $P_k$ denotes the GJMS operators on $\mathbb{H}^n$ and $f : \mathbb{R} \to \mathbb{R}$ satisfies certain growth conditions. We develop a moving sphere approach on $\mathbb{H}^n$ to obtain the symmetry propertyas well as the classification of positive solutions to the above equation. Our methods also rely on the Helgason-Fourier analysis and Hardy-Littlewood-Sobolev inequalities on hyperbolic space together with a Kelvin transform we introduce on the hyperbolic space in this paper. We also present applications to the higher order prescribed $Q$-curvature problem on the hyperbolic space.

math.AP↗

SAVEn-Vid: Synergistic Audio-Visual Integration for Enhanced Understanding in Long Video Context

Endeavors have been made to explore Large Language Models for video analysis (Video-LLMs), particularly in understanding and interpreting long videos. However, existing Video-LLMs still face challenges in effectively integrating the rich and diverse audio-visual information inherent in long videos, which is crucial for comprehensive understanding. This raises the question: how can we leverage embedded audio-visual information to enhance long video understanding? Therefore, (i) we introduce SAVEn-Vid, the first-ever long audio-visual video dataset comprising over 58k audio-visual instructions. (ii) From the model perspective, we propose a time-aware Audio-Visual Large Language Model (AV-LLM), SAVEnVideo, fine-tuned on SAVEn-Vid. (iii) Besides, we present AVBench, a benchmark containing 2,500 QAs designed to evaluate models on enhanced audio-visual comprehension tasks within long video, challenging their ability to handle intricate audio-visual interactions. Experiments on AVBench reveal the limitations of current AV-LLMs. Experiments also demonstrate that SAVEnVideo outperforms the best Video-LLM by 3.61% on the zero-shot long video task (Video-MME) and surpasses the leading audio-visual LLM by 1.29% on the zero-shot audio-visual task (Music-AVQA). Consequently, at the 7B parameter scale, SAVEnVideo can achieve state-of-the-art performance. Our dataset and code will be released at https://ljungang.github.io/SAVEn-Vid/ upon acceptance.

cs.CV↗

Symmetry of solutions to higher and fractional order semilinear equations on hyperbolic spaces

We show that nontrivial solutions to higher and fractional order equations with certain nonlinearity are radially symmetric and nonincreasing on geodesic balls in the hyperbolic space $\mathbb{H}^n$ as well as on the entire space $\mathbb{H}^n$. Applying the Helgason-Fourier analysis techniques on $\mathbb{H}^n$, we develop a moving plane approach for integral equations on $\mathbb{H}^n$. We also establish the symmetry to solutions of certain equations with singular terms on Euclidean spaces. Moreover, we obtain symmetry to solutions of some semilinear equations involving fractional order derivatives.

math.AP↗

The Chang-Marshall Trace Inequality for Sobolev functions in domains in higher dimensional space $\mathbb{R}^n$

In their celebrated work [5], Chang and Marshall established a critical trace inequality of Moser-Trudinger type for holomorphic functions with mean value zero on unit disc in the complex plane. The main purpose is to address a question proposed to us by S. Y. Alice Chang who asked whether the Chang-Marshall type inequality for holomorphic functions on unit disk in the complex plane holds for Sobolev functions on general domains in higher dimensional Euclidean space $\mathbb{R}^n$ for all $n\ge 2$. We partially answer her question affirmatively.

math.CV↗

Higher order Brezis-Nirenberg problem on hyperbolic spaces: Existence, nonexistence and symmetry of solutions

The main purpose of this paper is to establish the existence, nonexistence and symmetry of nontrivial solutions to the higher order Brezis-Nirenberg problems associated with the GJMS operators $P_k$ on bounded domains in the hyperbolic space $\mathbb{H}^n$ and as well as on the entire hyperbolic space $\mathbb{H}^n$. Among other techniques, one of our main novelties is to use crucially the Helgason-Fourier analysis on hyperbolic spaces and the higher order Hardy-Sobolev-Maz'ya inequalities and careful study of delicate properties of Green's functions of $P_k-λ$ on hyperbolic spaces which are of independent interests in dealing with such problems. Such Green's functions allow us to obtain the integral representations of solutions and thus to avoid using the maximum principle to establish the symmetry of solutions.

math.AP↗

The $p$-ellipticity condition for second order elliptic systems and applications to the Lamé and homogenisation problems

The notion of $p$-ellipticity has recently played a significant role in improving our understanding of issues of solvability of boundary value problems for scalar complex valued elliptic PDEs. In particular, the presence of $p$-ellipticity ensures higher regularity of solutions of such equations. In this work we extend the notion of $p$-ellipticity to second order elliptic systems. Recall that for systems, there is no single notion of ellipticity, rather a more complicated picture emerges with ellipticity conditions of varying strength such as the Legendre, Legendre-Hadamard and integral conditions. A similar picture emerges when $p$-ellipticity is considered. In this paper, we define three new notions of $p$-ellipticity, establish relationships between them and show that each of them does play an important role in solving boundary value problems. These important roles are demonstrated by establishing extrapolation results for solvability of the $L^p$ Dirichlet problem for elliptic systems, followed by applications of this result in two different scenarios: one for the Lamé system of linear elasticity and another in the theory of homogenization.

math.AP↗

Commissioning of te China-ADS injector-I testing facility

The 10 MeV accelerator-driven subcritical system (ADS) Injector-I test stand at Institute of High Energy Physics (IHEP) is a testing facility dedicated to demonstrate one of the two injector design schemes [Injector Scheme-I, which works at 325 MHz], for the ADS project in China. The Injector adopted a four vane copper structure RFQ with output energy of 3.2 MeV and a superconducting (SC) section accommodating fourteen \b{eta}g=0.12 single spoke cavities, fourteen SC solenoids and fourteen cold BPMs. The ion source was installed since April of 2014, periods of commissioning are regularly scheduled between installation phases of the rest of the injector. Continuous wave (CW) beam was shooting through the injector and 10 MeV CW proton beam with average beam current around 2 mA was obtained recently. This contribution describe the results achieved so far and the difficulties encountered in CW commissioning.

physics.acc-ph↗

Concentration-compactness principle for Trudinger-Moser inequalities on Heisenberg Groups and existence of ground state solutions

Let $\mathbb{H}^{n}=\mathbb{C}^{n}\times\mathbb{R}$ be the $n$-dimensional Heisenberg group, $Q=2n+2$ be the homogeneous dimension of $\mathbb{H}^{n}$. We extend the well-known concentration-compactness principle on finite domains in the Euclidean spaces of \ P. L. Lions to the setting of the Heisenberg group $\mathbb{H}^{n}$. Furthermore, we also obtain the corresponding concentration-compactness principle for the Sobolev space $HW^{1,Q}\left( \mathbb{H}^{n}\right) $ on the entire Heisenberg group $\mathbb{H}^{n}$. Our results improve the sharp Trudinger-Moser inequality on domains of finite measure in $\mathbb{H}^{n}$ by Cohn and the second author [8] and the corresponding one on the whole space $\mathbb{H}^n$ by Lam and the second author [21]. All the proofs of the concentration-compactness principles in the literature even in the Euclidean spaces use the rearrangement argument and the Polyá-Szegö inequality. Due to the absence of the Polyá-Szegö inequality on the Heisenberg group, we will develop a different argument. Our approach is surprisingly simple and general and can be easily applied to other settings where symmetrization argument does not work. As an application of the concentration-compactness principle, we establish the existence of ground state solutions for a class of $Q$- Laplacian subelliptic equations on $\mathbb{H}^{n}$ with nonlinear terms $f$ of maximal exponential growth $\exp\left( αt^{\frac{Q}{Q-1}}\right) $ as $t\rightarrow+\infty$.

math.AP↗