Searcharxiv⌕ Search

arXiv subjects

Yuchen Huang

Publications and source records attributed to Yuchen Huang.

27 records · Page 2Linked to original sources

MMBoundary: Advancing MLLM Knowledge Boundary Awareness through Reasoning Step Confidence Calibration

In recent years, multimodal large language models (MLLMs) have made significant progress but continue to face inherent challenges in multimodal reasoning, which requires multi-level (e.g., perception, reasoning) and multi-granular (e.g., multi-step reasoning chain) advanced inferencing. Prior work on estimating model confidence tends to focus on the overall response for training and calibration, but fails to assess confidence in each reasoning step, leading to undesirable hallucination snowballing. In this work, we present MMBoundary, a novel framework that advances the knowledge boundary awareness of MLLMs through reasoning step confidence calibration. To achieve this, we propose to incorporate complementary textual and cross-modal self-rewarding signals to estimate confidence at each step of the MLLM reasoning process. In addition to supervised fine-tuning MLLM on this set of self-rewarded confidence estimation signal for initial confidence expression warm-up, we introduce a reinforcement learning stage with multiple reward functions for further aligning model knowledge and calibrating confidence at each reasoning step, enhancing reasoning chain self-correction. Empirical results show that MMBoundary significantly outperforms existing methods across diverse domain datasets and metrics, achieving an average of 7.5% reduction in multimodal confidence calibration errors and up to 8.3% improvement in task performance.

cs.CL↗

PhysicsSolver: Transformer-Enhanced Physics-Informed Neural Networks for Forward and Forecasting Problems in Partial Differential Equations

Time-dependent partial differential equations are a significant class of equations that describe the evolution of various physical phenomena over time. One of the open problems in scientific computing is predicting the behaviour of the solution outside the given temporal region. Most traditional numerical methods are applied to a given time-space region and can only accurately approximate the solution of the given region. To address this problem, many deep learning-based methods, basically data-driven and data-free approaches, have been developed to solve these problems. However, most data-driven methods require a large amount of data, which consumes significant computational resources and fails to utilize all the necessary information embedded underlying the partial differential equations (PDEs). Moreover, data-free approaches such as Physics-Informed Neural Networks (PINNs) may not be that ideal in practice, as traditional PINNs, which primarily rely on multilayer perceptrons (MLPs) and convolutional neural networks (CNNs), tend to overlook the crucial temporal dependencies inherent in real-world physical systems. We propose a method denoted as \textbf{PhysicsSolver} that merges the strengths of two approaches: data-free methods that can learn the intrinsic properties of physical systems without using data, and data-driven methods, which are effective at making predictions. Extensive numerical experiments have demonstrated the efficiency and robustness of our proposed method. We provide the code at \href{https://github.com/PhysicsSolver/PhysicsSolver}{https://github.com/PhysicsSolver}.

math.NA↗

pTSE: A Multi-model Ensemble Method for Probabilistic Time Series Forecasting

Various probabilistic time series forecasting models have sprung up and shown remarkably good performance. However, the choice of model highly relies on the characteristics of the input time series and the fixed distribution that the model is based on. Due to the fact that the probability distributions cannot be averaged over different models straightforwardly, the current time series model ensemble methods cannot be directly applied to improve the robustness and accuracy of forecasting. To address this issue, we propose pTSE, a multi-model distribution ensemble method for probabilistic forecasting based on Hidden Markov Model (HMM). pTSE only takes off-the-shelf outputs from member models without requiring further information about each model. Besides, we provide a complete theoretical analysis of pTSE to prove that the empirical distribution of time series subject to an HMM will converge to the stationary distribution almost surely. Experiments on benchmarks show the superiority of pTSE overall member models and competitive ensemble methods.

cs.LG↗

New analysis of Mixed finite element methods for incompressible Magnetohydrodynamics

The paper focuses on a new error analysis of a class of mixed FEMs for stationary incompressible magnetohydrodynamics with the standard inf-sup stable velocity-pressure space pairs to Navier-Stokes equations and the Nédélec's edge element for the magnetic field. The methods have been widely used in various numerical simulations in the last several decades, while the existing analysis is not optimal due to the strong coupling of system and the pollution of the lower-order Nédélec's edge approximation in analysis. In terms of a newly modified Maxwell projection we establish new and optimal error estimates. In particular, we prove that the method based on the commonly-used Taylor-Hood/lowest-order Nédélec's edge element is efficient and the method provides the second-order accuracy for numerical velocity. Two numerical examples for the problem in both convex and nonconvex polygonal domains are presented. Numerical results confirm our theoretical analysis.

math.NA↗

Phase transitions and thermodynamic geometry of a Kerr-Newman black hole in a cavity

Being placed in a cavity is an effective way of reaching thermodynamic equilibrium for black holes. We investigate a Kerr-Newman black hole in a cavity as well as compare it with two reduced cases, i.e., a RN black hole in a cavity and a Kerr black hole in a cavity. We derive the quasi-local energy from the Hamiltonian, and construct the first law of thermodynamics accordingly. In a canonical ensemble, these black holes could undergo a van der Waals-like phase transition, which is very similar to that in AdS space. We further investigate the black holes' thermodynamic geometry, which is a powerful tool to diagnose microscopic interactions of a thermodynamic system. Our results show that in a cavity, although phase structures of these black holes are similar, their thermodynamic geometry show strong dissimilarities, implying that the microstructure of a black hole is sensitive to its states.

gr-qc↗

Hierarchical Capsule Prediction Network for Marketing Campaigns Effect

Marketing campaigns are a set of strategic activities that can promote a business's goal. The effect prediction for marketing campaigns in a real industrial scenario is very complex and challenging due to the fact that prior knowledge is often learned from observation data, without any intervention for the marketing campaign. Furthermore, each subject is always under the interference of several marketing campaigns simultaneously. Therefore, we cannot easily parse and evaluate the effect of a single marketing campaign. To the best of our knowledge, there are currently no effective methodologies to solve such a problem, i.e., modeling an individual-level prediction task based on a hierarchical structure with multiple intertwined events. In this paper, we provide an in-depth analysis of the underlying parse tree-like structure involved in the effect prediction task and we further establish a Hierarchical Capsule Prediction Network (HapNet) for predicting the effects of marketing campaigns. Extensive results based on both the synthetic data and real data demonstrate the superiority of our model over the state-of-the-art methods and show remarkable practicability in real industrial applications.

stat.ML↗

Thermodynamics and phase transition of BTZ black hole in a cavity

In this paper, we study the thermodynamics and phase transition of a BTZ black hole in a finite space region, namely a cavity. By imposing a temperature-fixed boundary condition on the wall of the cavity and evaluating the Euclidean action, we derive the thermodynamic quantities and then construct the first law of thermodynamics for a static and neutral BTZ black hole, a rotating BTZ black hole and a charged BTZ black hole, respectively. We prove that heat capacities of these three types of black holes are always non-negative. Considering a grand canonical ensemble, we find that the non-extreme rotating black hole and the charged black hole are locally thermodynamically stable by calculating the Hessian matrix of their internal energy. At the phase transition level, it shows that for the static and neutral BTZ black hole, the phase transition only exists between thermal AdS3 spacetime and the black hole. The temperature where the phase transition occurs is only determined by the cavity radius. For rotating and charged cases, there may exist an extra second-order phase transition between the black hole and the black hole-cavity merger state. The phase structure of a BTZ black hole in a cavity shows strong dissimilarities from that without the cavity.

gr-qc↗

Phase Structures and Transitions of Quintessence Surrounding RN Black Holes in a Grand Canonical Ensemble

Considering a grand canonical ensemble, we study the phase structures and transitions of RN black holes surrounded by quintessence dark energy on two different boundary conditions, namely AdS space and a Dirichlet wall. For AdS space, under the condition of fixed temperature and potential, as the temperature increases for lower potential, the black hole undergoes a first-order phase transition, while for higher potential, no phase transition occurs. There are two different regions in the parameter space. For the Dirichlet wall, on which the temperature and potential are fixed and the state parameter of quintessence $ω=-2/3$ is analyzed in detail. Then, three different physically allowed regions in the parameter space of the black hole are well studied. As the temperature rises, a first-order phase transition and a second-order phase transition may occur. In this case, there are nine regions in the parameter space, which is obviously distinct from the case of AdS space.

gr-qc↗

Charged torus-like black holes as heat engines

We investigate the thermodynamical properties of charged torus-like black holes and take it as the working substance to study the heat engines. In the extended phase space, by interpreting the cosmological constant as the thermodynamic pressure, we derive the thermodynamical quantities by the first law of black hole thermodynamics and obtain the equation of state. Then, we calculate the efficiency of the heat engine in Carnot cycle as well as rectangular cycle, and investigate how the efficiency changes with respect to volume. In addition, to avoid a negative temperature, we emphasize that the charge of this black hole can not be arbitrary. Last, we check the calculation accuracy of a benchmark scheme and discuss the upper bound and lower bound for charged torus-like black hole in the scheme.

gr-qc↗