SearcharxivSearch

arXiv subjects

Jae Wan Shim

Publications and source records attributed to Jae Wan Shim.

15 recordsLinked to original sources

Gauss--Hermite Quadrature for Gaussian-Mixture Entropy with an Action-Space Hermite Surrogate

Gaussian distributions are used to model uncertainty in signals and states, and Gaussian mixtures are often used when the underlying distribution is multimodal. Unlike a single Gaussian, a Gaussian mixture generally has no closed-form expression for differential entropy and therefore requires numerical approximation. We propose a Gauss--Hermite quadrature method for evaluating Gaussian mixture differential entropy. The quadrature order controls the numerical resolution of the approximation. The method is evaluated on one- and two-dimensional Gaussian mixture benchmarks against Taylor approximations, analytic entropy bounds, and numerical integration references. For repeated optimization over continuous actions, we also propose a Hermite polynomial surrogate in action space. In a radar pointing benchmark, its second-order form achieves substantially lower surrogate error and optimizer regret than a second-order Taylor surrogate based on local derivatives at the nominal action, while both methods use nine direct objective evaluations per replanning step. The Hermite surrogate also improves pointing performance in the tested benchmark.

stat.ML

Parameter-Space Heat Flow, Gaussian Density Ratios, and Sharp Hermite Truncation Rates

We reinterpret the classical Hermite generating function as a Gaussian density ratio: relative to the unit Gaussian reference, it is the density ratio of a Gaussian with shifted mean and unchanged covariance. Applying the heat semigroup in the mean-parameter variable to this generating function produces the corresponding temperature variation. Thus the heat-semigroup time variable is reinterpreted as the temperature variation of the Gaussian density ratio. This parameter-space formulation also gives a parabolic control principle for Hermite approximation errors. Since Hermite projections act in the velocity variable and the heat flow acts in the mean variable, Hermite block energies and truncation tails are subsolutions of the same parameter-space heat equation. This remains useful for heat-evolved non-Gaussian perturbations where no usable closed coefficient formula is available. For Gaussian density ratios with general covariance, the Hermite coefficients satisfy a weighted homogeneity in the mean and covariance-defect parameters. This yields Ornstein--Uhlenbeck covariance, an exact generating function for total-degree Hermite block energies, and the sharp geometric Hermite truncation rate, equal to the square root of the largest absolute covariance defect. We also derive precise isotropic block and tail asymptotics and interpret the estimates for near-Gaussian kinetic distributions.

math.PR

Conductive Heat Flux Driven by a Pressure Gradient in Non-Maxwellian Reference States

Standard Navier--Stokes--Fourier theory and Maxwellian-based Grad 13-moment closures yield no independent pressure-gradient driving of the conductive heat flux in an isothermal, single-component gas in the hydrodynamic (small-Knudsen) regime. This absence is specific to the Maxwellian local-equilibrium weight. We show that when the closure is constructed about a generalized class of isotropic non-Maxwellian reference weights with finite fourth moment -- characterized by a single shape parameter (a kurtosis-like moment ratio) that deforms the distribution continuously away from a Maxwellian -- the small-Knudsen constitutive reduction retains a bulk pressure-gradient (barothermal) contribution to the conductive heat flux. This mechanism predicts pressure-driven conduction as a direct kinetic signature of non-Maxwellian equilibrium moment structure.

math-ph

When Stein-Type Test Detects Equilibrium Distributions of Finite N-Body Systems

Starting from the probability distribution of finite N-body systems, which maximises the Havrda--Charv\'at entropy, we build a Stein-type goodness-of-fit test. The Maxwell--Boltzmann distribution is exact only in the thermodynamic limit, where the system is composed of infinitely many particles as N approaches infinity. For an isolated system with a finite number of particles, the equilibrium velocity distribution is compact and markedly non-Gaussian, being restricted by the fixed total energy. Using Stein's method, we first obtain a differential operator that characterises the target density. Its eigenfunctions are symmetric Jacobi polynomials, whose orthogonality yields a simple, parameter-free statistic. Under the null hypothesis that the data follows the finite-N distribution, the statistic converges to a chi-squared law, so critical values are available in closed form. Large-scale Monte Carlo experiments confirm exact size control and give a clear picture of the power. These findings quantify how quickly a finite system approaches the classical limit and provide a practical tool for testing kinetic models in regimes where normality cannot be assumed.

math-ph

When Normality Tests Detect Equilibrium Distributions of Finite N-Body Systems

The particle number $N$ can be used as a quantitative gauge of non-Gaussianity. This idea extends to systems that are not literally finite by assigning them a notional $N$ that captures the same deviation. For an ideal gas with $N$ insufficiently large for the thermodynamic limit, the velocity distribution that maximises Havrda-Charv\'at entropy departs markedly from the Maxwell--Boltzmann (Gaussian) form obtained in that limit. We explore how five standard normality tests -- Kolmogorov-Smirnov, Anderson-Darling, Cram\'er--von Mises, Jarque-Bera and Shapiro-Wilk -- respond to samples drawn from this finite-$N$ equilibrium distribution. A large-scale Monte Carlo study maps the tests' statistical power across system size $N$ and sample size $n$, providing practical reference tables and a heuristic scaling law, visualised as a contour plot, that together indicate when finite-size effects remain detectable.

cond-mat.stat-mech

Measuring and Analyzing Intelligence via Contextual Uncertainty in Large Language Models using Information-Theoretic Metrics

Large Language Models (LLMs) excel on many task-specific benchmarks, yet the mechanisms that drive this success remain poorly understood. We move from asking what these systems can do to asking how they process information. Our contribution is a task-agnostic method that builds a quantitative Cognitive Profile for any model. The profile is built around the Entropy Decay Curve -- a plot of a model's normalised predictive uncertainty as context length grows. Across several state-of-the-art LLMs and diverse texts, the curves expose distinctive, stable profiles that depend on both model scale and text complexity. We also propose the Information Gain Span (IGS) as a single index that summarises the desirability of a decay pattern. Together, these tools offer a principled way to analyse and compare the internal dynamics of modern AI systems.

cs.AI

Enhancing Cross Entropy with a Linearly Adaptive Loss Function for Optimized Classification Performance

We propose the Linearly Adaptive Cross Entropy Loss function. This is a novel measure derived from the information theory. In comparison to the standard cross entropy loss function, the proposed one has an additional term that depends on the predicted probability of the true class. This feature serves to enhance the optimization process in classification tasks involving one-hot encoded class labels. The proposed one has been evaluated on a ResNet-based model using the CIFAR-100 dataset. Preliminary results show that the proposed one consistently outperforms the standard cross entropy loss function in terms of classification accuracy. Moreover, the proposed one maintains simplicity, achieving practically the same efficiency to the traditional cross entropy loss. These findings suggest that our approach could broaden the scope for future research into loss function design.

cs.LG

A commented translation of Boltzmann's work, "Ueber die sogenannte H-Curve."

Boltzmann's work, ``Ueber die sogenannte H-Curve," discusses his demonstration of the essential characteristics of the H-curve in a clear, concise, and precise style, showcasing his efforts to persuade his peers. To make these findings more widely accessible, the author aims to provide a translated version of the original article, while also correcting some typographical errors in the mathematical expressions with explanatory footnotes. The final section offers concluding remarks with graphs and relevant references for interested readers.

physics.hist-ph

Generalized Entropy Approach for Conserved Systems with Finite vs Infinite Entities: Insights into Non-Gaussian and Non-Chi-Square Distributions using Havrda-Charvát-Tsallis Entropy vs Gaussian Distributions via Boltzmann-Shannon Entropy

We demonstrate that the most probable state of a conserved system with a limited number of entities or molecules is the state where non-Gaussian and non-chi-square distributions govern. We have conducted a thought experiment using a specific setup. We have verified the mathematical derivation of the most probable state accurately predicts the results obtained by computer simulations. The derived distributions approach the Gaussian and the chi-square distributions as the number of entities approaches infinity. The derived distributions of the most probable state will have an important role in the fields of medical research where the number of entities in the system of interest is limited. Especially, the non-chi-square distribution can be interpreted by an asset distribution achieved after a repetitive game where an arbitrary portion of one's assets is transferred to another arbitrary entity among a number of entities with equal abilities.

math-ph

Entropy formula of N-body system

We prove a proposition that the entropy of the system composed of finite $N$ molecules of ideal gas is the $q$-entropy or Havrda-Charvát-Tsallis entropy, which is also known as Tsallis entropy, with the entropic index $q=\frac{D(N-1)-4}{D(N-1)-2}$ in $D$-dimensional space. The indispensable infinity assumption used by Boltzmann and others in their derivation of entropy formulae is not involved in our derivation, therefore our derived formula is exact. The analogy of the $N$-body system brings us to obtain the entropic index of a combined system $q_C$ formed from subsystems having different entropic indexes $q_A$ and $q_B$ as $\frac{1}{1-q_C}=\frac{1}{1-q_A}+\frac{1}{1-q_B}+\frac{D+2}{2}$. It is possible to use the number $N$ for the physical measure of deviation from Boltzmann entropy.

cond-mat.stat-mech

Minimal number of discrete velocities for a flow description and internal structural evolution of a shock wave

A fluid flow is described by fictitious particles hopping on homogeneously distributed nodes with a given finite set of discrete velocities. We emphasize that the existence of a fictitious particle having a discrete velocity among the set in a node is given by a probability. We describe a compressible thermal flow of the level of accuracy of the Navier-Stokes equation by 25 or 33 discrete velocities for two-dimensional space and perform simulations for investigating internal structural evolution of a shock wave.

math-ph

Parametric Lattice Boltzmann Method

The discretized equilibrium distributions of the lattice Boltzmann method are presented by using the coefficients of the Lagrange interpolating polynomials that pass through the points related to discrete velocities and using moments of the Maxwell-Boltzmann distribution. The ranges of flow velocity and temperature providing positive valued distributions vary with regulating discrete velocities as parameters. New isothermal and thermal compressible models are proposed for flows of the level of the isothermal and thermal compressible Navier-Stokes equations. Thermal compressible shock tube flows are simulated by only five on-lattice discrete velocities. Two-dimensional isothermal and thermal vortices provoked by the Kelvin-Helmholtz instability are simulated by the parametric models.

physics.comp-ph

Multidimensional On-lattice Higher-order Models in the Thermal Lattice Boltzmann Theory

We present a set of uniform polynomial equations that provides multidimensional on-lattice higher-order models of the lattice Boltzmann theory, while keeping compact the number of discrete velocities. As examples, we explicitly derive two- and three-dimensional on-lattice models applicable to describing thermal compressible flows of the accuracy levels of the Navier-Stokes equations with smaller numbers of discrete velocities in comparison to the existing models. We demonstrate the accuracy and stability of the three-dimensional model by using the Riemann problem.

math-ph

Univariate Polynomial Equation Providing Models of Thermal Lattice Boltzmann Theory

A univariate polynomial equation is presented. It provides models of the thermal lattice Boltzmann equation. The models can be accurate up to any required level and can be applied to regular lattices, which allow efficient and accurate approximate solutions of the Boltzmann equation. We derive models satisfying the complete Galilean invariant and providing accuracy of the 4th-order moment and beyond. We simulate thermal shock tube problems to illustrate the accuracy of our models and to show the remarkably enhanced stability obtained by our models and our discretized equilibrium distributions.

math-ph