arXiv subjects

Jinho Kang

Publications and source records attributed to Jinho Kang.

3 recordsLinked to original sources

arXiv2024

A Theory of Machine Learning

We critically review three major theories of machine learning and provide a new theory according to which machines learn a function when the machines successfully compute it. We show that this theory challenges common assumptions in the statistical and the computational learning theories, for it implies that learning true probabilities is equivalent neither to obtaining a correct calculation of the true probabilities nor to obtaining an almost-sure convergence to them. We also briefly discuss some case studies from natural language processing and macroeconomics from the perspective of the new theory.

cs.LG↗

arXiv2024

Flat Posterior Does Matter For Bayesian Model Averaging

Bayesian neural networks (BNNs) estimate the posterior distribution of model parameters and utilize posterior samples for Bayesian Model Averaging (BMA) in prediction. However, despite the crucial role of flatness in the loss landscape in improving the generalization of neural networks, its impact on BMA has been largely overlooked. In this work, we explore how posterior flatness influences BMA generalization and empirically demonstrate that (1) most approximate Bayesian inference methods fail to yield a flat posterior and (2) BMA predictions, without considering posterior flatness, are less effective at improving generalization. To address this, we propose Flat Posterior-aware Bayesian Model Averaging (FP-BMA), a novel training objective that explicitly encourages flat posteriors in a principled Bayesian manner. We also introduce a Flat Posterior-aware Bayesian Transfer Learning scheme that enhances generalization in downstream tasks. Empirically, we show that FP-BMA successfully captures flat posteriors, improving generalization performance.

stat.ML↗

arXiv2013

Frequency comb-based microwave transfer over fiber with $7 \times 10^{-19}$ instability using fiber-loop optical-microwave phase detectors

We demonstrate a remote microwave/radio-frequency (RF) transfer technique based on the stabilization of a fiber link using a fiber-loop optical-microwave phase detector (FLOM-PD). This method compensates for the excess phase fluctuations introduced in fiber transfer by direct phase comparison between the optical pulse train reflected from the remote site and the local microwave/RF signal using the FLOM-PD. This enables sub-fs resolution and long-term stable link stabilization while having wide timing detection range and less demand in fiber dispersion compensation. The demonstrated relative frequency instability between 2.856-GHz RF oscillators separated by a 2.3-km fiber link is $7.6 \times 10^{-18}$ and $6.5 \times 10^{-19}$ at 1000 s and 82500 s averaging time, respectively.

physics.optics↗