SearcharxivSearch

arXiv subjects

Eunjung Lee

Publications and source records attributed to Eunjung Lee.

7 recordsLinked to original sources

A new strategy for physics-informed neural networks based on hierarchical collocation point refinement

Physics-informed neural networks (PINNs) offer a flexible framework for solving partial differential equations (PDEs), but training can become computationally expensive when a large number of collocation points are required to accurately enforce the governing equations. To alleviate this cost, we introduce multigrid-based parameter-updated PINNs (MPU-PINNs), a coarse-to-fine training strategy that progressively increases the number of training points throughout the learning process. The proposed approach begins by training a neural network on a coarse set of collocation points and then transfers the learned parameters to successively finer levels. This initialization strategy enables the network to capture the global features of the solution at a relatively low computational cost before refining local details with additional training points. To further improve performance for high-frequency problems, we incorporate a scaling technique that mitigates the effects of spectral bias during training. We evaluate MPU-PINNs on several benchmark PDEs, including two- and three-dimensional Poisson equations, a convection-diffusion-reaction equation, and the Helmholtz equation. Numerical experiments indicate that MPU-PINNs greatly reduce training time while achieving accuracy comparable to that of conventional PINNs and other representative variants such as SA-PINNs and XPINNs. The results further suggest that the proposed coarse-to-fine learning strategy substantially decreases the optimization effort required at finer levels. Overall, MPU-PINNs provide an efficient single-network training framework that enhances the computational efficiency and scalability of PINNs for a broad range of PDE problems.

math.NA

Systematic bias due to eccentricity in parameter estimation for merging binary neutron stars : Spinning case

In our previous work [Phys. Rev. D {\bf 105}. 124022 (2022)], we studied the impact of eccentricity on gravitational-wave parameter estimation for a nonspinning binary neutron star (BNS) system. We here extend the work to a more realistic case by including the spin parameter in the system. As in the previous work, we employ the analytic Fisher-Cutler-Vallisneri method to calculate the systematic bias that can be produced by using noneccentric waveforms in parameter estimation, and we verify the reliability of the method by comparing it with numerical Bayesian parameter estimation results. We generate $10^4$ BNS sources randomly distributed in the parameter space $m_1$-$m_2$-$χ_{\rm eff}$-$e_0$, where the neutron star mass is in the range of $1 M_\odot \leq m_{1,2}\leq 2M_\odot (m_2 \leq m_1)$, the effective spin is $-0.2 \leq χ_{\rm eff} \leq0 .2$, and the eccentricity (at the reference frequency 10 Hz) is $0 \leq e_0 \leq 0.024$. For the true value of the tidal deformability ($λ$) of neutron stars, we assume the equation of state model APR4. For all gravitational-wave signals emitted from the sources, we calculate the systematic biases ($Δθ$) for the chirp mass ($M_c$), symmetric mass ratio ($η$), effective spin ($χ_{\rm eff}$), and effective tidal deformability ($\tildeλ$), and obtain generalized distributions of the biases. The distribution of biases in $M_c, η$, and $χ_{\rm eff}$ shows narrow bands that increase or decrease quadratically with increasing $e_0$, indicating a weak dependence of biases on the three parameters. On the other hand, the biases of $\tildeλ$ are widely distributed depending on the values of the mass and spin parameters at a given $e_0$. We investigate the implications of biased parameters for the inference of neutron star properties by performing Bayesian parameter estimation for specific cases.

gr-qc

Enhancing Contrastive Learning with Efficient Combinatorial Positive Pairing

In the past few years, contrastive learning has played a central role for the success of visual unsupervised representation learning. Around the same time, high-performance non-contrastive learning methods have been developed as well. While most of the works utilize only two views, we carefully review the existing multi-view methods and propose a general multi-view strategy that can improve learning speed and performance of any contrastive or non-contrastive method. We first analyze CMC's full-graph paradigm and empirically show that the learning speed of $K$-views can be increased by $_{K}\mathrm{C}_{2}$ times for small learning rate and early training. Then, we upgrade CMC's full-graph by mixing views created by a crop-only augmentation, adopting small-size views as in SwAV multi-crop, and modifying the negative sampling. The resulting multi-view strategy is called ECPP (Efficient Combinatorial Positive Pairing). We investigate the effectiveness of ECPP by applying it to SimCLR and assessing the linear evaluation performance for CIFAR-10 and ImageNet-100. For each benchmark, we achieve a state-of-the-art performance. In case of ImageNet-100, ECPP boosted SimCLR outperforms supervised learning.

cs.CV

AID-Purifier: A Light Auxiliary Network for Boosting Adversarial Defense

We propose an AID-purifier that can boost the robustness of adversarially-trained networks by purifying their inputs. AID-purifier is an auxiliary network that works as an add-on to an already trained main classifier. To keep it computationally light, it is trained as a discriminator with a binary cross-entropy loss. To obtain additionally useful information from the adversarial examples, the architecture design is closely related to information maximization principles where two layers of the main classification network are piped to the auxiliary network. To assist the iterative optimization procedure of purification, the auxiliary network is trained with AVmixup. AID-purifier can be used together with other purifiers such as PixelDefend for an extra enhancement. The overall results indicate that the best performing adversarially-trained networks can be enhanced by the best performing purification networks, where AID-purifier is a competitive candidate that is light and robust.

cs.LG

DEEP-BO for Hyperparameter Optimization of Deep Networks

The performance of deep neural networks (DNN) is very sensitive to the particular choice of hyper-parameters. To make it worse, the shape of the learning curve can be significantly affected when a technique like batchnorm is used. As a result, hyperparameter optimization of deep networks can be much more challenging than traditional machine learning models. In this work, we start from well known Bayesian Optimization solutions and provide enhancement strategies specifically designed for hyperparameter optimization of deep networks. The resulting algorithm is named as DEEP-BO (Diversified, Early-termination-Enabled, and Parallel Bayesian Optimization). When evaluated over six DNN benchmarks, DEEP-BO easily outperforms or shows comparable performance with some of the well-known solutions including GP-Hedge, Hyperband, BOHB, Median Stopping Rule, and Learning Curve Extrapolation. The code used is made publicly available at https://github.com/snu-adsl/DEEP-BO.

cs.LG

Combining frequency-difference and ultrasound modulated electrical impedance tomography

Electrical impedance tomography (EIT) is highly affected by modeling errors regarding electrode positions and the shape of the imaging domain. In this work, we propose a new inclusion detection technique that is completely independent of such errors. Our new approach is based on a combination of frequency-difference and ultrasound modulated EIT measurements.

math.AP

Mathematical modeling of mechanical vibration assisted conductivity imaging

This paper aims at mathematically modeling a new multi-physics conductivity imaging system incorporating mechanical vibrations simultaneously applied to an imaging object together with current injections. We perturb the internal conductivity distribution by applying time-harmonic mechanical vibrations on the boundary. This enhances the effects of any conductivity discontinuity on the induced internal current density distribution. Unlike other conductivity contrast enhancing frameworks, it does not require a prior knowledge of a reference data. In this paper, we provide a mathematical framework for this novel imaging modality. As an application of the vibration-assisted impedance imaging framework, we propose a new breast image reconstruction method in electrical impedance tomography (EIT). As its another application, we investigate a conductivity anomaly detection problem and provide an efficient location search algorithm. We show both analytically and numerically that the applied mechanical vibration increases the data sensitivity to the conductivity contrast and enhances the quality of reconstructed images and anomaly detection results. For numerous applications in impedance imaging, the proposed multi-physics method opens a new difference imaging area called the vibration-difference imaging, which can augment the time-difference and also frequency-difference imaging methods for sensitivity improvements.

physics.med-ph