arXiv subjects

Hawoong Jeong

Publications and source records attributed to Hawoong Jeong.

At least 37 records · Page 2Linked to original sources

arXiv2023

Social learning spontaneously emerges by searching optimal heuristics with deep reinforcement learning

How have individuals of social animals in nature evolved to learn from each other, and what would be the optimal strategy for such learning in a specific environment? Here, we address both problems by employing a deep reinforcement learning model to optimize the social learning strategies (SLSs) of agents in a cooperative game in a multi-dimensional landscape. Throughout the training for maximizing the overall payoff, we find that the agent spontaneously learns various concepts of social learning, such as copying, focusing on frequent and well-performing neighbors, self-comparison, and the importance of balancing between individual and social learning, without any explicit guidance or prior knowledge about the system. The SLS from a fully trained agent outperforms all of the traditional, baseline SLSs in terms of mean payoff. We demonstrate the superior performance of the reinforcement learning agent in various environments, including temporally changing environments and real social networks, which also verifies the adaptability of our framework to different social settings.

cs.LG↗

arXiv2022

Learning Heterogeneous Interaction Strengths by Trajectory Prediction with Graph Neural Network

Dynamical systems with interacting agents are universal in nature, commonly modeled by a graph of relationships between their constituents. Recently, various works have been presented to tackle the problem of inferring those relationships from the system trajectories via deep neural networks, but most of the studies assume binary or discrete types of interactions for simplicity. In the real world, the interaction kernels often involve continuous interaction strengths, which cannot be accurately approximated by discrete relations. In this work, we propose the relational attentive inference network (RAIN) to infer continuously weighted interaction graphs without any ground-truth interaction strengths. Our model employs a novel pairwise attention (PA) mechanism to refine the trajectory representations and a graph transformer to extract heterogeneous interaction weights for each pair of agents. We show that our RAIN model with the PA mechanism accurately infers continuous interaction strengths for simulated physical systems in an unsupervised manner. Further, RAIN with PA successfully predicts trajectories from motion capture data with an interpretable interaction graph, demonstrating the virtue of modeling unknown dynamics with continuous weights.

cs.LG↗

arXiv2022

Unexpected advantages of exploitation for target searches in complex networks

Exploitation universally emerges in various decision-making contexts, e.g., animals foraging, web surfing, the evolution of scientists' research topics, and our daily lives. Despite its ubiquity, exploitation, which refers to the behavior of revisiting previous experiences, has often been considered to delay the search process of finding a target. In this paper, we investigate how exploitation affects search performance by applying a non-Markovian random walk model, where a walker randomly revisits a previously visited node using long-term memory. We analytically study two broad forms of network structures, namely (i) clique-like networks and (ii) lollipop-like networks, and find that exploitation can significantly improve search performance in lollipop-like networks whereas it hinders target search in clique-like networks. Moreover, we numerically verify that exploitation can reduce the time needed to fully explore the underlying networks by using $550$ diverse real-world networks. Based on the analytic result, we define the lollipop-likeness of a network and observe a positive relationship between the advantage of exploitation and lollipop-likeness.

cond-mat.stat-mech↗

arXiv2022

Quantifying team chemistry in scientific collaboration

Team chemistry is the holy grail of understanding collaborative human behavior, yet its quantitative understanding remains inconclusive. To reveal the presence and mechanisms of team chemistry in scientific collaboration, we reconstruct the publication histories of 560,689 individual scientists and 1,026,196 duos of scientists. We identify ability discrepancies between teams and their members, enabling us to evaluate team chemistry in a way that is robust against prior experience of collaboration and inherent randomness. Furthermore, our network analysis uncovers a nontrivial modular structure that allows us to predict team chemistry between scientists who have never collaborated before. Research interest is the highest correlated ingredient of team chemistry among six personal characteristics that have been commonly attributed as the keys to successful collaboration, yet the diversity of the characteristics cannot completely explain team chemistry. Our results may lead to unlocking the hidden potential of collaboration by the matching of well-paired scientists.

physics.soc-ph↗

arXiv2021

Estimating entropy production in a stochastic system with odd-parity variables

Entropy production (EP) is a central measure in nonequilibrium thermodynamics, as it can quantify the irreversibility of a process as well as its energy dissipation in special cases. Using the time-reversal asymmetry in a system's path probability distribution, many methods have been developed to estimate EP from only trajectory data. However, estimating the EP of a system with odd-parity variables, which prevails in nonequilibrium systems, has not been covered. In this study, we develop a machine learning method for estimating the EP in a stochastic system with odd-parity variables through multiple neural networks. We demonstrate our method with two systems, an underdamped bead-spring model and a one-particle odd-parity Markov jump process.

cond-mat.stat-mech↗

arXiv2021

Uncovering hidden dependency in weighted networks via information entropy

Interactions between elements, which are usually represented by networks, have to delineate potentially unequal relationships in terms of their relative importance or direction. The intrinsic unequal relationships of such kind, however, are opaque or hidden in numerous real systems. For instance, when a node in a network with limited interaction capacity spends its capacity to its neighboring nodes, the allocation of the total amount of interactions to them can be vastly diverse. Even if such potentially heterogeneous interactions epitomized by weighted networks are observable, as a result of the aforementioned ego-centric allocation of interactions, the relative importance or dependency between two interacting nodes can only be implicitly accessible. In this work, we precisely pinpoint such relative dependency by proposing the framework to discover hidden dependent relations extracted from weighted networks. For a given weighted network, we provide a systematic criterion to select the most essential interactions for individual nodes based on the concept of information entropy. The criterion is symbolized by assigning the effective number of neighbors or the effective out-degree to each node, and the resultant directed subnetwork decodes the hidden dependent relations by leaving only the most essential directed interactions. We apply our methodology to two time-stamped empirical network data, namely the international trade relations between nations in the world trade web (WTW) and the network of people in the historical record of Korea, Annals of the Joseon Dynasty (AJD). Based on the data analysis, we discover that the properties of mutual dependency encoded in the two systems are vastly different.

physics.soc-ph↗

arXiv2021

Discovering conservation laws from trajectories via machine learning

Invariants and conservation laws convey critical information about the underlying dynamics of a system, yet it is generally infeasible to find them from large-scale data without any prior knowledge or human insight. We propose ConservNet to achieve this goal, a neural network that spontaneously discovers a conserved quantity from grouped data where the members of each group share invariants, similar to a general experimental setting where trajectories from different trials are observed. As a neural network trained with a novel and intuitive loss function called noise-variance loss, ConservNet learns the hidden invariants in each group of multi-dimensional observables in a data-driven, end-to-end manner. Our model successfully discovers underlying invariants from the simulated systems having invariants as well as a real-world double pendulum trajectory. Since the model is robust to various noises and data conditions compared to baseline, our approach is directly applicable to experimental data for discovering hidden conservation laws and further, general relationships between variables.

cs.LG↗

arXiv2021

Attaining entropy production and dissipation maps from Brownian movies via neural networks

Quantifying entropy production (EP) is essential to understand stochastic systems at mesoscopic scales, such as living organisms or biological assemblies. However, without tracking the relevant variables, it is challenging to figure out where and to what extent EP occurs from recorded time-series image data from experiments. Here, applying a convolutional neural network (CNN), a powerful tool for image processing, we develop an estimation method for EP through an unsupervised learning algorithm that calculates only from movies. Together with an attention map of the CNN's last layer, our method can not only quantify stochastic EP but also produce the spatiotemporal pattern of the EP (dissipation map). We show that our method accurately measures the EP and creates a dissipation map in two nonequilibrium systems, the bead-spring model and a network of elastic filaments. We further confirm high performance even with noisy, low spatial resolution data, and partially observed situations. Our method will provide a practical way to obtain dissipation maps and ultimately contribute to uncovering the nonequilibrium nature of complex systems.

cond-mat.stat-mech↗

arXiv2021

Inertial effects on the Brownian gyrator

The recent interest into the Brownian gyrator has been confined chiefly to the analysis of Brownian dynamics both in theory and experiment despite the applicability of general cases with definite mass. Considering mass explicitly in the solution of the Fokker--Planck equation and Langevin dynamics simulations, we investigate how inertia can change the dynamics and energetics of the Brownian gyrator. In the Langevin model, the inertia reduces the nonequilibrium effects by diminishing the declination of the probability density function and the mean of a specific angular momentum, $j_θ$, as a measure of rotation. Another unique feature of the Langevin description is that rotation is maximized at a particular anisotropy while the stability of the rotation is minimized at a particular anisotropy or mass. Our results suggest that the Langevin dynamics description of the Brownian gyrator is intrinsically different from that with Brownian dynamics. In addition, $j_θ$ is proven to be essential and convenient for estimating stochastic energetics such as heat currents and entropy production even in the underdamped regime.

cond-mat.stat-mech↗

arXiv2021

Deep reinforcement learning for feedback control in a collective flashing ratchet

A collective flashing ratchet transports Brownian particles using a spatially periodic, asymmetric, and time-dependent on-off switchable potential. The net current of the particles in this system can be substantially increased by feedback control based on the particle positions. Several feedback policies for maximizing the current have been proposed, but optimal policies have not been found for a moderate number of particles. Here, we use deep reinforcement learning (RL) to find optimal policies, with results showing that policies built with a suitable neural network architecture outperform the previous policies. Moreover, even in a time-delayed feedback situation where the on-off switching of the potential is delayed, we demonstrate that the policies provided by deep RL provide higher currents than the previous strategies.

cs.LG↗

arXiv2021

Quantumness and thermodynamic uncertainty relation of finite-time Otto cycle

To reveal the role of the quantumness in the Otto cycle and to discuss the validity of the thermodynamic uncertainty relation (TUR) in the cycle, we study the quantum Otto cycle and its classical counterpart. In particular, we calculate exactly the mean values and relative error of thermodynamic quantities. In the quasistatic limit, quantumness reduces the productivity and precision of the Otto cycle compared to that in the absence of quantumness, whereas in the finite-time mode, it can increase the cycle's productivity and precision. Interestingly, as the strength (heat conductance) between the system and the bath increases, the precision of the quantum Otto cycle overtakes that of the classical one. Testing the conventional TUR of the Otto cycle, in the region where the entropy production is large enough, we find a tighter bound than that of the conventional TUR. However, in the finite-time mode, both quantum and classical Otto cycles violate the conventional TUR in the region where the entropy production is small. This implies that another modified TUR is required to cover the finite-time Otto cycle. Finally, we discuss the possible origin of this violation in terms of the uncertainty products of the thermodynamic quantities and the relative error near resonance conditions.

quant-ph↗

arXiv2020

Deep learning reveals hidden interactions in complex systems

Rich phenomena from complex systems have long intrigued researchers, and yet modeling system micro-dynamics and inferring the forms of interaction remain challenging for conventional data-driven approaches, being generally established by human scientists. In this study, we propose AgentNet, a model-free data-driven framework consisting of deep neural networks to reveal and analyze the hidden interactions in complex systems from observed data alone. AgentNet utilizes a graph attention network with novel variable-wise attention to model the interaction between individual agents, and employs various encoders and decoders that can be selectively applied to any desired system. Our model successfully captured a wide variety of simulated complex systems, namely cellular automata (discrete), the Vicsek model (continuous), and active Ornstein--Uhlenbeck particles (non-Markovian) in which, notably, AgentNet's visualized attention values coincided with the true interaction strength and exhibited collective behavior that was absent in the training data. A demonstration with empirical data from a flock of birds showed that AgentNet could identify hidden interaction ranges exhibited by real birds, which cannot be detected by conventional velocity correlation analysis. We expect our framework to open a novel path to investigating complex systems and to provide insight into general process-driven modeling.

cond-mat.stat-mech↗

arXiv2020

Learning entropy production via neural networks

This Letter presents a neural estimator for entropy production, or NEEP, that estimates entropy production (EP) from trajectories of relevant variables without detailed information on the system dynamics. For steady state, we rigorously prove that the estimator, which can be built up from different choices of deep neural networks, provides stochastic EP by optimizing the objective function proposed here. We verify the NEEP with the stochastic processes of the bead-spring and discrete flashing ratchet models, and also demonstrate that our method is applicable to high-dimensional data and can provide coarse-grained EP for Markov systems with unobservable states.

cond-mat.stat-mech↗

arXiv2020

Explosive Synchronization in Multilayer Dynamically Dissimilar Networks

The phenomenon of explosive synchronization, which originates from hypersensitivity to small perturbation caused by some form of frustration prevailed in various physical and biological systems, has been shown to lead events of cascading failure of the power grid to chronic pain or epileptic seizure in the brain. Furthermore, networks provide a powerful model to understand and predict the properties of a diverse range of real-world complex systems. Recently, a multilayer network has been realized as a better suited framework for the representation of complex systems having multiple types of interactions among the same set of constituents. This article shows that by tuning the properties of one layer (network) of a multilayer network, one can regulate the dynamical behavior of another layer (network). By taking an example of a multiplex network comprising two different types of networked Kuramoto oscillators representing two different layers, this article attempts to provide a glimpse of opportunities and emerging phenomena multiplexing can induce which is otherwise not possible for a network in isolation. Here we consider explosive synchronization to demonstrate the potential of multilayer networks framework. To the end, we discuss several possible extensions of the model considered here by incorporating real-world properties.

nlin.AO↗

arXiv2020

Finite-time quantum Otto engine: Surpassing the quasi-static efficiency due to friction

In finite-time quantum heat engines, some work is consumed to drive a working fluid accompanying coherence, which is called `friction'. To understand the role of friction in quantum thermodynamics, we present a couple of finite-time quantum Otto cycles with two different baths: Agarwal versus Lindbladian. We solve them exactly and compare the performance of the Agarwal engine with that of the Lindbladian engine. In particular, we find remarkable and counterintuitive results that the performance of the Agarwal engine due to friction can be much higher than that in the quasistatic limit with the Otto efficiency, and the power of the Lindbladian engine can be nonzero in the short-time limit. Based on additional numerical calculations of these outcomes, we discuss possible origins of such differences between two engines and reveal them. Our results imply that even with an equilibrium bath, a nonequilibrium working fluid brings on the higher performance than what an equilibrium working fluid does.

cond-mat.stat-mech↗

arXiv2020

Impact of environmental changes on the dynamics of temporal networks

Dynamics of complex social systems has often been described in the framework of temporal networks, where links are considered to exist only at the moment of interaction between nodes. Such interaction patterns are not only driven by internal interaction mechanisms, but also affected by environmental changes. To investigate the impact of the environmental changes on the dynamics of temporal networks, we analyze several face-to-face interaction datasets using the multiscale entropy (MSE) method to find that the observed temporal correlations can be categorized according to the environmental similarity of datasets such as classes and break times in schools. By devising and studying a temporal network model considering a periodically changing environment as well as a preferential activation mechanism, we numerically show that our model could successfully reproduce various empirical results by the MSE method in terms of multiscale temporal correlations. Our results demonstrate that the environmental changes can play an important role in shaping the dynamics of temporal networks when the interactions between nodes are influenced by the environment of the systems.

physics.soc-ph↗

arXiv2019

Impact of temporal connectivity patterns on epidemic process

To provide a comprehensive view for dynamics of and on many real-world temporal networks, we investigate the interplay of temporal connectivity patterns and spreading phenomena, in terms of the susceptible-infected-removed (SIR) model on the modified activity-driven temporal network (ADTN) with memory. In particular, we focus on how the epidemic threshold of the SIR model is affected by the heterogeneity of nodal activities and the memory strength in temporal and static regimes, respectively. While strong ties (memory) between nodes inhibit the spread of epidemic to be localized, the heterogeneity of nodal activities enhances it to be globalized initially. Since the epidemic threshold of the SIR model is very sensitive to the degree distribution of nodes in static networks, we test the SIR model on the modified ADTNs with the possible set of the activity exponents and the memory exponents that generates the same degree distributions in temporal networks. We also discuss the role of spatiotemporal scaling properties of the largest cluster and the maximum degree in the epidemic threshold. It is observed that the presence of highly active nodes enables to trigger the initial spread of epidemic in a short period of time, but it also limits its final spread to the entire network. This implies that there is the trade-off between the spreading time of epidemic and its outbreak size. Finally, we suggest the phase diagram of the SIR model on ADTNs and the optimal condition for the spread of epidemic under the circumstances.

physics.soc-ph↗

arXiv2019

Role of hubs in the synergistic spread of behavior

The spread of behavior in a society has two major features: the synergy of multiple spreaders and the dominance of hubs. While strong synergy is known to induce mixed-order transitions (MOTs) at percolation, the effects of hubs on the phenomena are yet to be clarified. By analytically solving the generalized epidemic process on random scale-free networks with the power-law degree distribution $p_k \sim k^{-α}$, we clarify how the dominance of hubs in social networks affects the conditions for MOTs. Our results show that, for $α< 4$, an abundance of hubs drive MOTs, even if a synergistic spreading event requires an arbitrarily large number of adjacent spreaders. In particular, for $2 < α< 3$, we find that a global cascade is possible even when only synergistic spreading events are allowed. These transition properties are substantially different from those of cooperative contagions, which are another class of synergistic cascading processes exhibiting MOTs.

physics.soc-ph↗