SearcharxivSearch

arXiv subjects

Jean-Pierre Nadal

Publications and source records attributed to Jean-Pierre Nadal.

At least 19 recordsLinked to original sources

Uncovering Social Network Activity Using Joint User and Topic Interaction

The emergence of online social platforms, such as social networks and social media, has drastically affected the way people apprehend the information flows to which they are exposed. In such platforms, various information cascades spreading among users is the main force creating complex dynamics of opinion formation, each user being characterized by their own behavior adoption mechanism. Moreover, the spread of multiple pieces of information or beliefs in a networked population is rarely uncorrelated. In this paper, we introduce the Mixture of Interacting Cascades (MIC), a model of marked multidimensional Hawkes processes with the capacity to model jointly non-trivial interaction between cascades and users. We emphasize on the interplay between information cascades and user activity, and use a mixture of temporal point processes to build a coupled user/cascade point process model. Experiments on synthetic and real data highlight the benefits of this approach and demonstrate that MIC achieves superior performance to existing methods in modeling the spread of information cascades. Finally, we demonstrate how MIC can provide, through its learned parameters, insightful bi-layered visualizations of real social network activity data.

cs.SI

Category learning in deep neural networks: Information content and geometry of internal representations

In humans and other animals, category learning enhances discrimination between stimuli close to the category boundary. This phenomenon, called categorical perception, was also empirically observed in artificial neural networks trained on classification tasks. In previous modeling works based on neuroscience data, we show that this expansion/compression is a necessary outcome of efficient learning. Here we extend our theoretical framework to artificial networks. We show that minimizing the Bayes cost (mean of the cross-entropy loss) implies maximizing the mutual information between the set of categories and the neural activities prior to the decision layer. Considering structured data with an underlying feature space of small dimension, we show that maximizing the mutual information implies (i) finding an appropriate projection space, and, (ii) building a neural representation with the appropriate metric. The latter is based on a Fisher information matrix measuring the sensitivity of the neural activity to changes in the projection space. Optimal learning makes this neural Fisher information follow a category-specific Fisher information, measuring the sensitivity of the category membership. Category learning thus induces an expansion of neural space near decision boundaries. We characterize the properties of the categorical Fisher information, showing that its eigenvectors give the most discriminant directions at each point of the projection space. We find that, unexpectedly, its maxima are in general not exactly at, but near, the class boundaries. Considering toy models and the MNIST dataset, we numerically illustrate how after learning the two Fisher information matrices match, and essentially align with the category boundaries. Finally, we relate our approach to the Information Bottleneck one, and we exhibit a bias-variance decomposition of the Bayes cost, of interest on its own.

cs.LG

From the perceptron to the cerebellum

The perceptron has served as a prototypical neuronal learning machine in the physics community interested in neural networks and artificial intelligence, which included Gérard Toulouse as one of its prominent figures. It has also been used as a model of Purkinje cells of the cerebellum, a brain structure involved in motor learning, in the early influential theories of David Marr and James Albus. We review these theories, more recent developments in the field, and highlight questions of current interest.

q-bio.NC

Information theoretic study of the neural geometry induced by category learning

Categorization is an important topic both for biological and artificial neural networks. Here, we take an information theoretic approach to assess the efficiency of the representations induced by category learning. We show that one can decompose the relevant Bayesian cost into two components, one for the coding part and one for the decoding part. Minimizing the coding cost implies maximizing the mutual information between the set of categories and the neural activities. We analytically show that this mutual information can be written as the sum of two terms that can be interpreted as (i) finding an appropriate representation space, and, (ii) building a representation with the appropriate metrics, based on the neural Fisher information on this space. One main consequence is that category learning induces an expansion of neural space near decision boundaries. Finally, we provide numerical illustrations that show how Fisher information of the coding neural population aligns with the boundaries between categories.

cs.LG

Application of spin glass ideas in social sciences, economics and finance

Classical economics has developed an arsenal of methods, based on the idea of representative agents, to come up with precise numbers for next year's GDP, inflation and exchange rates, among (many) other things. Few, however, will disagree with the fact that the economy is a complex system, with a large number of strongly heterogeneous, interacting units of different types (firms, banks, households, public institutions) and different sizes. Now, the main issue in economics is precisely the emergent organization, cooperation and coordination of such a motley crowd of micro-units. Treating them as a unique ``representative'' firm or household clearly risks throwing the baby with the bathwater. As we have learnt from statistical physics, understanding and characterizing such emergent properties can be difficult. Because of feedback loops of different signs, heterogeneities and non-linearities, the macro-properties are often hard to anticipate. In particular, these situations generically lead to a very large number of possible equilibria, or even the lack thereof. Spin-glasses and other disordered systems give a concrete example of such difficulties. In order to tackle these complex situations, new theoretical and numerical tools have been invented in the last 50 years, including of course the replica method and replica symmetry breaking, and the cavity method, both static and dynamic. In this chapter we review the application of such ideas and methods in economics and social sciences. Of particular interest are the proliferation (and fragility) of equilibria, the analogue of satisfiability phase transitions in games and random economies, and condensation (or concentration) effects in opinion, wealth, etc

physics.soc-ph

Income Inequalities Increase with City Size: Evidence from French Data

We analyse the income distributions of cities in France and the scaling of the income of different deciles as a function of the population. We find a significant difference in the scaling exponents for the richer and poorer parts of the population, implying an unequivocal rise in inequalities in larger cities, made worse by living costs that are disproportionately higher for the poor. We find that the distribution of revenues of cities in France has a universal, Gumbel-like form, with mean and variance growing with the logarithm of population. We show how this result directly implies different income scaling exponents as a function of decile. We also study the spatial correlations of income and population, which decay exponentially with distance. We find that large cities are not more income-segregated than small cities. Finally, we search for couplings between social and economic factors, like age and income, and propose a toy model that reproduces some of our observations.

physics.soc-ph

Categorical Perception: A Groundwork for Deep Learning

A well-known perceptual consequence of categorization in humans and other animals, called categorical perception, is notably characterized by a within-category compression and a between-category separation: two items, close in input space, are perceived closer if they belong to the same category than if they belong to different categories. Elaborating on experimental and theoretical results in cognitive science, here we study categorical effects in artificial neural networks. We combine a theoretical analysis that makes use of mutual and Fisher information quantities, and a series of numerical simulations on networks of increasing complexity. These formal and numerical analyses provide insights into the geometry of the neural representation in deep layers, with expansion of space near category boundaries and contraction far from category boundaries. We investigate categorical representation by using two complementary approaches: one mimics experiments in psychophysics and cognitive neuroscience by means of morphed continua between stimuli of different categories, while the other introduces a categoricality index that, for each layer in the network, quantifies the separability of the categories at the neural population level. We show on both shallow and deep neural networks that category learning automatically induces categorical perception. We further show that the deeper a layer, the stronger the categorical effects. As an outcome of our study, we propose a coherent view of the efficacy of different heuristic practices of the dropout regularization technique. More generally, our view, which finds echoes in the neuroscience literature, insists on the differential impact of noise in any given layer depending on the geometry of the neural representation that is being learned, i.e. on how this geometry reflects the structure of the categories.

cs.LG

Perceptual decision making: Biases in post-error reaction times explained by attractor network dynamics

Perceptual decision making is the subject of many experimental and theoretical studies. Whereas most modeling analysis are based on statistical processes of accumulation of evidence, less attention is being devoted to the modeling with attractor network dynamics, even though they describe well psychophysical and neurophysiological data. In particular, very few works confront attractor models predictions with data from continuous sequences of trials. Recently however, a biophysical competitive attractor network model has been used to describe such sequences of decision trials, and has been shown to reproduce repetition biases observed in perceptual decision experiments. Here we propose an extension of the reduced attractor network model of Wong and Wang (2006) to get more insights into such effects. We make explicit the conditions under which such network can perform a succession of decisions, and show that the model provides a mathematical framework for studying the effects of a trial on the decision made on the next one. We study in details the reaction times properties during a sequence of decision trials, and show that the model reproduces behavioral data, both qualitatively and quantitatively. In particular, we find that the decision made on the current trial is biased toward the one made on the previous trial. More remarkably, we show that, in the absence of any feedback about the correctness of the decision, the network exhibits post-error slowing, a subtle effect in agreement with empirical data.

physics.bio-ph

Epidemiological modeling of the 2005 French riots: a spreading wave and the role of contagion

As a large-scale instance of dramatic collective behaviour, the 2005 French riots started in a poor suburb of Paris, then spread in all of France, lasting about three weeks. Remarkably, although there were no displacements of rioters, the riot activity did travel. Access to daily national police data has allowed us to explore the dynamics of riot propagation. Here we show that an epidemic-like model, with just a few parameters and a single sociological variable characterizing neighbourhood deprivation, accounts quantitatively for the full spatio-temporal dynamics of the riots. This is the first time that such data-driven modelling involving contagion both within and between cities (through geographic proximity or media) at the scale of a country, and on a daily basis, is performed. Moreover, we give a precise mathematical characterization to the expression "wave of riots", and provide a visualization of the propagation around Paris, exhibiting the wave in a way not described before. The remarkable agreement between model and data demonstrates that geographic proximity played a major role in the propagation, even though information was readily available everywhere through media. Finally, we argue that our approach gives a general framework for the modelling of the dynamics of spontaneous collective uprisings.

physics.soc-ph

Frequency patterns of semantic change: Corpus-based evidence of a near-critical dynamics in language change

It is generally believed that, when a linguistic item acquires a new meaning, its overall frequency of use in the language rises with time with an S-shaped growth curve. Yet, this claim has only been supported by a limited number of case studies. In this paper, we provide the first corpus-based quantitative confirmation of the genericity of the S-curve in language change. Moreover, we uncover another generic pattern, a latency phase of variable duration preceding the S-growth, during which the frequency of use of the semantically expanding word remains low and more or less constant. We also propose a usage-based model of language change supported by cognitive considerations, which predicts that both phases, the latency and the fast S-growth, take place. The driving mechanism is a stochastic dynamics, a random walk in the space of frequency of use. The underlying deterministic dynamics highlights the role of a control parameter, the strength of the cognitive impetus governing the onset of change, which tunes the system at the vicinity of a saddle-node bifurcation. In the neighborhood of the critical point, the latency phase corresponds to the diffusion time over the critical region, and the S-growth to the fast convergence that follows. The duration of the two phases is computed as specific first passage times of the random walk process, leading to distributions that fit well the ones extracted from our dataset. We argue that our results are not specific to the studied corpus, but apply to semantic change in general.

physics.soc-ph

A model of riots dynamics: shocks, diffusion and thresholds

We introduce and analyze several variants of a system of differential equations which model the dynamics of social outbursts, such as riots. The systems involve the coupling of an explicit variable representing the intensity of rioting activity and an underlying (implicit) field of social tension. Our models include the effects of exogenous and endogenous factors as well as various propagation mechanisms. From numerical and mathematical analysis of these models we show that the assumptions made on how different locations influence one another and how the tension in the system disperses play a major role on the qualitative behavior of bursts of social unrest. Furthermore, we analyze here various properties of these systems, such as the existence of traveling wave solutions, and formulate some new open mathematical problems which arise from our work.

math.AP

Entanglement between Demand and Supply in Markets with Bandwagon Goods

Whenever customers' choices (e.g. to buy or not a given good) depend on others choices (cases coined 'positive externalities' or 'bandwagon effect' in the economic literature), the demand may be multiply valued: for a same posted price, there is either a small number of buyers, or a large one -- in which case one says that the customers coordinate. This leads to a dilemma for the seller: should he sell at a high price, targeting a small number of buyers, or at low price targeting a large number of buyers? In this paper we show that the interaction between demand and supply is even more complex than expected, leading to what we call the curse of coordination: the pricing strategy for the seller which aimed at maximizing his profit corresponds to posting a price which, not only assumes that the customers will coordinate, but also lies very near the critical price value at which such high demand no more exists. This is obtained by the detailed mathematical analysis of a particular model formally related to the Random Field Ising Model and to a model introduced in social sciences by T C Schelling in the 70's.

q-fin.GN

Modeling urban housing market dynamics: can the socio-spatial segregation preserve some social diversity?

Addressing issues of social diversity, we introduce a model of housing transactions between agents who are heterogeneous in their willingness to pay. A key assumption is that agents' preferences for a location depend on both an intrinsic attractiveness and on the social characteristics of the neighborhood. The stationary space distribution of income is analytically and numerically characterized. The main results are that socio-spatial segregation occurs if -- and only if -- the social influence is strong enough, but even so, some social diversity is preserved at most locations. Comparison with data on the Paris housing market shows that the results reproduce general trends of price distribution and spatial income segregation.

physics.soc-ph

Between order and disorder: a 'weak law' on recent electoral behavior among urban voters?

A new viewpoint on electoral involvement is proposed from the study of the statistics of the proportions of abstentionists, blank and null, and votes according to list of choices, in a large number of national elections in different countries. Considering 11 countries without compulsory voting (Austria, Canada, Czech Republic, France, Germany, Italy, Mexico, Poland, Romania, Spain and Switzerland), a stylized fact emerges for the most populated cities when one computes the entropy associated to the three ratios, which we call the entropy of civic involvement of the electorate. The distribution of this entropy (over all elections and countries) appears to be sharply peaked near a common value. This almost common value is typically shared since the 1970's by electorates of the most populated municipalities, and this despite the wide disparities between voting systems and types of elections. Performing different statistical analyses, we notably show that this stylized fact reveals particular correlations between the blank/null votes and abstentionists ratios. We suggest that the existence of this hidden regularity, which we propose to coin as a `weak law on recent electoral behavior among urban voters', reveals an emerging collective behavioral norm characteristic of urban citizen voting behavior in modern democracies. Analyzing exceptions to the rule provide insights into the conditions under which this normative behavior can be expected to occur.

physics.soc-ph

Perception of categories: from coding efficiency to reaction times

Reaction-times in perceptual tasks are the subject of many experimental and theoretical studies. With the neural decision making process as main focus, most of these works concern discrete (typically binary) choice tasks, implying the identification of the stimulus as an exemplar of a category. Here we address issues specific to the perception of categories (e.g. vowels, familiar faces, ...), making a clear distinction between identifying a category (an element of a discrete set) and estimating a continuous parameter (such as a direction). We exhibit a link between optimal Bayesian decoding and coding efficiency, the latter being measured by the mutual information between the discrete category set and the neural activity. We characterize the properties of the best estimator of the likelihood of the category, when this estimator takes its inputs from a large population of stimulus-specific coding cells. Adopting the diffusion-to-bound approach to model the decisional process, this allows to relate analytically the bias and variance of the diffusion process underlying decision making to macroscopic quantities that are behaviorally measurable. A major consequence is the existence of a quantitative link between reaction times and discrimination accuracy. The resulting analytical expression of mean reaction times during an identification task accounts for empirical facts, both qualitatively (e.g. more time is needed to identify a category from a stimulus at the boundary compared to a stimulus lying within a category), and quantitatively (working on published experimental data on phoneme identification tasks).

q-bio.NC

Disentangling collective trends from local dynamics

A single social phenomenon (such as crime, unemployment or birth rate) can be observed through temporal series corresponding to units at different levels (cities, regions, countries...). Units at a given local level may follow a collective trend imposed by external conditions, but also may display fluctuations of purely local origin. The local behavior is usually computed as the difference between the local data and a global average (e.g. a national average), a view point which can be very misleading. We propose here a method for separating the local dynamics from the global trend in a collection of correlated time series. We take an independent component analysis approach in which we do not assume a small unbiased local contribution in contrast with previously proposed methods. We first test our method on synthetic series generated by correlated random walkers. We then consider crime rate series (in the US and France) and the evolution of obesity rate in the US, which are two important examples of societal measures. For crime rates, the separation between global and local policies is a major subject of debate. For the US, we observe large fluctuations in the transition period of mid-70's during which crime rates increased significantly, whereas since the 80's, the state crime rates are governed by external factors and the importance of local specificities being decreasing. In the case of obesity, our method shows that external factors dominate the evolution of obesity since 2000, and that different states can have different dynamical behavior even if their obesity prevalence is similar.

physics.soc-ph

Phase diagram of a Schelling segregation model

The collective behavior in a variant of Schelling's segregation model is characterized with methods borrowed from statistical physics, in a context where their relevance was not conspicuous. A measure of segregation based on cluster geometry is defined and several quantities analogous to those used to describe physical lattice models at equilibrium are introduced. This physical approach allows to distinguish quantitatively several regimes and to characterize the transitions between them, leading to the building of a phase diagram. Some of the transitions evoke empirical sudden ethnic turnovers. We also establish links with 'spin-1' models in physics. Our approach provides generic tools to analyze the dynamics of other socio-economic systems.

physics.soc-ph

Discrete Choices under Social Influence: Generic Properties

We consider a model of socially interacting individuals that make a binary choice in a context of positive additive endogenous externalities. It encompasses as particular cases several models from the sociology and economics literature. We extend previous results to the case of a general distribution of idiosyncratic preferences, called here Idiosyncratic Willingnesses to Pay (IWP). Positive additive externalities yield a family of inverse demand curves that include the classical downward sloping ones but also new ones with non constant convexity. When j, the ratio of the social influence strength to the standard deviation of the IWP distribution, is small enough, the inverse demand is a classical monotonic (decreasing) function of the adoption rate. Even if the IWP distribution is mono-modal, there is a critical value of j above which the inverse demand is non monotonic, decreasing for small and high adoption rates, but increasing within some intermediate range. Depending on the price there are thus either one or two equilibria. Beyond this first result, we exhibit the generic properties of the boundaries limiting the regions where the system presents different types of equilibria (unique or multiple). These properties are shown to depend only on qualitative features of the IWP distribution: modality (number of maxima), smoothness and type of support (compact or infinite). The main results are summarized as phase diagrams in the space of the model parameters, on which the regions of multiple equilibria are precisely delimited.

physics.soc-ph