arXiv subjects

D. Ruggiero Lo Sardo

Publications and source records attributed to D. Ruggiero Lo Sardo.

2 recordsLinked to original sources

arXiv2022

Signal in Noise: Exploring Meaning Encoded in Random Character Sequences with Character-Aware Language Models

Natural language processing models learn word representations based on the distributional hypothesis, which asserts that word context (e.g., co-occurrence) correlates with meaning. We propose that $n$-grams composed of random character sequences, or $garble$, provide a novel context for studying word meaning both within and beyond extant language. In particular, randomly generated character $n$-grams lack meaning but contain primitive information based on the distribution of characters they contain. By studying the embeddings of a large corpus of garble, extant language, and pseudowords using CharacterBERT, we identify an axis in the model's high-dimensional embedding space that separates these classes of $n$-grams. Furthermore, we show that this axis relates to structure within extant language, including word part-of-speech, morphology, and concept concreteness. Thus, in contrast to studies that are mainly limited to extant language, our work reveals that meaning and primitive information are intrinsically linked.

cs.CL↗

arXiv2020

Network Sensitivity of Systemic Risk

A growing body of studies on systemic risk in financial markets has emphasized the key importance of taking into consideration the complex interconnections among financial institutions. Much effort has been put in modeling the contagion dynamics of financial shocks, and to assess the resilience of specific financial markets - either using real network data, reconstruction techniques or simple toy networks. Here we address the more general problem of how shock propagation dynamics depends on the topological details of the underlying network. To this end we consider different realistic network topologies, all consistent with balance sheets information obtained from real data on financial institutions. In particular, we consider networks of varying density and with different block structures, and diversify as well in the details of the shock propagation dynamics. We confirm that the systemic risk properties of a financial network are extremely sensitive to its network features. Our results can aid in the design of regulatory policies to improve the robustness of financial markets.

q-fin.RM↗