arXiv · 2107.12848
The Rising Entropy of English in the Attention Economy
Abstract
We present evidence that the word entropy of American English has been rising steadily since around 1900, contrary to predictions from existing sociolinguistic theories. We also find differences in word entropy between media categories, with short-form media such as news and magazines having higher entropy than long-form media, and social media feeds having higher entropy still. To explain these results we develop an ecological model of the attention economy that combines ideas from Zipf's law and information foraging. In this model, media consumers maximize information utility rate taking into account the costs of information search, while media producers adapt to technologies that reduce search costs, driving them to generate higher entropy content in increasingly shorter formats.
Explore related subjects
Keep this discovery
Charlie Pilgrim, Weisi Guo, Thomas T. Hills. 2021-07-27. The Rising Entropy of English in the Attention Economy. https://arxiv.org/abs/2107.12848
Cite the original work for its findings. Save a collection to share your selection of sources.