Ziv Epstein — Page 2

arXiv2019

Towards a new social laboratory: An experimental study of search through community participation at Burning Man

The "small world phenomenon," popularized by Stanley Milgram, suggests that individuals from across a social network are connected via a short path of mutual friends and can leverage their local social information to efficiently traverse that network. Existing social search experiments are plagued by high rates of attrition, which prohibit comprehensive study of social search. We investigate this by conducting a small world experiment at Burning Man, an event located in the Black Rock Desert of Nevada, USA, known its unique social systems and community participation. We design location-tracking vessels that we routed through Burning Man towards the goal of finding a particular person. Along the way, the vessels logged individual information and GPS data. Two of fifteen vessels made it to their designated people, but a month after Burning Man. Our results suggest possible improvements to limit rates of attrition through community participation and a design methodology that emphasizes cultural practices to aid social experimentation.

cs.SI↗

arXiv2018

Closing the AI Knowledge Gap

AI researchers employ not only the scientific method, but also methodology from mathematics and engineering. However, the use of the scientific method - specifically hypothesis testing - in AI is typically conducted in service of engineering objectives. Growing interest in topics such as fairness and algorithmic bias show that engineering-focused questions only comprise a subset of the important questions about AI systems. This results in the AI Knowledge Gap: the number of unique AI systems grows faster than the number of studies that characterize these systems' behavior. To close this gap, we argue that the study of AI could benefit from the greater inclusion of researchers who are well positioned to formulate and test hypotheses about the behavior of AI systems. We examine the barriers preventing social and behavioral scientists from conducting such studies. Our diagnosis suggests that accelerating the scientific study of AI systems requires new incentives for academia and industry, mediated by new tools and institutions. To address these needs, we propose a two-sided marketplace called TuringBox. On one side, AI contributors upload existing and novel algorithms to be studied scientifically by others. On the other side, AI examiners develop and post machine intelligence tasks designed to evaluate and characterize algorithmic behavior. We discuss this market's potential to democratize the scientific study of AI behavior, and thus narrow the AI Knowledge Gap.

cs.CY↗