arXiv subjects

Sujay Bhatt

Publications and source records attributed to Sujay Bhatt.

24 records · Page 2Linked to original sources

arXiv2018

Adaptive Polling in Hierarchical Social Networks using Blackwell Dominance

Consider a population of individuals that observe an underlying state of nature that evolves over time. The population is classified into different levels depending on the hierarchical influence that dictates how the individuals at each level form an opinion on the state. The population is sampled sequentially by a pollster and the nodes (or individuals) respond to the questions asked by the pollster. This paper considers the following problem: How should the pollster poll the hierarchical social network to estimate the state while minimizing the polling cost (measurement cost and uncertainty in the Bayesian state estimate)? This paper proposes adaptive versions of the following polling methods: Intent Polling, Expectation Polling, and the recently proposed Neighbourhood Expectation Polling to account for the time varying state of nature and the hierarchical influence in social networks. The adaptive polling problem in a hierarchical social network is formulated as a partially observed Markov decision process (POMDP). Our main results exploit the structure of the polling problem, and determine novel conditions for Blackwell dominance to construct myopic policies that provably upper bound the optimal policy of the adaptive polling POMDP. The LeCam deficiency is used to determine approximate Blackwell dominance for general polling problems. These Blackwell dominance conditions also facilitate the comparison of Renyi Divergence and Shannon capacity of more general channel structures that arise in hierarchical social networks. Numerical examples are provided to illustrate the adaptive polling policies with parameters estimated from YouTube data.

cs.SI↗

arXiv2017

Controlled Information Fusion with Risk-Averse CVaR Social Sensors

Consider a multi-agent network comprised of risk averse social sensors and a controller that jointly seek to estimate an unknown state of nature, given noisy measurements. The network of social sensors perform Bayesian social learning - each sensor fuses the information revealed by previous social sensors along with its private valuation using Bayes' rule - to optimize a local cost function. The controller sequentially modifies the cost function of the sensors by discriminatory pricing (control inputs) to realize long term global objectives. We formulate the stochastic control problem faced by the controller as a Partially Observed Markov Decision Process (POMDP) and derive structural results for the optimal control policy as a function of the risk-aversion factor in the Conditional Value-at-Risk (CVaR) cost function of the sensors. We show that the optimal price sequence when the sensors are risk- averse is a super-martingale; i.e, it decreases on average over time.

math.OC↗

arXiv2017

Multiple Stopping Time POMDPs: Structural Results & Application in Interactive Advertising in Social Media

This paper considers a multiple stopping time problem for a Markov chain observed in noise, where a decision maker chooses at most L stopping times to maximize a cumulative objective. We formulate the problem as a Partially Observed Markov Decision Process (POMDP) and derive structural results for the optimal multiple stopping policy. The main results are as follows: i) The optimal multiple stopping policy is shown to be characterized by threshold curves in the unit simplex of Bayesian Posteriors. ii) The stopping setsl (defined by the threshold curves) are shown to exhibit a nested structure. iii) The optimal cumulative reward is shown to be monotone with respect to the copositive ordering of the transition matrix. iv) A stochastic gradient algorithm is provided for estimating linear threshold policies by exploiting the structural results. These linear threshold policies approximate the threshold curves, and share the monotone structure of the optimal multiple stopping policy. As an illustrative example, we apply the multiple stopping framework to interactively schedule advertisements in live online social media. It is shown that advertisement scheduling using multiple stopping performs significantly better than currently used methods.

eess.SY↗

arXiv2016

Opportunistic Advertisement Scheduling in Live Social Media: A Multiple Stopping Time POMDP Approach

Live online social broadcasting services like YouTube Live and Twitch have steadily gained popularity due to improved bandwidth, ease of generating content and the ability to earn revenue on the generated content. In contrast to traditional cable television, revenue in online services is generated solely through advertisements, and depends on the number of clicks generated. Channel owners aim to opportunistically schedule advertisements so as to generate maximum revenue. This paper considers the problem of optimal scheduling of advertisements in live online social media. The problem is formulated as a multiple stopping problem and is addressed in a partially observed Markov decision process (POMDP) framework. Structural results are provided on the optimal advertisement scheduling policy. By exploiting the structure of the optimal policy, best linear thresholds are computed using stochastic approximation. The proposed model and framework are validated on real datasets, and the following observations are made: (i) The policy obtained by the multiple stopping problem can be used to detect changes in ground truth from online search data (ii) Numerical results show a significant improvement in the expected revenue by opportunistically scheduling the advertisements. The revenue can be improved by $20-30\%$ in comparison to currently employed periodic scheduling.

cs.SI↗

arXiv2016

Tracking Infection Diffusion in Social Networks: Filtering Algorithms and Threshold Bounds

This paper deals with the statistical signal pro- cessing over graphs for tracking infection diffusion in social networks. Infection (or Information) diffusion is modeled using the Susceptible-Infected-Susceptible (SIS) model. Mean field approximation is employed to approximate the discrete valued infected degree distribution evolution by a deterministic ordinary differential equation for obtaining a generative model for the infection diffusion. The infected degree distribution is shown to follow polynomial dynamics and is estimated using an exact non- linear Bayesian filter. We compute posterior Cramer-Rao bounds to obtain the fundamental limits of the filter which depend on the structure of the network. Considering the time-varying nature of the real world networks, the relationship between the diffusion thresholds and the degree distribution is investigated using generative models for real world networks. In addition, we validate the efficacy of our method with the diffusion data from a real-world online social system, Twitter. We find that SIS model is a good fit for the information diffusion and the non-linear filter effectively tracks the information diffusion.

cs.SI↗

arXiv2015

Sequential Detection of Market shocks using Risk-averse Agent Based Models

This paper considers a statistical signal processing problem involving agent based models of financial markets which at a micro-level are driven by socially aware and risk- averse trading agents. These agents trade (buy or sell) stocks by exploiting information about the decisions of previous agents (social learning) via an order book in addition to a private (noisy) signal they receive on the value of the stock. We are interested in the following: (1) Modelling the dynamics of these risk averse agents, (2) Sequential detection of a market shock based on the behaviour of these agents. Structural results which characterize social learning under a risk measure, CVaR (Conditional Value-at-risk), are presented and formulation of the Bayesian change point detection problem is provided. The structural results exhibit two interesting prop- erties: (i) Risk averse agents herd more often than risk neutral agents (ii) The stopping set in the sequential detection problem is non-convex. The framework is validated on data from the Yahoo! Tech Buzz game dataset.

math.OC↗