SearcharxivSearch

arXiv subjects

Ravi Srinivasan

Publications and source records attributed to Ravi Srinivasan.

8 recordsLinked to original sources

Built Environment Reasoning from Remote Sensing Imagery Using Large Vision--Language Models

This work investigates the use of large language models (LLMs) for tasks in smart cities. The core idea is to leverage remote sensing imagery to characterize the built environment, including design suggestions, constructability assessment, landuse patterns, and risk identification. We examine remote sensing imagery at multiple spatial scales as inputs for multimodal language modeling and evaluate their effects on built-environment-related reasoning. In addition, we compare state-of-the-art LLMs, including InternVL and Qwen, in terms of accuracy and reliability when generating built environment recommendations. The results demonstrate the potential of integrating remote sensing imagery with large language models to assist smart cities and decision-making.

cs.CL

Improving the Distributional Alignment of LLMs using Supervision

The ability to accurately align LLMs with diverse population groups on subjective questions would have great value. In this work, we show that adding simple supervision can more consistently improve the alignment of LLM-generated distributions with diverse population groups, as measured across three datasets spanning public health, public opinion, and values and beliefs. Beyond evaluating average alignment, we also report how alignment varies across specific groups. Our broad findings provide insights into the distributional alignment of LLM generations with diverse populations. By conducting evaluation over many LLMs and prompting strategies, we provide a benchmark to stimulate future research.

cs.CL

Forward Learning with Top-Down Feedback: Empirical and Analytical Characterization

"Forward-only" algorithms, which train neural networks while avoiding a backward pass, have recently gained attention as a way of solving the biologically unrealistic aspects of backpropagation. Here, we first address compelling challenges related to the "forward-only" rules, which include reducing the performance gap with backpropagation and providing an analytical understanding of their dynamics. To this end, we show that the forward-only algorithm with top-down feedback is well-approximated by an "adaptive-feedback-alignment" algorithm, and we analytically track its performance during learning in a prototype high-dimensional setting. Then, we compare different versions of forward-only algorithms, focusing on the Forward-Forward and PEPITA frameworks, and we show that they share the same learning principles. Overall, our work unveils the connections between three key neuro-inspired learning rules, providing a link between "forward-only" algorithms, i.e., Forward-Forward and PEPITA, and an approximation of backpropagation, i.e., Feedback Alignment.

cs.LG

Safe Imitation Learning via Fast Bayesian Reward Inference from Preferences

Bayesian reward learning from demonstrations enables rigorous safety and uncertainty analysis when performing imitation learning. However, Bayesian reward learning methods are typically computationally intractable for complex control problems. We propose Bayesian Reward Extrapolation (Bayesian REX), a highly efficient Bayesian reward learning algorithm that scales to high-dimensional imitation learning problems by pre-training a low-dimensional feature encoding via self-supervised tasks and then leveraging preferences over demonstrations to perform fast Bayesian inference. Bayesian REX can learn to play Atari games from demonstrations, without access to the game score and can generate 100,000 samples from the posterior over reward functions in only 5 minutes on a personal laptop. Bayesian REX also results in imitation learning performance that is competitive with or better than state-of-the-art methods that only learn point estimates of the reward function. Finally, Bayesian REX enables efficient high-confidence policy evaluation without having access to samples of the reward function. These high-confidence performance bounds can be used to rank the performance and risk of a variety of evaluation policies and provide a way to detect reward hacking behaviors.

cs.LG

Early Detection of Influenza outbreaks in the United States

Public health surveillance systems often fail to detect emerging infectious diseases, particularly in resource limited settings. By integrating relevant clinical and internet-source data, we can close critical gaps in coverage and accelerate outbreak detection. Here, we present a multivariate algorithm that uses freely available online data to provide early warning of emerging influenza epidemics in the US. We evaluated 240 candidate predictors and found that the most predictive combination does \textit{not} include surveillance or electronic health records data, but instead consists of eight Google search and Wikipedia pageview time series reflecting changing levels of interest in influenza-related topics. In cross validation on 2010-2016 data, this algorithm sounds alarms an average of 16.4 weeks prior to influenza activity reaching the Center for Disease Control and Prevention (CDC) threshold for declaring the start of the season. In an out-of-sample test on data from the rapidly-emerging fall wave of the 2009 H1N1 pandemic, it recognized the threat five weeks in advance of this surveillance threshold. Simpler algorithms, including fixed week-of-the-year triggers, lag the optimized alarms by only a few weeks when detecting seasonal influenza, but fail to provide early warning in the 2009 pandemic scenario. This demonstrates a robust method for designing next generation outbreak detection algorithms. By combining scan statistics with machine learning, it identifies tractable combinations of data sources (from among thousands of candidates) that can provide early warning of emerging infectious disease threats worldwide.

stat.AP

An invariant in shock clustering and Burgers turbulence

1-D scalar conservation laws with convex flux and Markov initial data are now known to yield a completely integrable Hamiltonian system. In this article, we rederive the analogue of Loitsiansky's invariant in hydrodynamic turbulence from the perspective of integrable systems. Other relevant physical notions such as energy dissipation and spectrum are also discussed.

nlin.SI

Rates of convergence for Smoluchowski's coagulation equations

We establish nearly optimal rates of convergence to self-similar solutions of Smoluchowski's coagulation equation with kernels $K = 2$, $x + y$, and $xy$. The method is a simple analogue of the Berry-Esséen theorem in classical probability and requires minimal assumptions on the initial data, namely that of an extra finite moment condition. For each kernel it is shown that the convergence rate is achieved in the case of monodisperse initial data.

nlin.AO

Kinetic theory and Lax equations for shock clustering and Burgers turbulence

We study shock statistics in the scalar conservation law $\partial_t u + \partial_x f(u)=0$, $x \in \R$, $t>0$, with a convex flux $f$ and spatially random initial data. We show that the Markov property (in $x$) is preserved for a large class of random initial data (Markov processes with downward jumps and derivatives of Lévy processes with downward jumps). The kinetics of shock clustering is then described completely by an evolution equation for the generator of the Markov process $u(x,t)$, $x\in \R$. We present four distinct derivations for this evolution equation, and show that it takes the form of a Lax pair. The Lax equation admits a spectral parameter as in Manakov (1976), and has remarkable exact solutions for Burgers equation ($f(u)=u^2/2$). This suggests the kinetic equations of shock clustering are completely integrable.

nlin.AO