arXiv subjects

Kris Sankaran

Publications and source records attributed to Kris Sankaran.

27 records · Page 2Linked to original sources

arXiv2020

HighRes-net: Recursive Fusion for Multi-Frame Super-Resolution of Satellite Imagery

Generative deep learning has sparked a new wave of Super-Resolution (SR) algorithms that enhance single images with impressive aesthetic results, albeit with imaginary details. Multi-frame Super-Resolution (MFSR) offers a more grounded approach to the ill-posed problem, by conditioning on multiple low-resolution views. This is important for satellite monitoring of human impact on the planet -- from deforestation, to human rights violations -- that depend on reliable imagery. To this end, we present HighRes-net, the first deep learning approach to MFSR that learns its sub-tasks in an end-to-end fashion: (i) co-registration, (ii) fusion, (iii) up-sampling, and (iv) registration-at-the-loss. Co-registration of low-resolution views is learned implicitly through a reference-frame channel, with no explicit registration mechanism. We learn a global fusion operator that is applied recursively on an arbitrary number of low-resolution pairs. We introduce a registered loss, by learning to align the SR output to a ground-truth through ShiftNet. We show that by learning deep representations of multiple views, we can super-resolve low-resolution signals and enhance Earth Observation data at scale. Our approach recently topped the European Space Agency's MFSR competition on real-world satellite imagery.

cs.CV↗

arXiv2019

Applying Knowledge Transfer for Water Body Segmentation in Peru

In this work, we present the application of convolutional neural networks for segmenting water bodies in satellite images. We first use a variant of the U-Net model to segment rivers and lakes from very high-resolution images from Peru. To circumvent the issue of scarce labelled data, we investigate the applicability of a knowledge transfer-based model that learns the mapping from high-resolution labelled images and combines it with the very high-resolution mapping so that better segmentation can be achieved. We train this model in a single process, end-to-end. Our preliminary results show that adding the information from the available high-resolution images does not help out-of-the-box, and in fact worsen results. This leads us to infer that the high-resolution data could be from a different distribution, and its addition leads to increased variance in our results.

eess.IV↗

arXiv2019

Tackling Climate Change with Machine Learning

Climate change is one of the greatest challenges facing humanity, and we, as machine learning experts, may wonder how we can help. Here we describe how machine learning can be a powerful tool in reducing greenhouse gas emissions and helping society adapt to a changing climate. From smart grids to disaster management, we identify high impact problems where existing gaps can be filled by machine learning, in collaboration with other fields. Our recommendations encompass exciting research questions as well as promising business opportunities. We call on the machine learning community to join the global effort against climate change.

cs.CY↗

arXiv2019

Hierarchical Importance Weighted Autoencoders

Importance weighted variational inference (Burda et al., 2015) uses multiple i.i.d. samples to have a tighter variational lower bound. We believe a joint proposal has the potential of reducing the number of redundant samples, and introduce a hierarchical structure to induce correlation. The hope is that the proposals would coordinate to make up for the error made by one another to reduce the variance of the importance estimator. Theoretically, we analyze the condition under which convergence of the estimator variance can be connected to convergence of the lower bound. Empirically, we confirm that maximization of the lower bound does implicitly minimize variance. Further analysis shows that this is a result of negative correlation induced by the proposed hierarchical meta sampling scheme, and performance of inference also improves when the number of samples increases.

cs.LG↗

arXiv2019

Visualizing the Consequences of Climate Change Using Cycle-Consistent Adversarial Networks

We present a project that aims to generate images that depict accurate, vivid, and personalized outcomes of climate change using Cycle-Consistent Adversarial Networks (CycleGANs). By training our CycleGAN model on street-view images of houses before and after extreme weather events (e.g. floods, forest fires, etc.), we learn a mapping that can then be applied to images of locations that have not yet experienced these events. This visual transformation is paired with climate model predictions to assess likelihood and type of climate-related events in the long term (50 years) in order to bring the future closer in the viewers mind. The eventual goal of our project is to enable individuals to make more informed choices about their climate future by creating a more visceral understanding of the effects of climate change, while maintaining scientific credibility by drawing on climate model projections.

cs.CV↗

arXiv2017

Inference of Dynamic Regimes in the Microbiome

Many studies have been performed to characterize the dynamics and stability of the microbiome across a range of environmental contexts [Costello et al., 2012, Faust et al., 2015]. For example, it is often of interest to identify time intervals within which certain subsets of taxa have an interesting pattern of behavior. Viewed abstractly, these problems often have a flavor not just of time series modeling but also of regime detection, a problem with a rich history across a variety of applications, including speech recognition [Fox et al., 2011], finance [Lee, 2009], EEG analysis [Camilleri et al., 2014], and geophysics [Weatherley and Mora, 2002]. In spite of the parallels, regime detection methods are rarely used in microbiome analysis, most likely due to the fact that references for these methods are scattered across several literatures, descriptions are inaccessible outside limited research communities, and implementations are difficult to come across. We distill the core ideas of different regime detection methods, provide example applications, and share reproducible code, making these techniques more accessible to microbiome researchers. We re-analyze data of Dethlefsen and Relman [2011], a study of the effects of antibiotics on the microbiome, using Classification and Regression Trees (CART) [Breiman et al., 1984], Hidden Markov Models (HMMs) [Rabiner and Juang, 1986], Bayesian nonparametric HMMs [Teh and Jordan, 2010, Fox et al., 2008], mixtures of Gaussian Processes (GPs) [Rasmussen and Ghahramani, 2002], switching dynamical systems [Linderman et al., 2016], and multiple changepoint detection [Fan and Mackey, 2015]. Along the way, we summarize each method, their relevance to the microbiome, and tradeoffs associated with using them. Ultimately, our goal is to describe types of temporal or regime switching structure that can be incorporated into studies of microbiome dynamics.

stat.AP↗

arXiv2017

Latent Variable Modeling for the Microbiome

The human microbiome is a complex ecological system, and describing its structure and function under different environmental conditions is important from both basic scientific and medical perspectives. Viewed through a biostatistical lens, many microbiome analysis goals can be formulated as latent variable modeling problems. However, although probabilistic latent variable models are a cornerstone of modern unsupervised learning, they are rarely applied in the context of microbiome data analysis, in spite of the evolutionary, temporal, and count structure that could be directly incorporated through such models. We explore the application of probabilistic latent variable models to microbiome data, with a focus on Latent Dirichlet Allocation, Nonnegative Matrix Factorization, and Dynamic Unigram models. To develop guidelines for when different methods are appropriate, we perform a simulation study. We further illustrate and compare these techniques using the data of [10], a study on the effects of antibiotics on bacterial community composition. Code and data for all simulations and case studies are available publicly.

stat.AP↗

arXiv2017

Applying Machine Learning Methods to Enhance the Distribution of Social Services in Mexico

The Government of Mexico's social development agency, SEDESOL, is responsible for the administration of social services and has the mission of lifting Mexican families out of poverty. One key challenge they face is matching people who have social service needs with the services SEDESOL can provide accurately and efficiently. In this work we describe two specific applications implemented in collaboration with SEDESOL to enhance their distribution of social services. The first problem relates to systematic underreporting on applications for social services, which makes it difficult to identify where to prioritize outreach. Responding that five people reside in a home when only three do is a type of underreporting that could occur while a social worker conducts a home survey with a family to determine their eligibility for services. The second involves approximating multidimensional poverty profiles across households. That is, can we characterize different types of vulnerabilities -- for example, food insecurity and lack of health services -- faced by those in poverty? We detail the problem context, available data, our machine learning formulation, experimental results, and effective feature sets. As far as we are aware this is the first time government data of this scale has been used to combat poverty within Mexico. We found that survey data alone can suggest potential underreporting. Further, we found geographic features useful for housing and service related indicators and transactional data informative for other dimensions of poverty. The results from our machine learning system for estimating poverty profiles will directly help better match 7.4 million individuals to social programs.

stat.AP↗

arXiv2016

Opioid Atlas: Mapping Access to Pain Medication

Opiates are some of the most effective pain relief medications available for patients suffering from cancer and surgery-related pain. Despite the affordability and effectiveness of these medications, access to opiates is highly geographically variable. Pain researchers have attributed geographic variation to various factors including the fear of opioid addiction, diversion of legal opiods to the underground market and pharmaceutical industry influences. However, the extent to which there is inequity in untreated cancer and surgery-related pain is unknown. To help opioid investigators study these questions, we designed a tool, the Opioid Atlas, for exploring data on legal opioid consumption, by country and time, collected by the International Narcotics Control Board. Our design borrows ideas from the data visualization and multivariate statistics communities, especially the principles of linking and dimensionality reduction. Our work is relevant to policymakers and pain researchers who wish to systematically assess country-level factors that contribute to differences in opioid access for patients with cancer and surgery-related pain. The Opioid Atlas, and the code behind it, is freely available with an open source license.

stat.AP↗