Searcharxiv⌕ Search

arXiv subjects

Alexander Lavin

Publications and source records attributed to Alexander Lavin.

28 records · Page 2Linked to original sources

Manifolds for Unsupervised Visual Anomaly Detection

Anomalies are by definition rare, thus labeled examples are very limited or nonexistent, and likely do not cover unforeseen scenarios. Unsupervised learning methods that don't necessarily encounter anomalies in training would be immensely useful. Generative vision models can be useful in this regard but do not sufficiently represent normal and abnormal data distributions. To this end, we propose constant curvature manifolds for embedding data distributions in unsupervised visual anomaly detection. Through theoretical and empirical explorations of manifold shapes, we develop a novel hyperspherical Variational Auto-Encoder (VAE) via stereographic projections with a gyroplane layer - a complete equivalent to the Poincaré VAE. This approach with manifold projections is beneficial in terms of model generalization and can yield more interpretable representations. We present state-of-the-art results on visual anomaly benchmarks in precision manufacturing and inspection, demonstrating real-world utility in industrial AI scenarios. We further demonstrate the approach on the challenging problem of histopathology: our unsupervised approach effectively detects cancerous brain tissue from noisy whole-slide images, learning a smooth, latent organization of tissue types that provides an interpretable decisions tool for medical professionals.

cs.CV↗

Fine-Grain Few-Shot Vision via Domain Knowledge as Hyperspherical Priors

Prototypical networks have been shown to perform well at few-shot learning tasks in computer vision. Yet these networks struggle when classes are very similar to each other (fine-grain classification) and currently have no way of taking into account prior knowledge (through the use of tabular data). Using a spherical latent space to encode prototypes, we can achieve few-shot fine-grain classification by maximally separating the classes while incorporating domain knowledge as informative priors. We describe how to construct a hypersphere of prototypes that embed a-priori domain information, and demonstrate the effectiveness of the approach on challenging benchmark datasets for fine-grain classification, with top results for one-shot classification and 5x speedups in training time.

cs.CV↗

Doubly Bayesian Optimization

Probabilistic programming systems enable users to encode model structure and naturally reason about uncertainties, which can be leveraged towards improved Bayesian optimization (BO) methods. Here we present a probabilistic program embedding of BO that is capable of addressing main issues such as problematic domains (noisy, non-smooth, high-dimensional) and the neglected inner-optimization. Not only can we utilize programmable structure to incorporate domain knowledge to aid optimization, but dealing with uncertainties and implementing advanced BO techniques become trivial, crucial for use in practice (particularly for non-experts). We demonstrate the efficacy of the approach on optimization benchmarks and a real-world drug development scenario.

cs.AI↗

Cortical Microcircuits from a Generative Vision Model

Understanding the information processing roles of cortical circuits is an outstanding problem in neuroscience and artificial intelligence. The theoretical setting of Bayesian inference has been suggested as a framework for understanding cortical computation. Based on a recently published generative model for visual inference (George et al., 2017), we derive a family of anatomically instantiated and functional cortical circuit models. In contrast to simplistic models of Bayesian inference, the underlying generative model's representational choices are validated with real-world tasks that required efficient inference and strong generalization. The cortical circuit model is derived by systematically comparing the computational requirements of this model with known anatomical constraints. The derived model suggests precise functional roles for the feedforward, feedback and lateral connections observed in different laminae and columns, and assigns a computational role for the path through the thalamus.

q-bio.NC↗

Clustering Time-Series Energy Data from Smart Meters

Investigations have been performed into using clustering methods in data mining time-series data from smart meters. The problem is to identify patterns and trends in energy usage profiles of commercial and industrial customers over 24-hour periods, and group similar profiles. We tested our method on energy usage data provided by several U.S. power utilities. The results show accurate grouping of accounts similar in their energy usage patterns, and potential for the method to be utilized in energy efficiency programs.

stat.ML↗

Finite Element-Based Structural Optimization of Large System Models Under Buckling Constraints

Optimization of large structures of multiple components is essential to many industries for minimizing mass, especially the design of aerospace vehicles. Optimizing a single primary load member independently of all other primary structures is an incomplete process, due to the redistribution of internal loads, as the stiffness distribution changes. That is, optimizing a component changes joint loads, which then calls for a new optimization - changing internal loads changes the optimum. This is particularly evident under buckling (stability) constraints. The goal is to develop a finite element-based optimization approach which can be used to optimize each component of a large, primary structure assembly. The optimization objective function will be to minimize mass for the system, and the constraints will be both stress constraints as well as buckling constraints. The research aims to improve both the solution and practical usability of these models. The system of interest is a spacecraft fuselage, of which the member components are panels throughout the structure. We present analyses of several main optimization methods, and define a new algorithm to solve this problem, eigenOpt.

math.NA↗

Evaluating Real-time Anomaly Detection Algorithms - the Numenta Anomaly Benchmark

Much of the world's data is streaming, time-series data, where anomalies give significant information in critical situations; examples abound in domains such as finance, IT, security, medical, and energy. Yet detecting anomalies in streaming data is a difficult task, requiring detectors to process data in real-time, not batches, and learn while simultaneously making predictions. There are no benchmarks to adequately test and score the efficacy of real-time anomaly detectors. Here we propose the Numenta Anomaly Benchmark (NAB), which attempts to provide a controlled and repeatable environment of open-source tools to test and measure anomaly detection algorithms on streaming data. The perfect detector would detect all anomalies as soon as possible, trigger no false alarms, work with real-world time-series data across a variety of domains, and automatically adapt to changing statistics. Rewarding these characteristics is formalized in NAB, using a scoring algorithm designed for streaming data. NAB evaluates detectors on a benchmark dataset with labeled, real-world time-series data. We present these components, and give results and analyses for several open source, commercially-used algorithms. The goal for NAB is to provide a standard, open source framework with which the research community can compare and evaluate different algorithms for detecting anomalies in streaming data.

cs.AI↗

A Pareto Optimal D* Search Algorithm for Multiobjective Path Planning

Path planning is one of the most vital elements of mobile robotics, providing the agent with a collision-free route through the workspace. The global path plan can be calculated with a variety of informed search algorithms, most notably the A* search method, guaranteed to deliver a complete and optimal solution that minimizes the path cost. D* is widely used for its dynamic replanning capabilities. Path planning optimization typically looks to minimize the distance traversed from start to goal, but many mobile robot applications call for additional path planning objectives, presenting a multiobjective optimization (MOO) problem. Common search algorithms, e.g. A* and D*, are not well suited for MOO problems, yielding suboptimal results. The search algorithm presented in this paper is designed for optimal MOO path planning. The algorithm incorporates Pareto optimality into D*, and is thus named D*-PO. Non-dominated solution paths are guaranteed by calculating the Pareto front at each search step. Simulations were run to model a planetary exploration rover in a Mars environment, with five path costs. The results show the new, Pareto optimal D*-PO outperforms the traditional A* and D* algorithms for MOO path planning.

cs.AI↗

Optimized Mission Planning for Planetary Exploration Rovers

The exploration of planetary surfaces is predominately unmanned, calling for a landing vehicle and an autonomous and/or teleoperated rover. Artificial intelligence and machine learning techniques can be leveraged for better mission planning. This paper describes the coordinated use of both global navigation and metaheuristic optimization algorithms to plan the safe, efficient missions. The aim is to determine the least-cost combination of a safe landing zone (LZ) and global path plan, where avoiding terrain hazards for the lander and rover minimizes cost. Computer vision methods were used to identify surface craters, mounds, and rocks as obstacles. Multiple search methods were investigated for the rover global path plan. Several combinatorial optimization algorithms were implemented to select the shortest distance path as the preferred mission plan. Simulations were run for a sample Google Lunar X Prize mission. The result of this study is an optimization scheme that path plans with the A* search method, and uses simulated annealing to select ideal LZ-path- goal combination for the mission. Simulation results show the methods are effective in minimizing the risk of hazards and increasing efficiency. This paper is specific to a lunar mission, but the resulting architecture may be applied to a large variety of planetary missions and rovers.

cs.RO↗

A Pareto Front-Based Multiobjective Path Planning Algorithm

Path planning is one of the most vital elements of mobile robotics. With a priori knowledge of the environment, global path planning provides a collision-free route through the workspace. The global path plan can be calculated with a variety of informed search algorithms, most notably the A* search method, guaranteed to deliver a complete and optimal solution that minimizes the path cost. Path planning optimization typically looks to minimize the distance traversed from start to goal, yet many mobile robot applications call for additional path planning objectives, presenting a multiobjective optimization (MOO) problem. Past studies have applied genetic algorithms to MOO path planning problems, but these may have the disadvantages of computational complexity and suboptimal solutions. Alternatively, the algorithm in this paper approaches MOO path planning with the use of Pareto fronts, or finding non-dominated solutions. The algorithm presented incorporates Pareto optimality into every step of A* search, thus it is named A*-PO. Results of simulations show A*-PO outperformed several variations of the standard A* algorithm for MOO path planning. A planetary exploration rover case study was added to demonstrate the viability of A*-PO in a real-world application.

cs.AI↗