arXiv · 2302.12178
A Scalable Space-efficient In-database Interpretability Framework for Embedding-based Semantic SQL Queries
Abstract
AI-Powered database (AI-DB) is a novel relational database system that uses a self-supervised neural network, database embedding, to enable semantic SQL queries on relational tables. In this paper, we describe an architecture and implementation of in-database interpretability infrastructure designed to provide simple, transparent, and relatable insights into ranked results of semantic SQL queries supported by AI-DB. We introduce a new co-occurrence based interpretability approach to capture relationships between relational entities and describe a space-efficient probabilistic Sketch implementation to store and process co-occurrence counts. Our approach provides both query-agnostic (global) and query-specific (local) interpretabilities. Experimental evaluation demonstrate that our in-database probabilistic approach provides the same interpretability quality as the precise space-inefficient approach, while providing scalable and space efficient runtime behavior (up to 8X space savings), without any user intervention.
Explore related subjects
Keep this discovery
Prabhakar Kudva, Rajesh Bordawekar, Apoorva Nitsure. 2023-02-23. A Scalable Space-efficient In-database Interpretability Framework for Embedding-based Semantic SQL Queries. https://arxiv.org/abs/2302.12178
Cite the original work for its findings. Save a collection to share your selection of sources.