Searcharxiv⌕ Search

arXiv subjects

Liv Våge

Publications and source records attributed to Liv Våge.

3 recordsLinked to original sources

WARP Logic Neural Networks

Fast and efficient AI inference is increasingly important, and recent models that directly learn low-level logic operations have achieved state-of-the-art performance. However, existing logic neural networks incur high training costs, introduce redundancy or rely on approximate gradients, which limits scalability. To overcome these limitations, we introduce WAlsh Relaxation for Probabilistic (WARP) logic neural networks -- a novel gradient-based framework that efficiently learns combinations of hardware-native logic blocks. We show that WARP yields the most parameter-efficient representation for exactly learning Boolean functions and that several prior approaches arise as restricted special cases. Training is improved by introducing learnable thresholding and residual initialization, while we bridge the gap between relaxed training and discrete logic inference through stochastic smoothing. Experiments demonstrate faster convergence than state-of-the-art baselines, while scaling effectively to deeper architectures and logic functions with higher input arity.

cs.LG↗

WARP-LUTs -- Walsh-Assisted Relaxation for Probabilistic Look Up Tables

Fast and efficient machine learning is of growing interest to the scientific community and has spurred significant research into novel model architectures and hardware-aware design. Recent hard? and software co-design approaches have demonstrated impressive results with entirely multiplication-free models. Differentiable Logic Gate Networks (DLGNs), for instance, provide a gradient-based framework for learning optimal combinations of low-level logic gates, setting state-of-the-art trade-offs between accuracy, resource usage, and latency. However, these models suffer from high computational cost during training and do not generalize well to logic blocks with more inputs. In this work, we introduce Walsh-Assisted Relaxation for Probabilistic Look-Up Tables (WARP-LUTs) - a novel gradient-based method that efficiently learns combinations of logic gates with substantially fewer trainable parameters. We demonstrate that WARP-LUTs achieve significantly faster convergence on CIFAR-10 compared to DLGNs, while maintaining comparable accuracy. Furthermore, our approach suggests potential for extension to higher-input logic blocks, motivating future research on extremely efficient deployment on modern FPGAs and its real-time science applications.

cs.LG↗

Machine Learning Power Week 2023: Clustering in Hadronic Calorimeters

In both high-energy physics and industry applications, a crowd-sourced approach to difficult problems is becoming increasingly common. These innovative approaches are ideal for the development of future facilities where the simulations can be publicly distributed, such as the Electron-Ion Collider (EIC). In this paper, we discuss a so-called ``Power Week" where graduate students were able to learn about machine learning while also contributing to an unsolved problem at a future facility. Here, the problem of interest was the clustering of the forward hadronic calorimeter in the foreseen electron-proton/ion collider experiment (ePIC) detector at the EIC. The different possible approaches, developed over the course of a single week, and their performance are detailed and summarised. Feedback on the format of the week and recommendations for future similar programs are provided in the hopes to inspire future learning opportunities for students that also serve as a crowd-sourced approaches to unsolved problems.

nucl-ex↗