arXiv · 2605.03430
DynaTab: Dynamic Feature Ordering as Neural Rewiring for High-Dimensional Tabular Data
Abstract
High-dimensional tabular data lacks a natural feature order, limiting the applicability of permutation-sensitive deep learning models. We propose DynaTab, a dynamic feature ordering-enabled architecture inspired by neural rewiring. We introduce a lightweight criterion that predicts when feature permutation will benefit a dataset by quantifying its intrinsic complexity. DynaTab dynamically reorders features via a neural rewiring algorithm and processes them through a compact, dynamic order-aware combination of separate learned positional embedding, importance-based gating, and masked attention layers, compatible with any sequence-sensitive backbone. Trained end-to-end with bespoke dynamic feature ordering (DFO) and dispersion losses, DynaTab achieves statistically significant gains, particularly on high-dimensional datasets, where it is benchmarked against 45 state-of-the-art baselines across 36 different real-world tabular datasets. Our results position DynaTab as a compelling new paradigm for high-dimensional tabular deep learning.
Explore related subjects
Keep this discovery
Al Zadid Sultan Bin Habib, Gianfranco Doretto, Donald A. Adjeroh. 2026-05-05. DynaTab: Dynamic Feature Ordering as Neural Rewiring for High-Dimensional Tabular Data. https://arxiv.org/abs/2605.03430
Cite the original work for its findings. Save a collection to share your selection of sources.