arXiv · 2512.08798
Can TabPFN Compete with GNNs for Node Classification via Graph Tabularization?
Abstract
Foundation models pretrained on large data have demonstrated remarkable zero-shot generalization capabilities across domains. Building on the success of TabPFN for tabular data and its recent extension to time series, we investigate whether graph node classification can be effectively reformulated as a tabular learning problem. We introduce TabPFN-GN, which transforms graph data into tabular features by extracting node attributes, structural properties, positional encodings, and optionally smoothed neighborhood features. This enables TabPFN to perform direct node classification without any graph-specific training or language model dependencies. Our experiments on 12 benchmark datasets reveal that TabPFN-GN achieves competitive performance with GNNs on homophilous graphs and consistently outperforms them on heterophilous graphs. These results demonstrate that principled feature engineering can bridge the gap between tabular and graph domains, providing a practical alternative to task-specific GNN training and LLM-dependent graph foundation models.
Explore related subjects
Keep this discovery
Jeongwhan Choi, Woosung Kang, Minseo Kim, Jongwoo Kim, Noseong Park. 2025-12-09. Can TabPFN Compete with GNNs for Node Classification via Graph Tabularization?. https://arxiv.org/abs/2512.08798
Cite the original work for its findings. Save a collection to share your selection of sources.