arXiv · 2610.19958
An Experimental Study on the Functional Correctness of Network Device Configurations Produced by Large Language Models
Abstract
This paper presents a preliminary study on the efficacy of network device configuration produced by Large Language Models (LLMs). Currently, the study focuses on routing protocol configurations in a predefined small internetwork with Cisco-based routing devices. The capability of three freely available LLMs with standard capabilities (i.e., with no enhanced features) to produce effective setups is investigated. Prompt engineering methods are excluded in order to assess the "first-response" configurations of the models under consideration. The assessment method is based on the contents of the resulting routing table, aiming at measuring the device functional correctness. For that purpose, the Jaccard index is used to indicate the percentage of correct network prefixes contained in the routing table constructed by the model-based configuration commands. The work provides insights on the maturity and limitations of modern LLMs on aiding network administrators with network device configurations in real deployments.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Anastasios C. Politis. 2026-10-14. An Experimental Study on the Functional Correctness of Network Device Configurations Produced by Large Language Models. https://doi.org/10.1109/iaict71158.2026.11621016
Cite the original work for its findings. Save a collection to share your selection of sources.