SearcharxivSearch

arXiv subjects

Spyros Tragoudas

Publications and source records attributed to Spyros Tragoudas.

4 recordsLinked to original sources

Carbon-Aware Routing for Function Calling in Edge-Cloud LLM Systems

Large Language Models (LLMs) with function-calling capabilities are becoming critical for modern agentic AI systems. Nevertheless, current deployments typically route inferences to powerful cloud-based models, incurring significant energy use and carbon emissions. We address this sustainability challenge with a carbon-aware routing framework that distributes function-calling queries across a three-tier edge-cloud architecture, combining edge and cloud LLMs on heterogeneous hardware. At its core, a lightweight k-NN predictor operating in a unified semantic-lexical embedding space estimates query-specific accuracy, delay, and power consumption on each edge tier. These predictions are then combined with real-time grid carbon intensity to route every query to the lowest-emission tier capable of executing it successfully. Evaluated on state-of-the-art function-calling benchmarks and LLM families, our framework matches cloud-level accuracy while reducing operational carbon emissions by $4\times$ on average.

cs.AI

A Statistical Method for Attack-Agnostic Adversarial Attack Detection with Compressive Sensing Comparison

Adversarial attacks present a significant threat to modern machine learning systems. Yet, existing detection methods often lack the ability to detect unseen attacks or detect different attack types with a high level of accuracy. In this work, we propose a statistical approach that establishes a detection baseline before a neural network's deployment, enabling effective real-time adversarial detection. We generate a metric of adversarial presence by comparing the behavior of a compressed/uncompressed neural network pair. Our method has been tested against state-of-the-art techniques, and it achieves near-perfect detection across a wide range of attack types. Moreover, it significantly reduces false positives, making it both reliable and practical for real-world applications.

cs.CR

A Vertical Approach to Designing and Managing Sustainable Heterogeneous Edge Data Centers

The increasing demand for Artificial Intelligence (AI) computing poses significant environmental challenges, with both operational and embodied carbon emissions becoming major contributors. This paper presents a carbon-aware holistic methodology for designing and managing sustainable Edge Data Centers (EDCs), based on three design principles that challenge the state-of-the-art optimization paradigms. Our approach employs vertical integration across the architecture, system, and runtime layers, balances operational and embodied carbon emissions while considering EDC performance as a co-optimization objective, rather than a constraint. At the architecture level, we propose carbon-aware and approximate accelerator designs to reduce embodied carbon. At the system level, we enhance resource utilization and adapt to real-time carbon intensity variations to minimize operational emissions. Finally, at the runtime level, we develop dynamic scheduling frameworks that adjust execution, based on energy constraints and carbon intensity.

eess.SY

Low Power Artificial Neural Network Architecture

Recent artificial neural network architectures improve performance and power dissipation by leveraging resistive devices to store and multiply synaptic weights with input data. Negative and positive synaptic weights are stored on the memristors of a reconfigurable crossbar array (MCA). Existing MCA-based neural network architectures use high power consuming voltage converters or operational amplifiers to generate the total synaptic current through each column of the crossbar array. This paper presents a low power MCA-based feedforward neural network architecture that uses a spintronic device per pair of columns to generate the synaptic current for each neuron. It is shown experimentally that the proposed architecture dissipates significantly less power compared to existing feedforward memristive neural network architectures.

cs.ET