SearcharxivSearch

arXiv subjects

Derek Thomas

Publications and source records attributed to Derek Thomas.

4 recordsLinked to original sources

Context Recycling for Long-Horizon LLM Inference

Large language models (LLMs) exhibit strong capabilities in short-context reasoning but degrade in performance over long conversational horizons due to context window limitations and inefficient token usage. We introduce ContextForge, a system for context recycling that maintains task-relevant information across turns by combining structured query generation, external memory retrieval, and controlled synthesis. The system enables efficient reuse of prior computation without relying on full context replay, reducing token overhead while preserving answer quality. We evaluate ContextForge using a 15-turn conversational benchmark that tests multi-turn reasoning, back-references, and domain shifts across structured healthcare queries. Compared to a baseline agent using identical underlying models, ContextForge demonstrates improved consistency and reduced token consumption, while maintaining comparable response accuracy. These results suggest that context recycling provides a practical approach for extending LLM capabilities in long-horizon tasks without requiring larger context windows or model retraining. Code and evaluation artifacts are available at https://github.com/Betanu701/ContextForge.

cs.CL

Relation Extraction with Self-determined Graph Convolutional Network

Relation Extraction is a way of obtaining the semantic relationship between entities in text. The state-of-the-art methods use linguistic tools to build a graph for the text in which the entities appear and then a Graph Convolutional Network (GCN) is employed to encode the pre-built graphs. Although their performance is promising, the reliance on linguistic tools results in a non end-to-end process. In this work, we propose a novel model, the Self-determined Graph Convolutional Network (SGCN), which determines a weighted graph using a self-attention mechanism, rather using any linguistic tool. Then, the self-determined graph is encoded using a GCN. We test our model on the TACRED dataset and achieve the state-of-the-art result. Our experiments show that SGCN outperforms the traditional GCN, which uses dependency parsing tools to build the graph.

cs.CL

Hierarchical B-spline complexes of discrete differential forms

In this paper, we introduce the hierarchical B-spline complex of discrete differential forms for arbitrary spatial dimension. This complex may be applied to the adaptive isogeometric solution of problems arising in electromagnetics and fluid mechanics. We derive a sufficient and necessary condition guaranteeing exactness of the hierarchical B-spline complex for arbitrary spatial dimension, and we derive a set of local, easy-to-compute, and sufficient exactness conditions for the two-dimensional setting. We examine the stability properties of the hierarchical B-spline complex, and we find that it yields stable approximations of both the Maxwell eigenproblem and Stokes problem provided that the local exactness conditions are satisfied. We conclude by providing numerical results showing the promise of the hierarchical B-spline complex in an adaptive isogeometric solution framework.

math.NA

Successive coefficients of convex functions

It is shown that for $f$ analytic and convex in $z\in D=\{z:|z|<1\}$ and given by $f(z)=z+\sum_{n=2}^{\infty}a_{n}z^{n}$, the difference of coefficients $||a_{3}|-|a_{2}||\le 25/48$ and $||a_{4}|-|a_{3}||\le 25/48$ . Both inequalities are sharp.

math.CV