Searcharxiv⌕ Search

arXiv · 2611.22967

CodeReel: Accelerating Code-to-Video Agents with Exact Frame Reuse and Blocking-Aware Scheduling

Abstract

Coding agents make videos by writing and refining programs in a build--inspect--edit loop. A finished film costs a median of $2.85 in model calls and 11 minutes, over a third of that time in builds that block the agent. We find that much of this time is avoidable, for two reasons. First, 37.5% of the frames of a session's later films were drawn before, many shifted in time or inside an edited scene. Second, half of the builds stop at a check, where the agent needs only the verdict, but which builds stop is unknown until the checks finish. We present CodeReel, a training-free execution layer behind agents' existing commands. Exact frame reuse keys each frame by its drawing commands, regardless of its position in time, and reuses each frame whose key recurs. Blocking-aware scheduling runs the checks first and starts the render alongside them, at idle priority, unless the session's recent builds make a pass unlikely. Scheduling spends CPU to answer sooner and reuse returns it; exact keys let later versions use frames rendered for a failed one as the agent thinks. We introduce EditLoop, a benchmark of replayable agent sessions whose films are checked against renders from scratch. On it, CodeReel cuts the agent's wait by 36.3% against Rebuild, a warm pipeline with parallel rendering, and by 57.9% against Sequential, today's step-by-step pipeline. On time-shifting edits its reuse renders 43.9%, close to the 43.0% whose pixels are new, while Manim-style caching renders 99.8%. With real agents, the median wait per build is 0.62x Rebuild's in Claude Code, on topics never used in development, and 0.67x in Codex CLI. The gain holds for five models and two frameworks.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Junyi Shen, Yao Lu. 2026-11-17. CodeReel: Accelerating Code-to-Video Agents with Exact Frame Reuse and Blocking-Aware Scheduling. https://searcharxiv.com/abs/2611.22967

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.

KEEP EXPLORING

Related papers

AutoMV: An Automatic Multi-Agent System for Music Video Generation

Turning a full song into a music video (MV) requires interpreting its lyrics, which are often metaphorical, multilingual, and repeated across choruses, together with its musical character, and laying the resulting imagery out along the song's structure. Existing music-to-video systems produce short clips or audio-reactive visuals and make little use of lyric meaning. We present AutoMV, a training-free multi-agent framework in which LLM Screenwriter and Director agents plan a full-song visual narrative from time-aligned lyrics and music analysis, keep characters consistent through a shared character bank, and route each shot to cinematic or lip-sync rendering with verification. To evaluate full-song MVs, we build M2VBench: 30 released songs paired with their official MVs, objective audio--visual metrics, and a 12-criterion rubric rated by music-industry experts. Expert evaluation shows that AutoMV outperforms other baselines, although a gap remains to human-produced MVs. Ablation studies highlight the importance of time-aligned lyrics for musical theme alignment and storytelling. We further find that the selected multimodal judge, guided by our evaluation rubric, recovers the expert ranking of automatic systems, with some discrepancies in fine-grained assessments.

cs.MM↗

DAT: Dual-Aware Adaptive Transmission with Small-Large Model Collaboration for Edge-Cloud Anomaly Detection

Continuous video anomaly detection is critical for timely safety monitoring in edge--cloud visual systems, but it remains challenging because abnormal events are sparse, transient, and require both low-latency anomaly detection and verifiable visual evidence. Multimodal large language models (MLLMs) offer strong semantic understanding and visual reasoning capabilities for such event-centric analysis, yet applying them to continuous video streams incurs prohibitive computation and communication overhead under bandwidth-constrained edge--cloud deployments. To address this challenge, we propose DAT, a dual-aware adaptive transmission framework that supports high-quality semantic generation, low-latency anomaly detection, and progressive visual evidence supplementation. DAT first uses a collaborative small--large model cascade, where a lightweight edge-side model filters non-target-event frames, performs object detection, and triggers MLLM inference only for suspicious frames. Building on this cascade, DAT introduces visual guidance and semantic prompting to improve structured event understanding, localization, and output consistency. It further schedules semantic anomaly alarms and visual evidence through a semantic- and bandwidth-aware multi-stream transmission optimization method. Experimental results show that DAT achieves 97.77\% F1 in traffic-accident detection while substantially reducing inference and communication overhead. On continuous video workloads, DAT lowers the MLLM call rate to 13.71\% and reduces upload volume by at least 95.72\% compared with representative edge--cloud baselines. Under severe congestion, DAT reduces weighted alarm delay by up to 87.9\%, demonstrating efficient MLLM-based anomaly detection under constrained edge--cloud networks.

cs.MM↗

Cassette-Editor: Shared Timeline Semantics for Human and Agent Editing

Video editing involves tedious manual manipulation across interconnected timeline tracks, motivating automated agents that offload routine work while keeping the project directly revisable by humans. Fixed operation catalogs limit expressiveness, while even a basic trim requires coordinated updates across later clips, attached titles, and transitions. We present Cassette-Editor, an agent harness that unifies manual user gestures and automated agent patches within a shared editing environment. The shared action language expresses the editor's manual content changes, and a common history records committed edits for undo and manual refinement. When the model selects an edit, a state executor automatically derives its downstream consequences, such as shifting later clips and attached titles after a trim, while a validation rulebook enforces structural invariants and returns localized diagnostics for automated repair. To keep the agent grounded as the project evolves, dynamic read operations map transcripts and shot descriptions onto the current timeline. Evaluated with GPT-6 Luna, the full harness passed the scored request checks in 92/93 trials across 31 authored requests on two interview documentaries, compared with 48/93 for an internal basic-tools baseline. In ablations, disabling the consequences derived by the executor reduced passed trials from 230/232 to 199/232 on edits with dependent timeline elements, while ablating rulebook validation and repair lowered passed trials from 46/48 to 10/48 on requests operating near structural validity boundaries. Evaluating the complete system on 50 TVSum videos further demonstrated greater agreement with human annotations than a general agent using the same model (F1 23.8 vs. 20.1).

cs.MM↗