arXiv subjects

William T. Freeman

Publications and source records attributed to William T. Freeman.

At least 19 recordsLinked to original sources

arXiv2026

Dynamics and geometry of the inner sub-parsec-scale jet in 3C 279 observed with the Event Horizon Telescope

The 2021 Event Horizon Telescope observations resolve the innermost jet region of the blazar 3C279 with unprecedented detail. The reconstructed images consistently reveal a compact core elongated nearly orthogonal to the large-scale jet axis. This rarely observed morphology recurs across multiple epochs and from 22-230 GHz and is therefore intrinsic rather than an imaging artifact. Geometric model fitting identifies several components with apparent speeds up to 10c, requiring bulk Lorentz factors greater than 10.3 and constraining viewing angles to extremely small values (smaller than one degree). Rest-frame brightness temperatures are systematically low (between 10^9 and 10^10 K), consistent with optically thin emission at 230 GHz. These results suggest that the jet bends toward the observer on sub-parsec scales, producing strong relativistic beaming. Possible drivers of the observed jet bending and temporal evolution include the jet's interaction with the interstellar medium, kink or Kelvin--Helmholtz instabilities, magnetic reconnection near the horizon, or binary-induced precession. However, the current temporal coverage of VLBI data remains insufficient to distinguish between these mechanisms. Continued multifrequency VLBI monitoring will be essential to constraining the dynamics and geometry of the jet base in 3C279.

astro-ph.GA↗

arXiv2026

Broadband multiwavelength properties of the archetypal blazar 3C 279 during the 2017 Event Horizon Telescope campaign

The archetypal blazar 3C 279 hosts a prominent relativistic jet and exhibits strong broadband variability across the electromagnetic spectrum. In April 2017, the Event Horizon Telescope (EHT) observed 3C 279, alongside one of the most extensive quasi-simultaneous multiwavelength (MWL) campaigns ever conducted. With the aim of investigating the physical processes governing 3C 279, we analyzed individual observations and multiband light curves, and constructed a new quasi-simultaneous MWL spectrum. We also performed phenomenological modeling using the turbulent extreme multi-zone (TEMZ) model to constrain the fundamental physical properties of the source. The EHT observations reveal a clear flux increase in the innermost core between April 5 and 11, 2017. Over a broader timescale, radio measurements at longer wavelengths show concurrent enhancements in core flux and polarization around mid-April, coinciding with the ejection of a superluminal knot. Record UV-optical flares with strong polarization variability occurred in late March, followed by gamma-ray activity that declined before the end of the EHT observing period. During this interval, the source remained in a low X-ray state and showed no detectable VHE emission. The TEMZ modeling suggests that the broadband spectrum and variability of 3C 279 can be explained within a jet scenario in which turbulent plasma cells are compressed by a stationary conical shock. However, alternative interpretations, such as magnetic reconnection or a moving shock-in-jet event, remain plausible. This coordinated MWL campaign advances our understanding of the origin of jet and gamma-ray emission in 3C 279, while also providing a comprehensive publicly available dataset that will serve as a valuable reference for future studies.

astro-ph.HE↗

arXiv2026

Everything at Every Scale: Scale-Invariant Diffusion with Continuous Super-Resolution

Creating images from noise is image generation; reconstructing fine details from coarse inputs is super-resolution. Despite their practical differences, both can be understood as reversing information loss across scales. We introduce $\textbf{SKILD}$, a $\textbf{S}$cale-invariant $\textbf{K}$-Space $\textbf{I}$mage $\textbf{L}$earning $\textbf{D}$iffusion model that unifies generation and continuous super-resolution within a single unconditional framework. Both natural images and critical physical systems exhibit scale invariance, and we leverage it to design a forward process that attenuates image content from fine to coarse scales while injecting spectrum-matched Gaussian noise, making scale an explicit coordinate of the diffusion dynamics. The same trained reverse process performs generation and continuous super-resolution by varying only the starting timestep: $\textit{no task-specific architecture, no conditioning branch, no classifier-free guidance, no retraining per scale factor}$. Empirically, SKILD reaches FID $2.65$ and Inception Score $9.63$ on unconditional CIFAR-10, performs $2\times$--$8\times$ super-resolution on ImageNet from a single unconditional checkpoint while outperforming conditional models across perceptual metrics, and reconstructs critical Ising models whose connected four-point correlations closely track the ground truth.

cs.CV↗

arXiv2026

Large Video Planner Enables Generalizable Robot Control

General-purpose robots require decision-making models that generalize across diverse tasks and environments. Recent works build robot foundation models by extending multimodal large language models (MLLMs) with action outputs, creating vision-language-action (VLA) systems. These efforts are motivated by the intuition that MLLMs' large-scale language and image pretraining can be effectively transferred to the action output modality. In this work, we explore an alternative paradigm of using large-scale video pretraining as a primary modality for building robot foundation models. Unlike static images and language, videos capture spatio-temporal sequences of states and actions in the physical world that are naturally aligned with robotic behavior. We curate an internet-scale video dataset of human activities and task demonstrations, and train, for the first time at a foundation-model scale, an open video model for generative robotics planning. The model produces zero-shot video plans for novel scenes and tasks, which we post-process to extract executable robot actions. We evaluate task-level generalization through third-party selected tasks in the wild and real-robot experiments, demonstrating successful physical execution. Together, these results show robust instruction following, strong generalization, and real-world feasibility. We release both the model and dataset to support open, reproducible video-based robot learning. Our website is available at https://www.boyuan.space/large-video-planner/.

cs.RO↗

arXiv2026

GenMatter: Perceiving Physical Objects with Generative Matter Models

Human visual perception offers valuable insights for understanding computational principles of motion-based scene interpretation. Humans robustly detect and segment moving entities that constitute independently moveable chunks of matter, whether observing sparse moving dots, textured surfaces, or naturalistic scenes. In contrast, existing computer vision systems lack a unified approach that works across these diverse settings. Inspired by principles of human perception, we propose a generative model that hierarchically groups low-level motion cues and high-level appearance features into particles (small Gaussians representing local matter), and groups particles into clusters capturing coherently and independently moveable physical entities. We develop a hardware-accelerated inference algorithm based on parallelized block Gibbs sampling to recover stable particle motion and groupings. Our model operates on different kinds of inputs (random dots, stylized textures, or naturalistic RGB video), enabling it to work across settings where biological vision succeeds but existing computer vision approaches do not. We validate this unified framework across three domains: on 2D random dot kinematograms, our approach captures human object perception including graded uncertainty across ambiguous conditions; on a Gestalt-inspired dataset of camouflaged rotating objects, our approach recovers correct 3D structure from motion and thereby accurate 2D object segmentation; and on naturalistic RGB videos, our model tracks the moving 3D matter that makes up deforming objects, enabling robust object-level scene understanding. This work thus establishes a general framework for motion-based perception grounded in principles of human vision.

cs.CV↗

arXiv2026

MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval

Mathematical problem solving remains a challenging test of reasoning for large language and multimodal models, yet existing benchmarks are limited in size, language coverage, and task diversity. We introduce MathNet, a high-quality, large-scale, multimodal, and multilingual dataset of Olympiad-level math problems together with a benchmark for evaluating mathematical reasoning in generative models and mathematical retrieval in embedding-based systems. MathNet spans 47 countries, 17 languages, and two decades of competitions, comprising 30,676 expert-authored problems with solutions across diverse domains. In addition to the core dataset, we construct a retrieval benchmark consisting of mathematically equivalent and structurally similar problem pairs curated by human experts. MathNet supports three tasks: (i) Problem Solving, (ii) Math-Aware Retrieval, and (iii) Retrieval-Augmented Problem Solving. Experimental results show that even state-of-the-art reasoning models (78.4% for Gemini-3.1-Pro and 69.3% for GPT-5) remain challenged, while embedding models struggle to retrieve equivalent problems. We further show that retrieval-augmented generation performance is highly sensitive to retrieval quality; for example, DeepSeek-V3.2-Speciale achieves gains of up to 12%, obtaining the highest scores on the benchmark. MathNet provides the largest high-quality Olympiad dataset together with the first benchmark for evaluating mathematical problem retrieval, and we publicly release both the dataset and benchmark at https://mathnet.mit.edu.

cs.AI↗

arXiv2026

Full-polarization millimeter wavelength variability of Sagittarius A* during the 2018 EHT campaign

Sagittarius A* (Srg A*), the supermassive black hole at the center of the Milky Way, provides a unique laboratory to study accretion dynamics and plasma processes near the event horizon. We investigated the variability and polarization properties of Srg A* using ALMA observations during the 2018 Event Horizon Telescope campaign. We analyzed high-cadence full-polarization light curves from ALMA at millimeter wavelengths, performed time-series analysis, and investigated the temporal behavior during an X-ray flare observed by Chandra on 2018 April 24. The variability characteristics are compared with expectations from standard accretion flow models. We find low variability in total intensity ($σ/μ< 10\%$), but significantly higher variability in linear and circular polarization (~ 30% and ~ 50%, respectively). A time-series analysis reveals red-noise variability, with power spectral densities between -2 and -3 across all Stokes parameters. Polarized intensity shows stable intra-day timescales, while total intensity exhibits more variable timescales, suggesting distinct emission regions, with polarization likely arising from a coherent structure. On April 24, a statistically significant inter-band delay in polarized intensity coincides with a near-simultaneous X-ray and millimeter peak that deviates from the typical delayed flare scenario. This event also features enhanced millimeter variability and coherent polarization loop evolution. The observed simultaneity challenges standard models of transient synchrotron emission with cooling delays, favoring instead a scenario of continuous energy injection in an optically thin region. Our results offer new constraints on the physical mechanisms driving variability in Srg A*, and provide key observational input for refining theoretical models of accretion and plasma behavior in the vicinity of supermassive black holes.

astro-ph.GA↗

arXiv2026

Learning What's Real: Disentangling Signal and Measurement Artifacts in Multi-Sensor Data, with Applications to Astrophysics

Data collected from the physical world is always a combination of multiple sources: an underlying signal from the physical process of interest and a signal from measurement-dependent artifacts from the sensor or instrument. This secondary signal acts as a confounding factor, limiting our ability to extract information about the physics underlying the phenomena we observe. Furthermore, it complicates the combination of observations in heterogeneous or multi-instrument settings. We propose a deep learning framework that leverages overlapping observations, a dual-encoder architecture, and a counterfactual generation objective to disentangle these factors of variation. The resulting representations explicitly separate intrinsic signals from sensor-specific distortions and noise, and can be used for counterfactual view generation, parameter inference unconfounded by measurement distortions, and instrument-independent similarity search. We demonstrate the effectiveness of our approach on astrophysical galaxy images from the DESI Legacy Imaging Survey (Legacy) and the Hyper Suprime-Cam (HSC) Survey as a representative multi-instrument setting. This framework provides a general recipe for scientific and multi-modal self-supervised pretraining: construct training pairs from overlapping observations of the same physical system, treat sensor- or modality-specific effects as augmentations, and learn invariant representations through counterfactual generation.

astro-ph.IM↗

arXiv2026

Ring Asymmetry and Spin in M87*

Event Horizon Telescope (EHT) images of the supermassive black hole M87* depict an asymmetric ring of emission. General relativistic magnetohydrodynamic (GRMHD) models of M87* and its accretion disk predict that the amplitude and location of the ring's peak brightness asymmetry should fluctuate due to turbulence in the source plasma. We compare the observed distribution of brightness asymmetry amplitudes to the simulated distribution in GRMHD models, across varying black hole spin $a_{*}$. We show that, for strongly magnetized (MAD) models, three epochs of EHT data marginally disfavor $|a_{*}| \lesssim 0.2$. This is consistent with the Blandford-Znajek model for M87's jet, which predicts that M87* should have nonzero spin. We show quantitatively how future observations could improve spin constraints, and discuss how improved spin constraints could distinguish between differing jet-launching mechanisms and black hole growth scenarios.

astro-ph.HE↗

arXiv2026

End-to-End Training for Unified Tokenization and Latent Denoising

Latent diffusion models (LDMs) enable high-fidelity synthesis by operating in learned latent spaces. However, training state-of-the-art LDMs requires complex staging: a tokenizer must be trained first, before the diffusion model can be trained in the frozen latent space. We propose UNITE - an autoencoder architecture for unified tokenization and latent diffusion. UNITE consists of a Generative Encoder that serves as both image tokenizer and latent generator via weight sharing. Our key insight is that tokenization and generation can be viewed as the same latent inference problem under different conditioning regimes: tokenization infers latents from fully observed images, whereas generation infers them from noise together with text or class conditioning. Motivated by this, we introduce a single-stage training procedure that jointly optimizes both tasks via two forward passes through the same Generative Encoder. The shared parameters enable gradients to jointly shape the latent space, encouraging a "common latent language". Across image and molecule modalities, UNITE achieves near state of the art performance without adversarial losses or pretrained encoders (e.g., DINO), reaching FID 2.12 and 1.73 for Base and Large models on ImageNet 256 x 256. We further analyze the Generative Encoder through the lenses of representation alignment and compression. These results show that single stage joint training of tokenization & generation from scratch is feasible.

cs.CV↗

arXiv2026

Dynamic Black-hole Emission Tomography with Physics-informed Neural Fields

With the success of static black-hole imaging, the next frontier is the dynamic and 3D imaging of black holes. Recovering the dynamic 3D gas near a black hole would reveal previously-unseen parts of the universe and inform new physics models. However, only sparse radio measurements from a single viewpoint are possible, making the dynamic 3D reconstruction problem significantly ill-posed. Previously, BH-NeRF addressed the ill-posed problem by assuming Keplerian dynamics of the gas, but this assumption breaks down near the black hole, where the strong gravitational pull of the black hole and increased electromagnetic activity complicate fluid dynamics. To overcome the restrictive assumptions of BH-NeRF, we propose PI-DEF, a physics-informed approach that uses differentiable neural rendering to fit a 4D (time + 3D) emissivity field given EHT measurements. Our approach jointly reconstructs the 3D velocity field with the 4D emissivity field and enforces the velocity as a soft constraint on the dynamics of the emissivity. In experiments on simulated data, we find significantly improved reconstruction accuracy over both BH-NeRF and a physics-agnostic approach. We demonstrate how our method may be used to estimate other physics parameters of the black hole, such as its spin.

gr-qc↗

arXiv2026

Locating the missing large-scale emission in the jet of M87* with short EHT baselines

In Very-Long Baseline Interferometric arrays, nearly co-located stations probe the largest scales and typically cannot resolve the observed source. In the absence of large-scale structure, closure phases constructed with these stations are zero and, since they are independent of station-based errors, they can be used to probe data issues. Here, we show with an expansion about co-located stations, how these trivial closure phases become non-zero with brightness distribution on smaller scales than their short baseline would suggest. When applied to sources that are made up of a bright compact and large-scale diffuse component, the trivial closure phases directly measure the centroid relative to the compact source and higher-order image moments. We present a technique to measure these image moments with minimal model assumptions and validate it on synthetic Event Horizon Telescope (EHT) data. We then apply this technique to 2017 and 2018 EHT observations of M87* and find a weak preference for extended emission in the direction of the large-scale jet. We also apply it to 2021 EHT data and measure the source centroid about 1 mas northwest of the compact ring, consistent with the jet observed at lower frequencies.

astro-ph.HE↗

arXiv2025

Probing jet base emission of M87* with the 2021 Event Horizon Telescope observations

We investigate the presence and spatial characteristics of the jet base emission in M87* at 230 GHz, enabled by the enhanced uv coverage in the 2021 Event Horizon Telescope (EHT) observations. The addition of the 12-m Kitt Peak Telescope and NOEMA provides two key intermediate-length baselines to SMT and the IRAM 30-m, giving sensitivity to emission structures at scales of $\sim250~μ$as and $\sim2500~μ$as (0.02 pc and 0.2 pc). Without these baselines, earlier EHT observations lacked the capability to constrain emission on large scales, where a "missing flux" of order $\sim1$ Jy is expected. To probe these scales, we analyzed closure phases, robust against station-based gain errors, and modeled the jet base emission using a simple Gaussian offset from the compact ring emission at separations $>100~μ$as. Our analysis reveals a Gaussian feature centered at ($Δ$RA $\approx320~μ$as, $Δ$Dec $\approx60~μ$as), a projected separation of $\approx5500$ AU, with a flux density of only $\sim60$ mJy, implying that most of the missing flux in previous studies must arise from larger scales. Brighter emission at these scales is ruled out, and the data do not favor more complex models. This component aligns with the inferred direction of the large-scale jet and is consistent with emission from the jet base. While our findings indicate detectable jet base emission at 230 GHz, coverage from only two intermediate baselines limits reconstruction of its morphology. We therefore treat the recovered Gaussian as an upper limit on the jet base flux density. Future EHT observations with expanded intermediate-baseline coverage will be essential to constrain the structure and nature of this component.

astro-ph.HE↗

arXiv2025

From Slow Bidirectional to Fast Autoregressive Video Diffusion Models

Current video diffusion models achieve impressive generation quality but struggle in interactive applications due to bidirectional attention dependencies. The generation of a single frame requires the model to process the entire sequence, including the future. We address this limitation by adapting a pretrained bidirectional diffusion transformer to an autoregressive transformer that generates frames on-the-fly. To further reduce latency, we extend distribution matching distillation (DMD) to videos, distilling 50-step diffusion model into a 4-step generator. To enable stable and high-quality distillation, we introduce a student initialization scheme based on teacher's ODE trajectories, as well as an asymmetric distillation strategy that supervises a causal student model with a bidirectional teacher. This approach effectively mitigates error accumulation in autoregressive generation, allowing long-duration video synthesis despite training on short clips. Our model achieves a total score of 84.27 on the VBench-Long benchmark, surpassing all previous video generation models. It enables fast streaming generation of high-quality videos at 9.4 FPS on a single GPU thanks to KV caching. Our approach also enables streaming video-to-video translation, image-to-video, and dynamic prompting in a zero-shot manner.

cs.CV↗

arXiv2025

Single-pass Adaptive Image Tokenization for Minimum Program Search

According to Algorithmic Information Theory (AIT) -- Intelligent representations compress data into the shortest possible program that can reconstruct its content, exhibiting low Kolmogorov Complexity (KC). In contrast, most visual representation learning systems use fixed-length representations for all inputs, ignoring variations in complexity or familiarity. Recent adaptive tokenization methods address this by allocating variable-length representations but typically require test-time search over multiple encodings to find the most predictive one. Inspired by Kolmogorov Complexity principles, we propose a single-pass adaptive tokenizer, KARL, which predicts the appropriate number of tokens for an image in a single forward pass, halting once its approximate KC is reached. The token count serves as a proxy for the minimum description length. KARL's training procedure closely resembles the Upside-Down Reinforcement Learning paradigm, as it learns to conditionally predict token halting based on a desired reconstruction quality. KARL matches the performance of recent adaptive tokenizers while operating in a single pass. We present scaling laws for KARL, analyzing the role of encoder/decoder size, continuous vs. discrete tokenization and more. Additionally, we offer a conceptual study drawing an analogy between Adaptive Image Tokenization and Algorithmic Information Theory, examining the predicted image complexity (KC) across axes such as structure vs. noise and in- vs. out-of-distribution familiarity -- revealing alignment with human intuition.

cs.CV↗

arXiv2025

RandAR: Decoder-only Autoregressive Visual Generation in Random Orders

We introduce RandAR, a decoder-only visual autoregressive (AR) model capable of generating images in arbitrary token orders. Unlike previous decoder-only AR models that rely on a predefined generation order, RandAR removes this inductive bias, unlocking new capabilities in decoder-only generation. Our essential design enables random order by inserting a "position instruction token" before each image token to be predicted, representing the spatial location of the next image token. Trained on randomly permuted token sequences -- a more challenging task than fixed-order generation, RandAR achieves comparable performance to its conventional raster-order counterpart. More importantly, decoder-only transformers trained from random orders acquire new capabilities. For the efficiency bottleneck of AR models, RandAR adopts parallel decoding with KV-Cache at inference time, enjoying 2.5x acceleration without sacrificing generation quality. Additionally, RandAR supports inpainting, outpainting and resolution extrapolation in a zero-shot manner. We hope RandAR inspires new directions for decoder-only visual generation models and broadens their applications across diverse scenarios. Our project page is at https://rand-ar.github.io/.

cs.CV↗

arXiv2025

Test-Time Training Done Right

Test-Time Training (TTT) models context dependencies by adapting part of the model's weights (referred to as fast weights) during inference. This fast weight, akin to recurrent states in RNNs, stores temporary memories of past tokens in the current sequence. Existing TTT methods struggled to show effectiveness in handling long-context data, due to their inefficiency on modern GPUs. The TTT layers in many of these approaches operate with extremely low FLOPs utilization (often <5%) because they deliberately apply small online minibatch sizes (e.g., updating fast weights every 16 or 64 tokens). Moreover, a small minibatch implies fine-grained block-wise causal dependencies in the data, unsuitable for data beyond 1D ordered sequences, like sets or N-dimensional grids such as images or videos. In contrast, we pursue the opposite direction by using an extremely large chunk update, ranging from 2K to 1M tokens across tasks of varying modalities, which we refer to as Large Chunk Test-Time Training (LaCT). It improves hardware utilization by orders of magnitude, and more importantly, facilitates scaling of nonlinear state size (up to 40% of model parameters), hence substantially improving state capacity, all without requiring cumbersome and error-prone kernel implementations. It also allows easy integration of sophisticated optimizers, e.g. Muon for online updates. We validate our approach across diverse modalities and tasks, including novel view synthesis with image set, language models, and auto-regressive video diffusion. Our approach can scale up to 14B-parameter AR video diffusion model on sequences up to 56K tokens. In our longest sequence experiment, we perform novel view synthesis with 1 million context length. We hope this work will inspire and accelerate new research in the field of long-context modeling and test-time training. Website: https://tianyuanzhang.com/projects/ttt-done-right

cs.LG↗

arXiv2025

Origin of the ring ellipticity in the black hole images of M87*

We investigate the origin of the elliptical ring structure observed in the images of the supermassive black hole M87*, aiming to disentangle contributions from gravitational, astrophysical, and imaging effects. Leveraging the enhanced capabilities of the Event Horizon Telescope (EHT) 2018 array, including improved $(u,v)$-coverage from the Greenland Telescope, we measure the ring's ellipticity using five independent imaging methods, obtaining a consistent average value of $τ= 0.08_{-0.02}^{+0.03}$ with a position angle $ξ= 50.1_{-7.6}^{+6.2}$ degrees. To interpret this measurement, we compare against General Relativistic Magnetohydrodynamic (GRMHD) simulations spanning a wide range of physical parameters including thermal or non-thermal electron distribution function, spins, and ion-to-electron temperature ratios in both low and high-density regions. We find no statistically significant correlation between spin and ellipticity in GRMHD images. Instead, we identify a correlation between ellipticity and the fraction of non-ring emission, particularly in non-thermal models and models with higher jet emission. These results indicate that the ellipticity measured from the \m87 emission structure is consistent with that expected from simulations of turbulent accretion flows around black holes, where it is dominated by astrophysical effects rather than gravitational ones. Future high-resolution imaging, including space very long baseline interferometry and long-term monitoring, will be essential to isolate gravitational signatures from astrophysical effects.

astro-ph.HE↗