SearcharxivSearch

arXiv subjects

Tong Ge

Publications and source records attributed to Tong Ge.

8 recordsLinked to original sources

MV-Bench: Benchmarking Multimodal Large Language Models for Coordinated Multi-View Interface Construction

Multimodal large language models (MLLMs) are increasingly expected to automate visualization development by generating code directly from visual designs. However, existing evaluations mainly focus on single-chart generation and overlook coordinated multi-view interface construction, which requires joint reasoning about data semantics, view coordination, and interaction logic. Consequently, MLLM capabilities in this setting remain underexplored, and the field lacks a dedicated benchmark for systematic assessment. We introduce MV-Bench, a benchmark for evaluating MLLMs on coordinated multi-view interface construction. Instead of relying on incomplete or inconsistent open-source implementations, we use Tableau workbook files as ground truth because they explicitly encode data bindings, visual mappings, and interactions. We develop a multi-stage pipeline that converts these specifications into executable web interfaces through structured intermediate representations. The benchmark contains 92 base interfaces and 1,048 verified instances created by recombining chart types, datasets, and interaction patterns. Each instance includes executable code, a rendered interface, a dataset, and interaction annotations. We evaluate five state-of-the-art MLLMs in a single-pass setting using metrics for visual fidelity, data binding correctness, and interaction completeness. The strongest model achieves 75.45 percent accuracy in visual layout reproduction, but only 21.71 percent in data binding and 11.68 percent in interaction completeness. These results show that current MLLMs can reproduce visual appearance but remain limited in generating the data semantics and interactive logic required by coordinated multi-view interfaces. Iterative refinement improves code executability but does not substantially reduce the gap in data binding and interaction generation.

cs.CV

Integrated lithium niobate microwave photonics: Driving next-generation wireless technologies

Integrated microwave photonics (MWP) offers a powerful paradigm for handling high-speed microwave signals within chip-scale optical systems. It provides a cost-effective solution to address bandwidth, tunability, and loss bottlenecks of electronics-based radio frequency (RF) systems. The recently emerged thin-film lithium niobate (TFLN) photonic platform, with its exceptional electro-optic (EO) properties, low loss, and scalability, has shown promise to reshape the MWP landscape. Here, we discuss the performance implications of state-of-the-art TFLN photonic devices for MWP applications and offer insights into the emerging trends for next-generation wireless networks. In particular, the unparalleled EO bandwidth enables direct optical generation, processing, and reception of millimeter-wave or even terahertz (THz) signals, significantly expanding the operation frequency range of MWP systems. The low drive voltages and linearity of TFLN modulators lead to an unprecedented operation regime of radio-over-fiber (RoF) systems, featuring net gain, low noise figure and large dynamic range, simultaneously. The availability of a versatile device toolkit, combined with low optical loss and scalability, further supports the transition from traditional tabletop MWP systems to chip-scale solutions, with advanced functionalities, compact footprint, and enhanced system robustness. As the TFLN industrial ecosystem rapidly matures, TFLN-based MWP technology has the potential to deliver transformative solutions to future 6G integrated sensing and communication networks.

physics.optics

Spectral-temporal processing using integrated recursive electro-optic circuit

Advances in integrated photonics have enabled unprecedented level of control of light, powering a wide range of photonic technologies from communications and computing to precision metrology and quantum information. However, the conventional on-chip optical signal processing approaches based on optical waveguides and cavities suffer from their large physical footprint and narrow operating bandwidth, respectively. To address this, we propose and experimentally demonstrate, using the thin film lithium niobate (TFLN) photonics, a modular, recursive optical signal processing framework. In our approach, fast electro-optic (EO) switch is used to either keep an optical packet inside the loop, with the processing element embedded within, or to release it from the loop and direct it towards the output waveguide. By configuring the switch on a timescale shorter than a time the photon spends traversing the loop, this architecture can achieve different optical pathlengths in a compact footprint without sacrificing optical bandwidth. As an example, we embed a phase-modulator (PM) inside the loop and demonstrate a frequency shift of optical packets up to 420 GHz, using only a 3 GHz sinusoidal microwave signal. By replacing the PM with chirped Bragg gratings (CBG), we demonstrate recursive delay line featuring large group delays of 28 ps/nm over a 30 nm optical bandwidth. Finally, by introducing asymmetric Mach-Zehnder interferometer (AMZI) inside the loop, we demonstrate a reconfigurable differentiation of the optical packet in time, up to an unprecedented fifth-order. Our results establish a powerful and scalable platform for multifunctional photonic processing, setting the stage for next-generation integrated systems with ultrahigh reconfigurability and spectral-temporal versatility.

physics.optics

Integrated photonic ultrawideband real-time spectrum sensing for 6G wireless networks

The sixth generation (6G) wireless networks require dynamic spectrum management to optimize the utilization of scarce spectral resources and support emerging integrated sensing and communication (ISAC) applications. This necessitates real-time spectrum sensing (RT-SS) capability with ultrawide measurement range, compact size, and low latency. Conventional electronic RT-SS solutions face critical challenges in operating across the millimeter-wave and sub-terahertz bands, which are essential spectra for 6G wireless. While photonic RT-SS has the potential to surpass this limitation, the current implementations feature limited bandwidths below 50 GHz and mostly rely on bulky dispersive fibers with high latency. Here, we address these challenges by developing an integrated photonic RT-SS system capable of ultrabroadband measurement from microwave to sub-terahertz bands, covering the full spectrum for 6G wireless. The photonic RT-SS circuit integrates a broadband electro-optic (EO) modulator for unknown signal loading, an EO tunable microring filter bank for high-speed parallel frequency-to-time mapping, as well as an EO comb for precise channel frequency referencing, all realized on a single thin-film lithium niobate chip. We achieve an unprecedented spectral measurement range beyond 120 GHz at a low latency of less than 100 ns. To validate the effectiveness of our photonic RT-SS system in future 6G scenes, we further propose a heuristic spectro-temporal resource allocation algorithm and conduct a proof-of-concept ISAC demonstration, where a radar adaptively access RT-SS-informed spectrally underutilized regions for high-quality target sensing under dynamic communication interferences. Our work presents a compact and cost-effective solution for efficient spectrum sharing and dynamic management in future 6G ISAC networks.

physics.optics

Advancing vision-language models in front-end development via data synthesis

Modern front-end (FE) development, especially when leveraging the unique features of frameworks like React and Vue, presents distinctive challenges. These include managing modular architectures, ensuring synchronization between data and visual outputs for declarative rendering, and adapting reusable components to various scenarios. Such complexities make it particularly difficult for state-of-the-art large vision-language models (VLMs) to generate accurate and functional code directly from design images. To address these challenges, we propose a reflective agentic workflow that synthesizes high-quality image-text data to capture the diverse characteristics of FE development. This workflow automates the extraction of self-contained\footnote{A \textbf{self-contained} code snippet is one that encapsulates all necessary logic, styling, and dependencies, ensuring it functions independently without requiring external imports or context.} code snippets from real-world projects, renders the corresponding visual outputs, and generates detailed descriptions that link design elements to functional code. To further expand the scope and utility of the synthesis, we introduce three data synthesis strategies: Evolution-based synthesis, which enables scalable and diverse dataset expansion; Waterfall-Model-based synthesis, which generates logically coherent code derived from system requirements; and Additive Development synthesis, which iteratively increases the complexity of human-authored components. We build a large vision-language model, Flame, trained on the synthesized datasets and demonstrate its effectiveness in generating React code via the $\text{pass}@k$ metric. Our results suggest that a code VLM trained to interpret images before code generation may achieve better performance.

cs.CV

In-situ optical vector analysis based on integrated lithium niobate single-sideband modulators

Optical vector analysis (OVA) is an enabling technology for comprehensively characterizing both amplitude and phase responses of optical devices or systems. Conventional OVA technologies are mostly based on discrete optoelectronic components, leading to unsatisfactory system sizes, complexity, and stability. They also encounter challenges in revealing the on-chip characteristics of integrated photonic devices, which are often overwhelmed by the substantial coupling loss and extra spectral response at chip facets. In this work, we demonstrate a miniaturized OVA system for integrated photonics devices based on broadband single sideband (SSB) modulators on a thin-film lithium niobate (LN) platform. The OVA could provide a direct probe of both amplitude and phase responses of photonic devices with kHz-level resolution and tens of terahertz measurement bandwidth. We perform in-situ characterizations of single and coupled microring resonators fabricated on the same chip as the OVA, unfolding their intrinsic loss and coupling states unambiguously. Furthermore, we achieve the direct measurement of collective phase dynamics and density of states of the Bloch modes in a synthetic frequency crystal, by in-situ OVA of a dynamically modulated microring resonator. Our in-situ OVA system provides a compact, high-precision, and broadband solution for characterizing future integrated photonic devices and circuits, with potential applications ranging from optical communications, biosensing, neuromorphic computing, to quantum information processing.

physics.optics

Integrated lithium niobate microwave photonic processing engine

Integrated microwave photonics is an intriguing field that leverages integrated photonic technologies for the generation, transmission, and manipulation of microwave signals in chip-scale optical systems. In particular, ultrafast processing and computation of analog electronic signals in the optical domain with high fidelity and low latency could enable a variety of applications such as MWP filters, microwave signal processing, and image recognition. An ideal photonic platform for achieving these integrated MWP processing tasks shall simultaneously offer an efficient, linear and high-speed electro-optic modulation block to faithfully perform microwave-optic conversion at low power, and a low-loss functional photonic network that can be configured for a variety of signal processing tasks, as well as large-scale, low-cost manufacturability to monolithically integrate the two building blocks on the same chip. In this work, we demonstrate such an integrated MWP processing engine based on a thin-film lithium niobate platform capable of performing multi-purpose processing and computation tasks of analog signals up to 92 giga samples per second at CMOS-compatible voltages. We demonstrate high-speed analog computation, i.e., first- and second-order temporal integration and differentiation with computing accuracies up to 98.1 %, and deploy these functions to showcase three proof-of-concept applications, namely, ordinary differential equation solving, ultra-wideband signal generation and high-speed edge detection of images. We further leverage the image edge detector to enable a photonic-assisted image segmentation model that could effectively outline the boundaries of melanoma lesion in medical diagnostic images, achieving orders of magnitude faster processing speed and lower power consumption than conventional electronic processors.

physics.optics

Visual Data Analysis and Simulation Prediction for COVID-19

The COVID-19 (formerly, 2019-nCoV) epidemic has become a global health emergency, as such, WHO declared PHEIC. China has taken the most hit since the outbreak of the virus, which could be dated as far back as late November by some experts. It was not until January 23rd that the Wuhan government finally recognized the severity of the epidemic and took a drastic measure to curtain the virus spread by closing down all transportation connecting the outside world. In this study, we seek to answer a few questions: How did the virus get spread from the epicenter Wuhan city to the rest of the country? To what extent did the measures, such as, city closure and community quarantine, help controlling the situation? More importantly, can we forecast any significant future development of the event had some of the conditions changed? By collecting and visualizing publicly available data, we first show patterns and characteristics of the epidemic development; we then employ a mathematical model of disease transmission dynamics to evaluate the effectiveness of some epidemic control measures, and more importantly, to offer a few tips on preventive measures.

physics.med-ph