arXiv subjects

Yi-Chun Chen

Publications and source records attributed to Yi-Chun Chen.

At least 19 recordsLinked to original sources

arXiv2026

Reconstructing Persistent Worlds from Narratives for Narrative-Grounded Interactive Experiences

Designing narrative-grounded interactive experiences remains labor-intensive because interactive content must align with the underlying world implied by the narrative. Existing approaches formulate problems such as narrative planning, scene generation, and gameplay generation, each constructing computational representations tailored to specific downstream tasks rather than explicitly reconstructing and maintaining the persistent world that grounds them. We investigate reconstructing explicit persistent worlds from narrative descriptions as the central computational objective for narrative-grounded interactive realization. Rather than treating the world as an implicit by-product of downstream generation, our approach reconstructs and maintains persistent entities, locations, semantic relationships, and evolving world states while inferring only the contextual information required to support coherent interactive experiences. To investigate this perspective, we develop a reference prototype that reconstructs structured persistent world representations from narrative descriptions and subsequently instantiates playable tile-based environments. Through three representative case studies spanning a procedural scenario, an original fantasy narrative, and an adapted public-domain story, we demonstrate the feasibility of reconstructing persistent worlds and show how a shared world representation supports coherent gameplay while remaining grounded in the source narrative. By explicitly reconstructing persistent worlds prior to interactive realization, this work bridges computational narrative understanding and interactive content generation, providing a semantic foundation for AI-assisted game authoring, mixed-initiative design, educational simulations, and narrative-grounded interactive experiences.

cs.CL↗

arXiv2026

Distinguishing Revision and Delayed Elaboration in Incremental Narrative Interpretation

Both human and AI systems that process narrative or long-form content operate incrementally: input is received over time, and internal representations must be updated accordingly. Incremental interpretation, therefore, depends not only on what is represented but also on how the representational state evolves under new evidence. We distinguish two structurally different update operators that arise in narrative interpretation: revision-driven update and delayed elaboration. Revision-driven updates retract or replace previously committed structure in response to a contradiction and are therefore non-monotonic. Delayed elaboration, by contrast, refines initially underspecified elements through constraint addition without retracting prior commitments, yielding monotonic extension of the interpretive state. Although both operators may alter how earlier material is understood, they impose fundamentally different structural requirements on state transitions. Using visual narratives as a diagnostic domain, we demonstrate how a structured narrative representation can explicitly separate committed from underspecified content and support both update operators during incremental construction. Through a worked example, we show how delayed elaboration enables monotonic refinement of interpretive state, while revision requires non-monotonic correction. We discuss the broader relevance of this structural distinction for incremental reasoning and hybrid symbolic-neural systems.

cs.CL↗

arXiv2026

The Wisdom of the Crowd and Higher-Order Beliefs

We propose a new simple procedure called Population-Mean-Based Aggregation (PMBA) that enables a principal to "aggregate" information about an unknown state of the world from agents without understanding the information structure among them. PMBA only requires agents to communicate their beliefs about the state, and some agents to communicate their expectations of the population average belief. In a large population, for any finite number of possible states, and under weak assumptions on the information structure, allowing individual agents' beliefs to be misspecified, we show that PMBA infers the true state (in probability or almost surely under the stated conditions). We show how PMBA can be reinterpreted as a linear regression procedure, and how it can be used to aggregate information from a finite number of agents, allowing us to reuse existing results on inference in linear models. We conduct a novel experiment to show that the real-world performance of our procedure exceeds that of existing methods.

econ.TH↗

arXiv2026

How to Ask for Belief Statistics without Distortion?

Belief elicitation is ubiquitous in experiments but can distort behavior in the main tasks. We study when, and how, an experimenter can ask for a series of action-dependent belief statistics after a subject chooses an action, while incentivize truthful reports without distorting the subject's optimal action in the main experimental tasks. We first propose a novel mechanism called the Counterfactual Scoring Rule (CSR), which achieves such nondistortionary elicitation of any single belief statistic by decomposing it into supplemental action-independent statistics. In contrast, when eliciting a fixed set of belief statistics without such decomposition, we show that robust nondistortionary elicitation is achievable if and only if the questions satisfy a joint alignment condition with the task payoff. The necessity of joint alignment is established through a graph theoretical approach, while its sufficiency follows from invoking an adaptation of the Becker-DeGroot-Marschak mechanism. Our characterization applies to experiments with general task-payoff structures and belief elicitation questions.

econ.TH↗

arXiv2026

A Tale of Two Monopolies

We apply marginal analysis à la Bulow and Roberts (1989) to characterize revenue-maximizing selling mechanisms for a multiproduct monopoly. We derive marginal revenue from price perturbations over arbitrary sets of bundles and show that optimal mechanisms admit no revenue-increasing perturbation for bundles with positive demand, nor revenue-decreasing perturbations for zero-demand bundles. For any symmetric two-dimensional type distribution under mild regularity, this analysis fully characterizes the optimal mechanism across independence, substitutability, and complementarity. For general type distributions and allocation spaces, our approach identifies bundles that must carry positive demand and provides conditions under which pure bundling or separate selling is suboptimal.

econ.TH↗

arXiv2025

GameTileNet: A Semantic Dataset for Low-Resolution Game Art in Procedural Content Generation

GameTileNet is a dataset designed to provide semantic labels for low-resolution digital game art, advancing procedural content generation (PCG) and related AI research as a vision-language alignment task. Large Language Models (LLMs) and image-generative AI models have enabled indie developers to create visual assets, such as sprites, for game interactions. However, generating visuals that align with game narratives remains challenging due to inconsistent AI outputs, requiring manual adjustments by human artists. The diversity of visual representations in automatically generated game content is also limited because of the imbalance in distributions across styles for training data. GameTileNet addresses this by collecting artist-created game tiles from OpenGameArt.org under Creative Commons licenses and providing semantic annotations to support narrative-driven content generation. The dataset introduces a pipeline for object detection in low-resolution tile-based game art (e.g., 32x32 pixels) and annotates semantics, connectivity, and object classifications. GameTileNet is a valuable resource for improving PCG methods, supporting narrative-rich game content, and establishing a baseline for object detection in low-resolution, non-photorealistic images. TL;DR: GameTileNet is a semantic dataset of low-resolution game tiles designed to support narrative-driven procedural content generation through visual-language alignment.

cs.CV↗

arXiv2025

Narrative-to-Scene Generation: An LLM-Driven Pipeline for 2D Game Environments

Recent advances in large language models (LLMs) enable compelling story generation, but connecting narrative text to playable visual environments remains an open challenge in procedural content generation (PCG). We present a lightweight pipeline that transforms short narrative prompts into a sequence of 2D tile-based game scenes, reflecting the temporal structure of stories. Given an LLM-generated narrative, our system identifies three key time frames, extracts spatial predicates in the form of "Object-Relation-Object" triples, and retrieves visual assets using affordance-aware semantic embeddings from the GameTileNet dataset. A layered terrain is generated using Cellular Automata, and objects are placed using spatial rules grounded in the predicate structure. We evaluated our system in ten diverse stories, analyzing tile-object matching, affordance-layer alignment, and spatial constraint satisfaction across frames. This prototype offers a scalable approach to narrative-driven scene generation and lays the foundation for future work on multi-frame continuity, symbolic tracking, and multi-agent coordination in story-centered PCG.

cs.GR↗

arXiv2025

Hierarchical Knowledge Graphs for Story Understanding in Visual Narratives

We present a hierarchical knowledge graph framework for the structured semantic understanding of visual narratives, using comics as a representative domain for multimodal storytelling. The framework organizes narrative content across three levels-panel, event, and macro-event, by integrating symbolic graphs that encode semantic, spatial, and temporal relationships. At the panel level, it models visual elements such as characters, objects, and actions alongside textual components including dialogue and narration. These are systematically connected to higher-level graphs that capture narrative sequences and abstract story structures. Applied to a manually annotated subset of the Manga109 dataset, the framework supports interpretable symbolic reasoning across four representative tasks: action retrieval, dialogue tracing, character appearance mapping, and timeline reconstruction. Rather than prioritizing predictive performance, the system emphasizes transparency in narrative modeling and enables structured inference aligned with cognitive theories of event segmentation and visual storytelling. This work contributes to explainable narrative analysis and offers a foundation for authoring tools, narrative comprehension systems, and interactive media applications.

cs.MM↗

arXiv2025

Correlated equilibrium implementation: Navigating toward social optima with learning dynamics

Implementation theory has made significant advances in characterizing which social choice functions can be implemented in Nash equilibrium, but these results typically assume sophisticated strategic reasoning by agents. However, evidence exists to show that agents frequently cannot perform such reasoning. In this paper, we present a finite mechanism which fully implements Maskin-monotonic social choice functions as the outcome of the unique correlated equilibrium of the induced game. Due to the results in Hart and MasColell (2000), this yields that even when agents use a simple adaptive heuristic like regret minimization rather than computing equilibrium strategies, the designer can expect to implement the SCF correctly. We demonstrate the mechanism's effectiveness through simulations in a bilateral trade environment, where agents using regret matching converge to the desired outcomes despite having no knowledge of others' preferences or the equilibrium structure. The mechanism does not use integer games or modulo games.

econ.TH↗

arXiv2025

Robust Symbolic Reasoning for Visual Narratives via Hierarchical and Semantically Normalized Knowledge Graphs

Understanding visual narratives such as comics requires structured representations that capture events, characters, and their relations across multiple levels of story organization. However, symbolic narrative graphs often suffer from inconsistency and redundancy, where similar actions or events are labeled differently across annotations or contexts. Such variance limits the effectiveness of reasoning and generalization. This paper introduces a semantic normalization framework for hierarchical narrative knowledge graphs. Building on cognitively grounded models of narrative comprehension, we propose methods that consolidate semantically related actions and events using lexical similarity and embedding-based clustering. The normalization process reduces annotation noise, aligns symbolic categories across narrative levels, and preserves interpretability. We demonstrate the framework on annotated manga stories from the Manga109 dataset, applying normalization to panel-, event-, and story-level graphs. Preliminary evaluations across narrative reasoning tasks, such as action retrieval, character grounding, and event summarization, show that semantic normalization improves coherence and robustness, while maintaining symbolic transparency. These findings suggest that normalization is a key step toward scalable, cognitively inspired graph models for multimodal narrative understanding.

cs.MM↗

arXiv2025

Implementation with Uncertain Evidence

We study a full implementation problem with a state unknown to the designer but known to agents, where agents have uncertain evidence privately drawn from state-dependent distributions. Stochastic evidence enables ``perfect deceptions,'' where agents' reports can mimic the evidence distribution of a false state, making differentiation impossible for any mechanism. This yields our main result: a necessary and sufficient condition, No Perfect Deceptions (NPD), for implementation in (mixed-strategy) Bayesian Nash equilibria. The solution requires novel techniques like belief elicitation via competing scoring rules, and an endogenous ``test allocation'' using the evidence structure. For informationally small agents (McLean and Postlewaite (2002)), a generalized condition (GNPD) is sufficient. Our mechanisms work for two or more agents, avoid integer/modulo games, and use limited liability transfers that vanish in equilibrium.

econ.TH↗

arXiv2024

Magnetic Field-Induced Polar Order in Monolayer Molybdenum Disulfide Transistors

In semiconducting monolayer transition metal dichalcogenides (ML-TMDs), broken inversion symmetry and strong spin-orbit coupling result in spin-valley lock-in effects so that the valley degeneracy may be lifted by external magnetic fields, potentially leading to real-space structural transformation. Here, we report magnetic field (B)-induced giant electric hysteretic responses to back-gate voltages in ML-MoS2 field-effect transistors (FETs) on SiO2/Si at temperatures < 20 K. The observed hysteresis increases with |B| up to 12 T and is tunable by varying the temperature. Raman spectroscopic and scanning tunneling microscopic studies reveal significant lattice expansion with increasing |B| at 4.2 K, and this lattice expansion becomes asymmetric in ML-MoS2 FETs on rigid SiO2/Si substrates, leading to out-of-plane mirror symmetry breaking and the emergence of a tunable out-of-plane ferroelectric-like polar order. This broken symmetry-induced polarization in ML-MoS2 shows typical ferroelectric butterfly hysteresis in piezo-response force microscopy, adding ML-MoS2 to the single-layer material family that exhibit out-of-plane polar order-induced ferroelectricity, which is promising for such technological applications as cryo-temperature ultracompact non-volatile memories, memtransistors, and ultrasensitive magnetic field sensors. Moreover, the polar effect induced by asymmetric lattice expansion may be further generalized to other ML-TMDs and achieved by nanoscale strain engineering of the substrate without magnetic fields.

cond-mat.str-el↗

arXiv2024

Collaborative Comic Generation: Integrating Visual Narrative Theories with AI Models for Enhanced Creativity

This study presents a theory-inspired visual narrative generative system that integrates conceptual principles-comic authoring idioms-with generative and language models to enhance the comic creation process. Our system combines human creativity with AI models to support parts of the generative process, providing a collaborative platform for creating comic content. These comic-authoring idioms, derived from prior human-created image sequences, serve as guidelines for crafting and refining storytelling. The system translates these principles into system layers that facilitate comic creation through sequential decision-making, addressing narrative elements such as panel composition, story tension changes, and panel transitions. Key contributions include integrating machine learning models into the human-AI cooperative comic generation process, deploying abstract narrative theories into AI-driven comic creation, and a customizable tool for narrative-driven image sequences. This approach improves narrative elements in generated image sequences and engages human creativity in an AI-generative process of comics. We open-source the code at https://github.com/RimiChen/Collaborative_Comic_Generation.

cs.AI↗

arXiv2024

Ptychographic nanoscale imaging of the magnetoelectric coupling in freestanding BiFeO$_3$

Understanding the magnetic and ferroelectric ordering of magnetoelectric multiferroic materials at the nanoscale necessitates a versatile imaging method with high spatial resolution. Here, soft X-ray ptychography is employed to simultaneously image the ferroelectric and antiferromagnetic domains in an 80 nm thin freestanding film of the room-temperature multiferroic BiFeO$_3$ (BFO). The antiferromagnetic spin cycloid of period 64 nm is resolved by reconstructing the corresponding resonant elastic X-ray scattering in real space and visualized together with mosaic-like ferroelectric domains in a linear dichroic contrast image at the Fe L$_3$ edge. The measurements reveal a near perfect coupling between the antiferromagnetic and ferroelectric ordering by which the propagation direction of the spin cycloid is locked orthogonally to the ferroelectric polarization. In addition, the study evinces both a preference for in-plane propagation of the spin cycloid and changes of the ferroelectric polarization by 71° between multiferroic domains in the epitaxial strain-free, freestanding BFO film. The results provide a direct visualization of the strong magnetoelectric coupling in BFO and of its fine multiferroic domain structure, emphasizing the potential of ptychographic imaging for the study of multiferroics and non-collinear magnetic materials with soft X-rays.

cond-mat.mtrl-sci↗

arXiv2024

Intra-operative tumour margin evaluation in breast-conserving surgery with deep learning

A positive margin may result in an increased risk of local recurrences after breast retention surgery for any malignant tumour. In order to reduce the number of positive margins would offer surgeon real-time intra-operative information on the presence of positive resection margins. This study aims to design an intra-operative tumour margin evaluation scheme by using specimen mammography in breast-conserving surgery. Total of 30 cases were evaluated and compared with the manually determined contours by experienced physicians and pathology report. The proposed method utilizes image thresholding to extract regions of interest and then performs a deep learning model, i.e. SegNet, to segment tumour tissue. The margin width of normal tissues surrounding it is evaluated as the result. The desired size of margin around the tumor was set for 10 mm. The smallest average difference to manual sketched margin (6.53 mm +- 5.84). In the all case, the SegNet architecture was utilized to obtain tissue specimen boundary and tumor contour, respectively. The simulation results indicated that this technology is helpful in discriminating positive from negative margins in the intra-operative setting. The aim of proposed scheme was a potential procedure in the intra-operative measurement system. The experimental results reveal that deep learning techniques can draw results that are consistent with pathology reports.

cs.CV↗

arXiv2024

Engineering the strain and interlayer excitons of 2D materials via lithographically engraved hexagonal boron nitride

Strain engineering has quickly emerged as a viable option to modify the electronic, optical and magnetic properties of 2D materials. However, it remains challenging to arbitrarily control the strain. Here we show that by creating atomically-flat surface nanostructures in hexagonal boron nitride, we achieve an arbitrary on-chip control of both the strain distribution and magnitude on high-quality molybdenum disulfide. The phonon and exciton emissions are shown to vary in accordance with our strain field designs, enabling us to write and draw any photoluminescence color image in a single chip. Moreover, our strain engineering offers a powerful means to significantly and controllably alter the strengths and energies of interlayer excitons at room temperature. This method can be easily extended to other material systems and offers a promise for functional excitonic devices.

cond-mat.mes-hall↗

arXiv2023

CPST: Comprehension-Preserving Style Transfer for Multi-Modal Narratives

We investigate the challenges of style transfer in multi-modal visual narratives. Among static visual narratives such as comics and manga, there are distinct visual styles in terms of presentation. They include style features across multiple dimensions, such as panel layout, size, shape, and color. They include both visual and text media elements. The layout of both text and media elements is also significant in terms of narrative communication. The sequential transitions between panels are where readers make inferences about the narrative world. These feature differences provide an interesting challenge for style transfer in which there are distinctions between the processing of features for each modality. We introduce the notion of comprehension-preserving style transfer (CPST) in such multi-modal domains. CPST requires not only traditional metrics of style transfer but also metrics of narrative comprehension. To spur further research in this area, we present an annotated dataset of comics and manga and an initial set of algorithms that utilize separate style transfer modules for the visual, textual, and layout parameters. To test whether the style transfer preserves narrative semantics, we evaluate this algorithm through visual story cloze tests inspired by work in computational cognition of narrative systems. Understanding the connection between style and narrative semantics provides insight for applications ranging from informational brochure designs to data storytelling.

cs.CV↗

arXiv2023

Panel Transitions for Genre Analysis in Visual Narratives

Understanding how humans communicate and perceive narratives is important for media technology research and development. This is particularly important in current times when there are tools and algorithms that are easily available for amateur users to create high-quality content. Narrative media develops over time a set of recognizable patterns of features across similar artifacts. Genre is one such grouping of artifacts for narrative media with similar patterns, tropes, and story structures. While much work has been done on genre-based classifications in text and video, we present a novel approach to do a multi-modal analysis of genre based on comics and manga-style visual narratives. We present a systematic feature analysis of an annotated dataset that includes a variety of western and eastern visual books with annotations for high-level narrative patterns. We then present a detailed analysis of the contributions of high-level features to genre classification for this medium. We highlight some of the limitations and challenges of our existing computational approaches in modeling subjective labels. Our contributions to the community are: a dataset of annotated manga books, a multi-modal analysis of visual panels and text in a constrained and popular medium through high-level features, and a systematic process for incorporating subjective narrative patterns in computational models.

cs.AI↗