Searcharxiv⌕ Search

arXiv subjects

Takaki Yamamoto

Publications and source records attributed to Takaki Yamamoto.

6 recordsLinked to original sources

Left-Right Symmetry Breaking in CLIP-style Vision-Language Models Trained on Synthetic Spatial-Relation Data

Spatial understanding remains a key challenge in vision-language models. Yet it is still unclear whether such understanding is truly acquired, and if so, through what mechanisms. We present a controllable 1D image-text testbed to probe how left-right relational understanding emerges in Transformer-based vision and text encoders trained with a CLIP-style contrastive objective. We train lightweight Transformer-based vision and text encoders end-to-end on paired descriptions of one- and two-object scenes and evaluate generalization to unseen object pairs while systematically varying label and layout diversity. We find that contrastive training learns left-right relations and that label diversity, more than layout diversity, is the primary driver of generalization in this setting. To gain the mechanistic understanding, we perform an attention decomposition and show that interactions between positional and token embeddings induce a horizontal attention gradient that breaks left-right symmetry in the encoders; ablating this contribution substantially reduces left-right discrimination. Our results provide a mechanistic insight of when and how CLIP-style models acquire relational competence.

cs.CV↗

Pseudo-Expert Regularized Offline RL for End-to-End Autonomous Driving in Photorealistic Closed-Loop Environments

End-to-end (E2E) autonomous driving models that take only camera images as input and directly predict a future trajectory are appealing for their computational efficiency and potential for improved generalization via unified optimization; however, persistent failure modes remain due to reliance on imitation learning (IL). While online reinforcement learning (RL) could mitigate IL-induced issues, the computational burden of neural rendering-based simulation and large E2E networks renders iterative reward and hyperparameter tuning costly. We introduce a camera-only E2E offline RL framework that performs no additional exploration and trains solely on a fixed simulator dataset. Offline RL offers strong data efficiency and rapid experimental iteration, yet is susceptible to instability from overestimation on out-of-distribution (OOD) actions. To address this, we construct pseudo ground-truth trajectories from expert driving logs and use them as a behavior regularization signal, suppressing imitation of unsafe or suboptimal behavior while stabilizing value learning. Training and closed-loop evaluation are conducted in a neural rendering environment learned from the public nuScenes dataset. Empirically, the proposed method achieves substantial improvements in collision rate and route completion compared with IL baselines. Our code is available at https://github.com/ToyotaInfoTech/PEBC.

cs.RO↗

From Binary to Semantic: Utilizing Large-Scale Binary Occupancy Data for 3D Semantic Occupancy Prediction

Accurate perception of the surrounding environment is essential for safe autonomous driving. 3D occupancy prediction, which estimates detailed 3D structures of roads, buildings, and other objects, is particularly important for vision-centric autonomous driving systems that do not rely on LiDAR sensors. However, in 3D semantic occupancy prediction -- where each voxel is assigned a semantic label -- annotated LiDAR point clouds are required, making data acquisition costly. In contrast, large-scale binary occupancy data, which only indicate occupied or free space without semantic labels, can be collected at a lower cost. Despite their availability, the potential of leveraging such data remains unexplored. In this study, we investigate the utilization of large-scale binary occupancy data from two perspectives: (1) pre-training and (2) learning-based auto-labeling. We propose a novel binary occupancy-based framework that decomposes the prediction process into binary and semantic occupancy modules, enabling effective use of binary occupancy data. Our experimental results demonstrate that the proposed framework outperforms existing methods in both pre-training and auto-labeling tasks, highlighting its effectiveness in enhancing 3D semantic occupancy prediction. The code will be available at https://github.com/ToyotaInfoTech/b2s-occupancy

cs.CV↗

Non-monotonic fluidization generated by fluctuating edge tensions in confluent tissues

In development and homeostasis, multi-cellular systems exhibit spatial and temporal heterogeneity in their biochemical and mechanical properties. Nevertheless, it remains unclear how spatiotemporally heterogeneous forces affect the dynamical and mechanical properties of confluent tissue. To address this question, we study the dynamical behavior of the two-dimensional cellular vertex model for epithelial monolayers in the presence of fluctuating cell-cell interfacial tensions, which is a biologically relevant source of mechanical spatiotemporal heterogeneity. In particular, we investigate the effects of the amplitude and persistence time of fluctuating tension on the tissue dynamics. We unexpectedly find that the long-time diffusion constant describing cell rearrangements depends non-monotonically on the persistence time, while it increases monotonically as the amplitude increases. Our analysis indicates that at low and intermediate persistence times tension fluctuations drive motion of vertices and promote cell rearrangements, while at the highest persistence times the tension in the network evolves so slowly that rearrangements become rare.

cond-mat.soft↗

Collective cell migration of epithelial cells driven by chiral torque generation

Various multicellular tissues show chiral morphology. Experimental studies have shown this can originate from cell chirality. However, no theory has been proposed to connect the cellular chiral torque and multicellular chiral morphogenesis. We propose a model of confluent tissue dynamics with cellular chiral torque. We found that cells migrate unidirectionally under a gradient of cellular chiral torque. While the migration speed varies depending on the tissue's mechanical parameters, it is scaled solely by a structural order parameter for liquid-to-solid transition in confluent tissues.

cond-mat.soft↗

Chirality-induced helical self-propulsion of cholesteric liquid crystal droplets

We report the first experimental realization of a chiral artificial microswimmer exhibiting the helical motion. We found that a cholesteric liquid crystal droplet with a helical director field swims in a helical path driven by the Marangoni flow in an aqueous surfactant solution. We confirmed that the handedness of the droplet determines that of the helical path. This result strongly suggests that the helical motion is originated from the chirality of the cholesteric liquid crystal. To study the mechanism of the emergence of the helical motion, we propose a coupled time-evolution equations in terms of a velocity, an angular velocity and a tensor variable representing the symmetry of the helical director field of the droplet. Our model shows that the chiral coupling terms between the velocity and the angular velocity play a crucial role in the emergence of the helical swimming of the droplet.

cond-mat.soft↗