SearcharxivSearch

arXiv subjects

Ziyi Tian

Publications and source records attributed to Ziyi Tian.

3 recordsLinked to original sources

FalconFS: Distributed File System for Large-Scale Deep Learning Pipeline

Client-side metadata caching has long been considered an effective method for accelerating metadata operations in distributed file systems (DFSs). However, we have found that client-side state (e.g., caching) is not only ineffective but also consumes valuable memory resources in the deep learning pipelines. We thus propose FalconFS, a DFS optimized for deep learning pipelines with the stateless-client architecture. Specifically, instead of performing client-side path resolution and caching, FalconFS efficiently resolves paths on the server side using hybrid metadata indexing and lazy namespace replication. FalconFS also boosts server concurrency with concurrent request merging and provides easy deployment with VFS shortcut. Evaluations against CephFS and Lustre show that FalconFS achieves up to 5.72$\times$ throughput for small file read/write and up to 12.81$\times$ throughput for deep learning model training. FalconFS has been running in Huawei autonomous driving system's production environment with 10,000 NPUs for one year and has been open-sourced.

cs.DC

SwitchFS: Asynchronous Metadata Updates for Distributed Filesystems with In-Network Coordination

Distributed filesystem metadata updates are typically synchronous. This creates inherent challenges for access efficiency, load balancing, and directory contention, especially under dynamic and skewed workloads. This paper argues that synchronous updates are overly conservative. We propose SwitchFS with asynchronous metadata updates that allow operations to return early and defer directory updates until reads, both hiding latency and amortizing overhead. The key challenge lies in efficiently maintaining the synchronous POSIX semantics of metadata updates. To address this, SwitchFS is co-designed with a programmable switch, leveraging the limited on-switch resources to track directory states with negligible overhead. This allows SwitchFS to aggregate and apply delayed updates efficiently, using batching and consolidation before directory reads. Evaluation shows that SwitchFS achieves up to 13.34$\times$ and 3.85$\times$ higher throughput, and 61.6% and 57.3% lower latency than two state-of-the-art distributed filesystems, Emulated-InfiniFS and Emulated-CFS, respectively, under skewed workloads. For real-world workloads, SwitchFS improves end-to-end throughput by 21.1$\times$, 1.1$\times$, and 0.3$\times$ over CephFS, Emulated-InfiniFS, and Emulated-CFS, respectively.

cs.DC

Signature of gate tunable superconducting network in twisted bilayer graphene

Twisted van der Waals materials provide a tunable platform for investigating two-dimensional superconductivity and quantum phases. Using spectra-imaging scanning tunneling microscopy, we study the superconducting states in twisted bilayer graphene and track their evolution from insulating phases. Gate-dependent spectroscopic measurements reveal two distinct regimes: under-doped (ν = -2.3) and optimally doped (ν = -2.6). In the under-doped regime, partial superconductivity arises, forming a network interspersed with non-gapped regions. At optimal doping, the entire unit cell demonstrates superconductivity, with gap size modulation showing an anti-correlation with the local density of states. This gate-dependent transition from an insulating phase to a modulated superconductor uncovers an unexpected spatial hierarchy in pairing behavior and offers direct microscopic insights to constrain theories of superconductivity in moiré systems.

cond-mat.supr-con