arXiv subjects

Mo Li

Publications and source records attributed to Mo Li.

At least 55 records · Page 3Linked to original sources

arXiv2025

Babel: A Scalable Pre-trained Model for Multi-Modal Sensing via Expandable Modality Alignment

This paper presents Babel, the expandable modality alignment model, specially designed for multi-modal sensing. While there has been considerable work on multi-modality alignment, they all struggle to effectively incorporate multiple sensing modalities due to the data scarcity constraints. How to utilize multi-modal data with partial pairings in sensing remains an unresolved challenge. Babel tackles this challenge by introducing the concept of expandable modality alignment. The key idea involves transforming the N-modality alignment into a series of binary-modality alignments. Novel techniques are also proposed to further mitigate data scarcity issue and balance the contribution of the newly incorporated modality with the previously established modality alignment during the expandable alignment process. We provide the comprehensive implementation. In the pre-training phase, Babel currently aligns 6 sensing modalities, namely Wi-Fi, mmWave, IMU, LiDAR, video, and depth. For the deployment phase, as a foundation model, any single or combination of aligned modalities could be selected from Babel and applied to downstream tasks. Evaluation demonstrates Babel's outstanding performance on eight human activity recognition datasets, compared to a broad range of baselines e.g., the SOTA single-modal sensing networks, multi-modal sensing framework, and multi-modal large language models. Babel not only improves the performance of individual modality sensing (12% averaged accuracy improvement), but also effectively fuses multiple available modalities (up to 22% accuracy increase). Case studies also highlight emerging application scenarios empowered by Babel, including cross-modality retrieval (i.e., sensing imaging), and bridging LLM for sensing comprehension.

cs.AI↗

arXiv2025

SelfReplay: Adapting Self-Supervised Sensory Models via Adaptive Meta-Task Replay

Self-supervised learning has emerged as a method for utilizing massive unlabeled data for pre-training models, providing an effective feature extractor for various mobile sensing applications. However, when deployed to end-users, these models encounter significant domain shifts attributed to user diversity. We investigate the performance degradation that occurs when self-supervised models are fine-tuned in heterogeneous domains. To address the issue, we propose SelfReplay, a few-shot domain adaptation framework for personalizing self-supervised models. SelfReplay proposes self-supervised meta-learning for initial model pre-training, followed by a user-side model adaptation by replaying the self-supervision with user-specific data. This allows models to adjust their pre-trained representations to the user with only a few samples. Evaluation with four benchmarks demonstrates that SelfReplay outperforms existing baselines by an average F1-score of 8.8%p. Our on-device computational overhead analysis on a commodity off-the-shelf (COTS) smartphone shows that SelfReplay completes adaptation within an unobtrusive latency (in three minutes) with only a 9.54% memory consumption, demonstrating the computational efficiency of the proposed method.

eess.SP↗

arXiv2025

AutoIOT: LLM-Driven Automated Natural Language Programming for AIoT Applications

The advent of Large Language Models (LLMs) has profoundly transformed our lives, revolutionizing interactions with AI and lowering the barrier to AI usage. While LLMs are primarily designed for natural language interaction, the extensive embedded knowledge empowers them to comprehend digital sensor data. This capability enables LLMs to engage with the physical world through IoT sensors and actuators, performing a myriad of AIoT tasks. Consequently, this evolution triggers a paradigm shift in conventional AIoT application development, democratizing its accessibility to all by facilitating the design and development of AIoT applications via natural language. However, some limitations need to be addressed to unlock the full potential of LLMs in AIoT application development. First, existing solutions often require transferring raw sensor data to LLM servers, which raises privacy concerns, incurs high query fees, and is limited by token size. Moreover, the reasoning processes of LLMs are opaque to users, making it difficult to verify the robustness and correctness of inference results. This paper introduces AutoIOT, an LLM-based automated program generator for AIoT applications. AutoIOT enables users to specify their requirements using natural language (input) and automatically synthesizes interpretable programs with documentation (output). AutoIOT automates the iterative optimization to enhance the quality of generated code with minimum user involvement. AutoIOT not only makes the execution of AIoT tasks more explainable but also mitigates privacy concerns and reduces token costs with local execution of synthesized programs. Extensive experiments and user studies demonstrate AutoIOT's remarkable capability in program synthesis for various AIoT tasks. The synthesized programs can match and even outperform some representative baselines.

cs.CL↗

arXiv2025

Expand Heterogeneous Learning Systems with Selective Multi-Source Knowledge Fusion

Expanding existing learning systems to provide high-quality customized models for more domains, such as new users, is challenged by the limited labeled data and the data and device heterogeneities. While knowledge distillation methods could overcome label scarcity and device heterogeneity, they assume the teachers are fully reliable and overlook the data heterogeneity, which prevents the direct adoption of existing models. To address this problem, this paper proposes a framework, HaT, to expand learning systems. It first selects multiple high-quality models from the system at a low cost and then fuses their knowledge by assigning sample-wise weights to their predictions. Later, the fused knowledge is selectively injected into the customized models based on the knowledge quality. Extensive experiments on different tasks, modalities, and settings show that HaT outperforms state-of-the-art baselines by up to 16.5% accuracy and saves up to 39% communication traffic.

cs.AI↗

arXiv2025

Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement

The quality of Supervised Fine-Tuning (SFT) data plays a critical role in enhancing the conversational capabilities of Large Language Models (LLMs). However, as LLMs become more advanced, the availability of high-quality human-annotated SFT data has become a significant bottleneck, necessitating a greater reliance on synthetic training data. In this work, we introduce Condor, a novel two-stage synthetic data generation framework that incorporates World Knowledge Tree and Self-Reflection Refinement to produce high-quality SFT data at scale. Our experimental results demonstrate that a base model fine-tuned on only 20K Condor-generated samples achieves superior performance compared to counterparts. The additional refinement stage in Condor further enables iterative self-improvement for LLMs at various scales (up to 72B), validating the effectiveness of our approach. Furthermore, our investigation into the scaling for synthetic data in post-training reveals substantial unexplored potential for performance improvements, opening promising avenues for future research.

cs.CL↗

arXiv2025

Roadmap on Neuromorphic Photonics

This roadmap consolidates recent advances while exploring emerging applications, reflecting the remarkable diversity of hardware platforms, neuromorphic concepts, and implementation philosophies reported in the field. It emphasizes the critical role of cross-disciplinary collaboration in this rapidly evolving field.

cs.ET↗

arXiv2024

Origin of Pressure-Induced Structural Instability in CsPbX$_3$ Photovoltaic Perovskites

Under external stimuli, lead halide perovskites exhibit large atomic fluctuations, impacting optical and electron transport properties that affect device performance in operational settings. However, a thorough understanding of the atomic basis for the underlying structural instability is still absent. Focusing on the model material CsPbBr$_3$, the inherent lattice softness of halide perovskites is elucidated at the atomic level through in-situ single-crystal X-ray diffraction measurements under pressure complemented by atomic level simulations. We identify and explore the nature of the first-order phase transition to a distorted P21/c phase at 1.3 GPa, induced by the sudden Cs-Br bonds breaking. Unlike classical transition metal oxide perovskites, where the internal energy term dominates, we show explicitly that pressure primarily influences the Gibbs free energy for halide perovskites through the pressure-volume term. As such, strategically mitigating bond strains from volume shrinkage is the key to suppressing the first-order behavior for maintaining the coordinates of PbX$_6$ polyhedral upon external perturbation. Our thermodynamic calculation reveals the demand for high entropy in the -T*del-S term, which can be achieved by exploring a broader spectrum of doped A site and B sites in ABX$_3$ systems, enabling continuous structural changes that facilitate recovery from mechanical damage in practical applications.

cond-mat.mtrl-sci↗

arXiv2024

AutoLife: Automatic Life Journaling with Smartphones and LLMs

This paper introduces a novel mobile sensing application - life journaling - designed to generate semantic descriptions of users' daily lives. We present AutoLife, an automatic life journaling system based on commercial smartphones. AutoLife only inputs low-cost sensor data (without photos or audio) from smartphones and can automatically generate comprehensive life journals for users. To achieve this, we first derive time, motion, and location contexts from multimodal sensor data, and harness the zero-shot capabilities of Large Language Models (LLMs), enriched with commonsense knowledge about human lives, to interpret diverse contexts and generate life journals. To manage the task complexity and long sensing duration, a multilayer framework is proposed, which decomposes tasks and seamlessly integrates LLMs with other techniques for life journaling. This study establishes a real-life dataset as a benchmark and extensive experiment results demonstrate that AutoLife produces accurate and reliable life journals.

cs.AI↗

arXiv2024

Non-volatile Tuning of Cryogenic Optical Resonators

Quantum computing, ultra-low-noise sensing, and high-energy physics experiments often rely on superconducting circuits or semiconductor qubits and devices operating at deep cryogenic temperatures (4K and below). Photonic integrated circuits and interconnects have been demonstrated for scalable communications and optical domain transduction in these systems. Due to energy and area constraints, many of these devices need enhanced light-matter interaction, provided by photonic resonators. A key challenge, however, for using these resonators is the sensitivity of resonance wavelength to process variations and thermal fluctuations. While thermo-optical tuning methods are typically employed at room temperature to mitigate this problem, the thermo-optic effect is ineffective at 4K. To address this issue, we demonstrate a non-volatile approach to tune the resonance of photonic resonators using integrated phase-change materials (PCMs) at cryogenic temperatures. In this work, we report a 10Gb/s free-carrier dispersion based resonant photonic modulator that can be tuned in a non-volatile fashion at sub-4K temperatures using a commercial silicon photonics process. This method paves the way for realizing scalable cryogenic integrated photonics with thousands of resonant devices for quantum and high-energy physics applications.

physics.optics↗

arXiv2024

Hamster: A Fast Synchronous Byzantine Fault Tolerance Protocol

This paper introduces Hamster, a novel synchronous Byzantine Fault Tolerance protocol that achieves better performance and has weaker dependency on synchrony. Specifically, Hamster employs coding techniques to significantly decrease communication complexity and addresses coding related security issues. Consequently, Hamster achieves a throughput gain that increases linearly with the number of nodes, compared to Sync HotStuff. By adjusting the block size, Hamster outperforms Sync HotStuff in terms of both throughput and latency. Moreover, With minor modifications, Hamster can also function effectively in mobile sluggish environments, further reducing its dependency on strict synchrony. We implement Hamster and the experimental results demonstrate its performance advantages. Specifically, Hamster's throughput in a network of $9$ nodes is $2.5\times$ that of Sync HotStuff, and this gain increases to $10$ as the network scales to $65$ nodes.

cs.DC↗

arXiv2024

Optical multi-beam steering and communication using integrated acousto-optics arrays

Optical beam steering enables optical detection and imaging in macroscopic or microscopic scales and long-range communication over free space. It underpins numerous optical applications, including LiDAR, biomedical imaging, and remote sensing. Despite the inherent speed of light, advanced applications increasingly require the ability to steer multiple beams simultaneously to increase imaging throughput, boost communication bandwidth, and control arrays qubits for scalable quantum computing. Therefore, there is a significant demand for non-mechanical, integrated, and scalable multi-beam steering technology. Here, we report a scalable multi-beam steering system comprising an array of acousto-optic beam steering channels and photonic integrated circuits on a thin-film lithium niobate platform. Each channel generates tens of individually controllable beams of visible wavelength by exciting acoustic waves using digitally synthesized multi-tone microwave signals. We demonstrate the system's capabilities through multi-input, multi-output free-space communications, simultaneously transmitting to multiple receivers at megabits/sec data rates. This technology can be readily scaled up to steer hundreds of optical beams from a compact chip, potentially advancing many areas of optical technologies and enabling novel applications.

physics.optics↗

arXiv2024

Reconfigurable inverse designed phase-change photonics

Chalcogenide phase-change materials (PCMs) offer a promising approach to programmable photonics thanks to their nonvolatile, reversible phase transitions and high refractive index contrast. However, conventional designs are limited by global phase control over entire PCM thin films between fully amorphous and fully crystalline states, which restricts device functionality and confines design flexibility and programmability. In this work, we present a novel approach that leverages pixel-level control of PCM in inverse-designed photonic devices, enabling highly reconfigurable, multi-functional operations. We integrate low-loss Sb2Se3 onto a multi-mode interferometer (MMI) and achieve precise, localized phase manipulation through direct laser writing. This technique allows for flexible programming of the photonic device by adjusting the PCM phase pattern rather than relying on global phase states, thereby enhancing device adaptability. As a proof of concept, we programmed the device as a wavelength-division multiplexer and subsequently reconfigured it into a mode-division multiplexer. Our results underscore the potential of combining inverse design with pixel-wise tuning for next-generation programmable phase-change photonic systems.

physics.optics↗

arXiv2024

Penetrative AI: Making LLMs Comprehend the Physical World

Recent developments in Large Language Models (LLMs) have demonstrated their remarkable capabilities across a range of tasks. Questions, however, persist about the nature of LLMs and their potential to integrate common-sense human knowledge when performing tasks involving information about the real physical world. This paper delves into these questions by exploring how LLMs can be extended to interact with and reason about the physical world through IoT sensors and actuators, a concept that we term "Penetrative AI". The paper explores such an extension at two levels of LLMs' ability to penetrate into the physical world via the processing of sensory signals. Our preliminary findings indicate that LLMs, with ChatGPT being the representative example in our exploration, have considerable and unique proficiency in employing the embedded world knowledge for interpreting IoT sensor data and reasoning over them about tasks in the physical realm. Not only this opens up new applications for LLMs beyond traditional text-based tasks, but also enables new ways of incorporating human knowledge in cyber-physical systems.

cs.AI↗

arXiv2024

OFHE: An Electro-Optical Accelerator for Discretized TFHE

This paper presents \textit{OFHE}, an electro-optical accelerator designed to process Discretized TFHE (DTFHE) operations, which encrypt multi-bit messages and support homomorphic multiplications, lookup table operations and full-domain functional bootstrappings. While DTFHE is more efficient and versatile than other fully homomorphic encryption schemes, it requires 32-, 64-, and 128-bit polynomial multiplications, which can be time-consuming. Existing TFHE accelerators are not easily upgradable to support DTFHE operations due to limited datapaths, a lack of datapath bit-width reconfigurability, and power inefficiencies when processing FFT and inverse FFT (IFFT) kernels. Compared to prior TFHE accelerators, OFHE addresses these challenges by improving the DTFHE operation latency by 8.7\%, the DTFHE operation throughput by $57\%$, and the DTFHE operation throughput per Watt by $94\%$.

cs.CR↗

arXiv2024

Mixed polytype/polymorph formation and its effects on the electronic properties in InSe films grown by molecular beam epitaxy on GaAs(111)B

The top-down synthesis of inherently ferroelectric semiconductors and their integration with traditional material platforms have the potential to enable new low power logic devices, and to harness the bulk photoelectric effect for more efficient photovoltaic cells. InSe is a layered van der Waals compound exhibiting multiple polytypes, with semiconducting gamma-InSe revealing a non-centrosymmetric space group and showing a high carrier mobility at room temperature. Here we report the growth of InSe films on close to lattice matched semi-insulating GaAs(111)B substrates by molecular beam epitaxy (MBE). Excellent nucleation behavior resulted in the growth of smooth, single phase InSe films. The dominant polytype determined from X-ray diffraction was the targeted gamma-InSe, however Raman spectroscopy revealed spatial variations in the overall low-intensity non-centrosymmetric vibration modes. Transmission electron microscopy uncovered the presence of the three bulk polytypes beta, gamma, and epsilon-InSe coexisting in the films arranging in nanosized domains. The different polytypes can be interpreted as sequences of stacking faults and rotational twin boundaries of gamma-InSe made from individual non-centrosymmetric Se-In-In-Se layers with P-6m2 symmetry. A second, centrosymmetric Se-In-In-Se layer polymorph was identified with P-3m symmetry, which is typically not present in InSe bulk phases. First principles calculations revealed small formation energy differences between the InSe polymorphs and polytypes, yet sizeable differences in their electronic properties. Nanoscale domain sizes of varying polytypes thus resulted in sizeable electronic disorder in the grown films that dominated the electronic transport properties. Our results indicate that bottom-up thin film synthesis is a viable synthesis route towards stabilization of InSe polytypes not present in the bulk.

cond-mat.mtrl-sci↗

arXiv2024

Absence of Weyl nodes in EuCd$_2$As$_2$ revealed by the carrier density dependence of the anomalous Hall effect

The antiferromagnetic layered compound EuCd$_2$As$_2$ is widely considered as a leading candidate of ideal Weyl semimetal, featuring a single pair of Weyl nodes in its field-induced ferromagnetic (FM) state. Nevertheless, this view has recently been challenged by an optical spectroscopy study, which suggests that it is a magnetic semiconductor. In this study, we have successfully synthesized highly insulating EuCd$_2$As$_2$ crystals with carrier density reaching as low as $2\times 10^{15}$ $\text{cm}^{-3}$. The magneto-transport measurements revealed a progressive decrease of the anomalous Hall conductivity (AHC) by several orders of magnitude as the carrier density decreases. This behavior contradicts with what is expected from the intrinsic AHC generated by the Weyl points, which is independent of carrier density as the Fermi level approaches the charge neutrality point. In contrast, the scaling relationship between AHC and longitudinal conductivity aligns with the characteristics of variable range hopping insulators. Our results suggest that EuCd$_2$As$_2$ is a magnetic semiconductor rather than a topological Weyl semimetal.

cond-mat.mtrl-sci↗

arXiv2023

Construct 3D Hand Skeleton with Commercial WiFi

This paper presents HandFi, which constructs hand skeletons with practical WiFi devices. Unlike previous WiFi hand sensing systems that primarily employ predefined gestures for pattern matching, by constructing the hand skeleton, HandFi can enable a variety of downstream WiFi-based hand sensing applications in gaming, healthcare, and smart homes. Deriving the skeleton from WiFi signals is challenging, especially because the palm is a dominant reflector compared with fingers. HandFi develops a novel multi-task learning neural network with a series of customized loss functions to capture the low-level hand information from WiFi signals. During offline training, HandFi takes raw WiFi signals as input and uses the leap motion to provide supervision. During online use, only with commercial WiFi, HandFi is capable of producing 2D hand masks as well as 3D hand poses. We demonstrate that HandFi can serve as a foundation model to enable developers to build various applications such as finger tracking and sign language recognition, and outperform existing WiFi-based solutions. Artifacts can be found: https://github.com/SIJIEJI/HandFi

cs.HC↗

arXiv2023

Freeform Direct-write and Rewritable Photonic Integrated Circuits in Phase-Change Thin Films

Photonic integrated circuits (PICs) with rapid prototyping and reprogramming capabilities promise revolutionary impacts on a plethora of photonic technologies. Here, we report direct-write and rewritable photonic circuits on a low-loss phase change material (PCM) thin film. Complete end-to-end PICs are directly laser written in one step without additional fabrication processes, and any part of the circuit can be erased and rewritten, facilitating rapid design modification. We demonstrate the versatility of this technique for diverse applications, including an optical interconnect fabric for reconfigurable networking, a photonic crossbar array for optical computing, and a tunable optical filter for optical signal processing. By combining the programmability of the direct laser writing technique with PCM, our technique unlocks opportunities for programmable photonic networking, computing, and signal processing. Moreover, the rewritable photonic circuits enable rapid prototyping and testing in a convenient and cost-efficient manner, eliminate the need for nanofabrication facilities, and thus promote the proliferation of photonics research and education to a broader community.

physics.optics↗