Searcharxiv⌕ Search

arXiv subjects

Jie Wang

Publications and source records attributed to Jie Wang.

At least 235 records · Page 13Linked to original sources

ZeroMimic: Distilling Robotic Manipulation Skills from Web Videos

Many recent advances in robotic manipulation have come through imitation learning, yet these rely largely on mimicking a particularly hard-to-acquire form of demonstrations: those collected on the same robot in the same room with the same objects as the trained policy must handle at test time. In contrast, large pre-recorded human video datasets demonstrating manipulation skills in-the-wild already exist, which contain valuable information for robots. Is it possible to distill a repository of useful robotic skill policies out of such data without any additional requirements on robot-specific demonstrations or exploration? We present the first such system ZeroMimic, that generates immediately deployable image goal-conditioned skill policies for several common categories of manipulation tasks (opening, closing, pouring, pick&place, cutting, and stirring) each capable of acting upon diverse objects and across diverse unseen task setups. ZeroMimic is carefully designed to exploit recent advances in semantic and geometric visual understanding of human videos, together with modern grasp affordance detectors and imitation policy classes. After training ZeroMimic on the popular EpicKitchens dataset of ego-centric human videos, we evaluate its out-of-the-box performance in varied real-world and simulated kitchen settings with two different robot embodiments, demonstrating its impressive abilities to handle these varied tasks. To enable plug-and-play reuse of ZeroMimic policies on other task setups and robots, we release software and policy checkpoints of our skill policies.

cs.RO↗

The HI Mass Function of the Local Universe: Combining Measurements from HIPASS, ALFALFA and FASHI

We present the first HI mass function (HIMF) measurement for the recent FAST All Sky HI (FASHI) survey and the most complete measurements of HIMF in the local universe thus far. We obtained these results by combining the HI catalogues from HI Parkes All Sky Survey (HIPASS), Arecibo Legacy Fast ALFA (ALFALFA) and FASHI surveys at redshift 0 < z < 0.05, covering 76% of the entire sky. We adopted the same methods to estimate the distances, calculate the sample completeness, and determine the HIMF for all three surveys. The best-fit Schechter function for the total HIMF shows a low-mass slope parameter of alpha = -1.30 and a knee mass log(Ms) = 9.86, along with a normalisation of phi_s = 0.00658. This gives us the cosmic HI abundance: omega_HI= 0.000454. We find that a double Schechter function with the same slope alpha better describes our HIMF, where the two different knee masses are log(Ms1) = 9.96 and log(Ms2) = 9.65. We verify that the measured HIMF is marginally affected by the choice of distance estimates. The effect of cosmic variance is significantly suppressed by combining the three surveys and this provides a unique opportunity to obtain an unbiased estimate of the HIMF in the Local Universe.

astro-ph.GA↗

Sinkhorn Distributionally Robust Optimization

We study distributionally robust optimization with Sinkhorn distance -- a variant of Wasserstein distance based on entropic regularization. We derive a convex programming dual reformulation for general nominal distributions, transport costs, and loss functions. To solve the dual reformulation, we develop a stochastic mirror descent algorithm with biased subgradient estimators and derive its computational complexity guarantees. Finally, we provide numerical examples using synthetic and real data to demonstrate its superior performance.

math.OC↗

WLB-LLM: Workload-Balanced 4D Parallelism for Large Language Model Training

In this work, we present WLB-LLM, a workLoad-balanced 4D parallelism for large language model training. We first thoroughly analyze the workload imbalance issue in LLM training and identify two primary sources of imbalance at the pipeline parallelism and context parallelism levels. Then, to address the imbalance issue, at the pipeline parallelism level, WLB-LLM incorporates a workload-aware variable-length document packing method to balance the computation and communication workload across micro-batches. Additionally, at the context parallelism level, WLB-LLM introduces a novel fine-grained per-document sharding strategy, ensuring each worker within a context parallelism group has an identical workload. Comprehensive experiments under different model scales demonstrate that WLB-LLM significantly mitigates the workload imbalance during 4D parallelism LLM training and achieves an average speedup of 1.23x when applying WLB-LLM in our internal LLM training framework.

cs.DC↗

R$^2$: A LLM Based Novel-to-Screenplay Generation Framework with Causal Plot Graphs

Automatically adapting novels into screenplays is important for the TV, film, or opera industries to promote products with low costs. The strong performances of large language models (LLMs) in long-text generation call us to propose a LLM based framework Reader-Rewriter (R$^2$) for this task. However, there are two fundamental challenges here. First, the LLM hallucinations may cause inconsistent plot extraction and screenplay generation. Second, the causality-embedded plot lines should be effectively extracted for coherent rewriting. Therefore, two corresponding tactics are proposed: 1) A hallucination-aware refinement method (HAR) to iteratively discover and eliminate the affections of hallucinations; and 2) a causal plot-graph construction method (CPC) based on a greedy cycle-breaking algorithm to efficiently construct plot lines with event causalities. Recruiting those efficient techniques, R$^2$ utilizes two modules to mimic the human screenplay rewriting process: The Reader module adopts a sliding window and CPC to build the causal plot graphs, while the Rewriter module generates first the scene outlines based on the graphs and then the screenplays. HAR is integrated into both modules for accurate inferences of LLMs. Experimental results demonstrate the superiority of R$^2$, which substantially outperforms three existing approaches (51.3%, 22.6%, and 57.1% absolute increases) in pairwise comparison at the overall win rate for GPT-4o.

cs.AI↗

LMC: Fast Training of GNNs via Subgraph Sampling with Provable Convergence

The message passing-based graph neural networks (GNNs) have achieved great success in many real-world applications. However, training GNNs on large-scale graphs suffers from the well-known neighbor explosion problem, i.e., the exponentially increasing dependencies of nodes with the number of message passing layers. Subgraph-wise sampling methods -- a promising class of mini-batch training techniques -- discard messages outside the mini-batches in backward passes to avoid the neighbor explosion problem at the expense of gradient estimation accuracy. This poses significant challenges to their convergence analysis and convergence speeds, which seriously limits their reliable real-world applications. To address this challenge, we propose a novel subgraph-wise sampling method with a convergence guarantee, namely Local Message Compensation (LMC). To the best of our knowledge, LMC is the {\it first} subgraph-wise sampling method with provable convergence. The key idea of LMC is to retrieve the discarded messages in backward passes based on a message passing formulation of backward passes. By efficient and effective compensations for the discarded messages in both forward and backward passes, LMC computes accurate mini-batch gradients and thus accelerates convergence. We further show that LMC converges to first-order stationary points of GNNs. Experiments on large-scale benchmark tasks demonstrate that LMC significantly outperforms state-of-the-art subgraph-wise sampling methods in terms of efficiency.

cs.LG↗

Surgical-LVLM: Learning to Adapt Large Vision-Language Model for Grounded Visual Question Answering in Robotic Surgery

Recent advancements in Surgical Visual Question Answering (Surgical-VQA) and related region grounding have shown great promise for robotic and medical applications, addressing the critical need for automated methods in personalized surgical mentorship. However, existing models primarily provide simple structured answers and struggle with complex scenarios due to their limited capability in recognizing long-range dependencies and aligning multimodal information. In this paper, we introduce Surgical-LVLM, a novel personalized large vision-language model tailored for complex surgical scenarios. Leveraging the pre-trained large vision-language model and specialized Visual Perception LoRA (VP-LoRA) blocks, our model excels in understanding complex visual-language tasks within surgical contexts. In addressing the visual grounding task, we propose the Token-Interaction (TIT) module, which strengthens the interaction between the grounding module and the language responses of the Large Visual Language Model (LVLM) after projecting them into the latent space. We demonstrate the effectiveness of Surgical-LVLM on several benchmarks, including EndoVis-17-VQLA, EndoVis-18-VQLA, and a newly introduced EndoVis Conversations dataset, which sets new performance standards. Our work contributes to advancing the field of automated surgical mentorship by providing a context-aware solution.

cs.CV↗

Privacy Law Enforcement Under Centralized Governance: A Qualitative Analysis of Four Years' Special Privacy Rectification Campaigns

In recent years, major privacy laws like the GDPR have brought about positive changes. However, challenges remain in enforcing the laws, particularly due to under-resourced regulators facing a large number of potential privacy-violating software applications (apps) and the high costs of investigating them. Since 2019, China has launched a series of privacy enforcement campaigns known as Special Privacy Rectification Campaigns (SPRCs) to address widespread privacy violations in its mobile application (app) ecosystem. Unlike the enforcement of the GDPR, SPRCs are characterized by large-scale privacy reviews and strict sanctions, under the strong control of central authorities. In SPRCs, central government authorities issue administrative orders to mobilize various resources for market-wide privacy reviews of mobile apps. They enforce strict sanctions by requiring privacy-violating apps to rectify issues within a short timeframe or face removal from app stores. While there are a few reports on SPRCs, the effectiveness and potential problems of this campaign-style privacy enforcement approach remain unclear to the community. In this study, we conducted 18 semi-structured interviews with app-related engineers involved in SPRCs to better understand the campaign-style privacy enforcement. Based on the interviews, we reported our findings on a variety of aspects of SPRCs, such as the processes that app engineers regularly follow to achieve privacy compliance in SPRCs, the challenges they encounter, the solutions they adopt to address these challenges, and the impacts of SPRCs, etc. We found that app engineers face a series of challenges in achieving privacy compliance in their apps...

cs.HC↗

Formation of the dark-matter deficient S0 galaxy NGC 4111 under the tidal interactions

We present the high-sensitivity and large-scale atomic hydrogen (HI) observations towards lenticular (S0) galaxy NGC 4111 using the Five-hundred-meter Aperture Spherical Radio Telescope (FAST). The column density map shows that NGC4111 and seven other different types of galaxies share a huge HI gas complex. The data also suggest that NGC 4111 is interacting with seven galaxies. Moreover, we identified a rotating gas disk associated with NGC 4111 from the HI complex. Still, the HI disk rotation direction has deviated from its stellar disk about 34.2$^{\circ}$, indicating that the NGC 4111 galaxy is undergoing a transition from a spiral galaxy to an S0 galaxy by the tidal interactions. The obtained dark matter-to-stellar mass ratio of NGC4111 is 3.1$\pm$0.7, which is lower than the average value of the Local Universe, implying that the interactions may strip its dark matter. Our results suggest that in a galaxy group environment, tidal interactions have a significant effect on galaxy features.

astro-ph.GA↗

Apollo-MILP: An Alternating Prediction-Correction Neural Solving Framework for Mixed-Integer Linear Programming

Leveraging machine learning (ML) to predict an initial solution for mixed-integer linear programming (MILP) has gained considerable popularity in recent years. These methods predict a solution and fix a subset of variables to reduce the problem dimension. Then, they solve the reduced problem to obtain the final solutions. However, directly fixing variable values can lead to low-quality solutions or even infeasible reduced problems if the predicted solution is not accurate enough. To address this challenge, we propose an Alternating prediction-correction neural solving framework (Apollo-MILP) that can identify and select accurate and reliable predicted values to fix. In each iteration, Apollo-MILP conducts a prediction step for the unfixed variables, followed by a correction step to obtain an improved solution (called reference solution) through a trust-region search. By incorporating the predicted and reference solutions, we introduce a novel Uncertainty-based Error upper BOund (UEBO) to evaluate the uncertainty of the predicted values and fix those with high confidence. A notable feature of Apollo-MILP is the superior ability for problem reduction while preserving optimality, leading to high-quality final solutions. Experiments on commonly used benchmarks demonstrate that our proposed Apollo-MILP significantly outperforms other ML-based approaches in terms of solution quality, achieving over a 50% reduction in the solution gap.

cs.LG↗

Air-stable lithiation engineering of $\mathrm{MoS}_{2}$ for direct-bandgap multilayers

Due to its sizable direct bandgap and strong light-matter interactions, the preparation of monolayer $\mathrm{MoS}_{2}$ has attracted significant attention and intensive research efforts. However, multilayer $\mathrm{MoS}_{2}$ is largely overlooked because of its optically inactive indirect bandgap caused by interlayer coupling. It is highly desirable to modulate and decrease the interlayer coupling so that each layer in multilayer $\mathrm{MoS}_{2}$ can exhibit a monolayer-like direct-gap behavior. Here, we demonstrate the nanoprobe fabrication of $\mathrm{Li}_{x}\mathrm{MoS}_{2}$-based multilayers exhibiting a direct bandgap and strong photoluminescence emission from tightly bound excitons and trions. The fabrication is facilitated by our newly developed Li-ion platform, featuring tip-induced Li intercalation, air stability and rewritability. Raman characterizations reveal that controlled Li intercalation effectively transforms multilayer $\mathrm{MoS}_{2}$ into the stack of multiple monolayers, leading to a 26-fold enhancement of photoluminescence, compared to a monolayer. This intercalation result is different from existing observations of transforming $\mathrm{MoS}_{2}$ multilayers into metallic phases.

cond-mat.mes-hall↗

Accurate and Scalable Graph Neural Networks via Message Invariance

Message passing-based graph neural networks (GNNs) have achieved great success in many real-world applications. For a sampled mini-batch of target nodes, the message passing process is divided into two parts: message passing between nodes within the batch (MP-IB) and message passing from nodes outside the batch to those within it (MP-OB). However, MP-OB recursively relies on higher-order out-of-batch neighbors, leading to an exponentially growing computational cost with respect to the number of layers. Due to the neighbor explosion, the whole message passing stores most nodes and edges on the GPU such that many GNNs are infeasible to large-scale graphs. To address this challenge, we propose an accurate and fast mini-batch approach for large graph transductive learning, namely topological compensation (TOP), which obtains the outputs of the whole message passing solely through MP-IB, without the costly MP-OB. The major pillar of TOP is a novel concept of message invariance, which defines message-invariant transformations to convert costly MP-OB into fast MP-IB. This ensures that the modified MP-IB has the same output as the whole message passing. Experiments demonstrate that TOP is significantly faster than existing mini-batch methods by order of magnitude on vast graphs (millions of nodes and billions of edges) with limited accuracy degradation.

cs.LG↗

FEASTS Combined with Interferometry (IV): Mapping HI Emission to a limit of $N_{\text{HI}}=10^{17.7} \text{cm}^{-2}$ in Seven Edge-on Galaxies

We present a statistical study of the neutral atomic hydrogen (HI) gas extending into the circumgalactic medium perpendicular to the disk for 7 edge-on galaxies with inclinations above $85^{\circ}$ from the FEASTS program with a $3σ$ ($20\,\text{km}\,\text{s}^{-1}$) column density ($N_{\text{HI}}$) depth of $5\times10^{17} \text{cm}^{-2}$. We develop two photometric methods to separate the extraplanar HI from the disk component, based on existing interferometric data and parametric modeling of the disk flux distribution respectively. With both methods, the FEASTS data exhibit clear extended wings beyond the disk along the minor axis. The extraplanar HI accounts for 5% to 20% of the total HI mass and extends to $20\text{-}50$ kpc at $N_{\text{HI}}=10^{18} \text{cm}^{-2}$. We find a tight positive correlation between vertical extensions of the extraplanar HI and total HI mass $M_\text{HI}$. The iso-density shape of HI at $N_{\text{HI}}=10^{18} \text{cm}^{-2}$ has an average axis ratio of $0.56\pm0.11$. The off-disk $N_{\text{HI}}$ profiles of these edge-on galaxies well represent the lower envelop of previous Lyman-$α$ absorption measurements at low-redshift. Our results suggest that at $N_{\text{HI}}=5\times10^{17} \text{cm}^{-2}$, the HI extends considerably further than the known thin and thick disks in the vertical direction, but still remains much flattener than a spherical distribution, consistent with theoretical expectations that outflow, circulation, and accretion should have different impacts in these two directions. We show the tension of our results with Illustris and TNG predictions, highlighting the constraining power of our results for future simulations.

astro-ph.GA↗

Higher Landau-Level Analogs and Signatures of Non-Abelian States in Twisted Bilayer MoTe$_2$

Recent experimental discovery of fractional Chern insulators at zero magnetic field in moiré superlattices has sparked intense interests in bringing Landau level physics to flat Chern bands. In twisted MoTe$_2$ bilayers (tMoTe$_2$), recent theoretical and experimental studies have found three consecutive flat Chern bands at twist angle $\sim 2^\circ$. In this work, we investigate whether higher Landau level physics can be found in these consecutive Chern bands. At twist angles $2.00^\circ$ and $1.89^\circ$, we identify four consecutive $C = 1$ bands for the $K$ valley in tMoTe$_2$. By constructing Wannier functions directly from density functional theory (DFT) calculations, a six-orbital model is developed to describe the consecutive Chern bands, with the orbitals forming a honeycomb lattice. Exact diagonalization on top of Hartree-Fock calculations are carried out with the Wannier functions. Especially, when the second moiré miniband is half-filled, signatures of non-Abelian states are found. Our Wannier-based approach in modelling moiré superlattices is faithful to DFT wave functions and can serve as benchmarks for continuum models. The possibility of realizing non-Abelian anyons at zero magnetic field also opens up a new pathway for fault-tolerant quantum information processing.

cond-mat.str-el↗

The FAST HI 21-cm absorption blind survey. II. -- Statistic Exploration for Associated and Intervening systems

We present an extragalactic HI 21-cm absorption lines catalog from a blind search at z $\leqslant$ 0.35, using drift-scan data collected in 1325.6 hours by the ongoing Commensal Radio Astronomy FasT Survey (CRAFTS) and FAST All Sky HI Survey (FASHI), which spans a sky area of 6072.0 deg$^{2}$ and covers 84533 radio sources with a flux density greater than 12 mJy. 14 previously identified HI absorbers and 20 newly discovered HI absorbers were detected, comprising 15 associated systems, 10 intervening systems, and 9 systems with undetermined classifications. Through spectral stacking, the mean peak optical path, mean velocity-integrated optical path, mean FWHM and mean HI column density are measured to be 0.47 and 0.30; 27.19 and 4.36 km s$^{-1}$; 42.61 and 9.33 km s$^{-1}$; 0.49 and 0.08 T$_{s} \times$ 10$^{20}$cm$^{-2}$K$^{-1}$, for the associated and intervening samples, respectively. Statistical analysis also reveals that associated systems tend to be hosted by red ($g-r>$0.7) galaxies at lower redshifts, whereas galaxies hosting intervening HI absorption are typically found at higher redshifts and are of a bluer ($g-r\leqslant$0.7) type. A noticeable difference is observed in the positions of foregrounds, backgrounds of intervening systems, and high-redshift and low-redshift associated systems on the WISE color-color diagram. All identified foreground sources in our sample have W1-W2 magnitudes below 0.8, suggesting no Active Galactic Nuclei (AGN). In contrast, backgrounds of intervening systems tend to have W1-W2 magnitudes above 0.8, indicating AGN presence. For associated absorption, most low-redshift ($z\leqslant$0.5) systems show W1-W2 values below 0.8, while higher-redshift associated absorption ($z>$0.5) displays a broader range of W1-W2 values.

astro-ph.GA↗

New Calculations of the Turbulence-Turbulence Contribution to the Wind Noise Pressure Spectra within Homogeneous Anisotropic Turbulence

The turbulence-turbulence interaction and the turbulence-shear interaction are the sources of intrinsic pressure fluctuation for wind noise generated by atmospheric turbulence. In previous research [Yu et al., J. Acoust. Soc. Am. 129(2), 622-632 (2011)], it was shown that the measured turbulent fields outdoors can be realistically modeled with Kraichnan's mirror flow model [Kraichnan, J. Acoust. Soc. Am. 28(3), 378-390 (1956)]. This paper applies Kraichnan's mirror flow idea to develop theory for calculating the turbulence-turbulence interaction wind noise pressure spectra within homogeneous anisotropic turbulence. New calculations of the turbulence-turbulence contribution to the wind noise pressure spectra by incorporating turbulence anisotropy are performed and compared to the result using the same approach but with isotropic input and the result of the turbulence-turbulence interaction pressure spectrum for homogeneous isotropic turbulence using George et al.'s method [George et al., J. Fluid Mech. 148, 155-191 (1984)]. We also evaluated different contributions to the turbulence-turbulence interaction pressure spectra using our approach with both anisotropic and isotropic inputs. Our results indicate that the turbulence anisotropy has small effect on the turbulence-turbulence interaction pressure in source region, but changes the spectral slope in inertial region to about -5/3. The turbulence-turbulence interaction pressure spectrum incorporating turbulence anisotropy is not sensitive to height. The F33F33 term and the F11F11 term are the most dominant contributions to the anisotropic turbulence pressure spectra in the source region and inertial region, respectively.

physics.flu-dyn↗

Molecular optomechanically-induced transparency

Molecular cavity optomechanics (COM), characterized by remarkably efficient optomechanical coupling enabled by a highly localized light field and ultra-small effective mode volume, holds significant promise for advancing applications in quantum science and technology. Here, we study optomechanically induced transparency and the associated group delay in a hybrid molecular COM system. We find that even with an extremely low optical quality factor, an obvious transparency window can appear, which is otherwise unattainable in a conventional COM system. Furthermore, by varying the ports of the probe light, the optomechanically induced transparency or absorption can be achieved, along with corresponding slowing or advancing of optical signals. These results indicate that our scheme provides a new method for adjusting the storage and retrieval of optical signals in such a molecular COM device.

physics.optics↗

A refined lower bound theorem for $d$-polytopes with at most $2d$ vertices

In 1967, Grünbaum conjectured that the function $$ ϕ_k(d+s,d):=\binom{d+1}{k+1}+\binom{d}{k+1}-\binom{d+1-s}{k+1},\; \text{for $2\le s\le d$} $$ provides the minimum number of $k$-faces for a $d$-dimensional polytope (abbreviated as a $d$-polytope) with $d+s$ vertices. In 2021, Xue proved this conjecture for each $k\in[1\ldots d-2]$ and characterised the unique minimisers, each having $d+2$ facets. In this paper, we refine Xue's theorem by considering $d$-polytopes with $d+s$ vertices ($2\le s\le d$) and at least $d+3$ facets. If $s=2$, then there is precisely one minimiser for many values of $k$. For other values of $s$, the number of $k$-faces is at least $ϕ_k(d+s,d)+\binom{d-1}{k}-\binom{d+1-s}{k}$, which is met by precisely two polytopes in many cases, and up to five polytopes for certain values of $s$ and $k$. We also characterise the minimising polytopes.

math.CO↗