arXiv subjects

Wei Wu

Publications and source records attributed to Wei Wu.

At least 235 records · Page 13Linked to original sources

arXiv2024

Beam shaping by nonlinear moiré metasurfaces

This paper explores the interplay of momentum transfer and nonlinear optical processes through moiré phenomena. Momentum transfer plays a crucial role in the interaction between photons and matter. Here, we study stacked metasurfaces with tailored dispersion and rotated against each other with varying twisted angles. The stacking introduces interlayer interactions, which can be controlled by the relative angle between metasurfaces, significantly enriching the resulting response compared to the single layer counterpart. By focusing on second-harmonic generation (SHG) from these twisted metasurfaces, we delve into the realm of nonlinear moiré photonics. Through experimental observations, we unveil the emergence of intricate far-field SHG radiation patterns, showing their effective tuning by varying the twisted angles. These findings offer a fresh perspective to explore nonlinear wavefront shaping through moiré phenomena, opening new avenues for nonlinear information processing, optical steering, and nonlinear optical switching.

physics.optics↗

arXiv2024

Generative Pretrained Structured Transformers: Unsupervised Syntactic Language Models at Scale

A syntactic language model (SLM) incrementally generates a sentence with its syntactic tree in a left-to-right manner. We present Generative Pretrained Structured Transformers (GPST), an unsupervised SLM at scale capable of being pre-trained from scratch on raw texts with high parallelism. GPST circumvents the limitations of previous SLMs such as relying on gold trees and sequential training. It consists of two components, a usual SLM supervised by a uni-directional language modeling loss, and an additional composition model, which induces syntactic parse trees and computes constituent representations, supervised by a bi-directional language modeling loss. We propose a representation surrogate to enable joint parallel training of the two models in a hard-EM fashion. We pre-train GPST on OpenWebText, a corpus with $9$ billion tokens, and demonstrate the superiority of GPST over GPT-2 with a comparable size in numerous tasks covering both language understanding and language generation. Meanwhile, GPST also significantly outperforms existing unsupervised SLMs on left-to-right grammar induction, while holding a substantial acceleration on training.

cs.CL↗

arXiv2024

MOSS: A Large-scale Open Microscopic Traffic Simulation System

In the research of Intelligent Transportation Systems (ITS), traffic simulation is a key procedure for the evaluation of new methods and optimization of strategies. However, existing traffic simulation systems face two challenges. First, how to balance simulation scale with realism is a dilemma. Second, it is hard to simulate realistic results, which requires realistic travel demand data and simulator. These problems limit computer-aided optimization of traffic management strategies for large-scale road networks and reduce the usability of traffic simulations in areas where real-world travel demand data are lacking. To address these problems, we design and implement MObility Simulation System (MOSS). MOSS adopts GPU acceleration to significantly improve the efficiency and scale of microscopic traffic simulation, which enables realistic and fast simulations for large-scale road networks. It provides realistic travel Origin-Destination (OD) matrices generation through a pre-trained generative neural network model based on publicly available data on a global scale, such as satellite imagery, to help researchers build meaningful travel demand data. It also provides a complete open toolchain to help users with road network construction, demand generation, simulation, and result analysis. The whole toolchain including the simulator can be accessed at https://moss.fiblab.net and the codes are open-source for community collaboration.

cs.DC↗

arXiv2024

AFDGCF: Adaptive Feature De-correlation Graph Collaborative Filtering for Recommendations

Collaborative filtering methods based on graph neural networks (GNNs) have witnessed significant success in recommender systems (RS), capitalizing on their ability to capture collaborative signals within intricate user-item relationships via message-passing mechanisms. However, these GNN-based RS inadvertently introduce excess linear correlation between user and item embeddings, contradicting the goal of providing personalized recommendations. While existing research predominantly ascribes this flaw to the over-smoothing problem, this paper underscores the critical, often overlooked role of the over-correlation issue in diminishing the effectiveness of GNN representations and subsequent recommendation performance. Up to now, the over-correlation issue remains unexplored in RS. Meanwhile, how to mitigate the impact of over-correlation while preserving collaborative filtering signals is a significant challenge. To this end, this paper aims to address the aforementioned gap by undertaking a comprehensive study of the over-correlation issue in graph collaborative filtering models. Firstly, we present empirical evidence to demonstrate the widespread prevalence of over-correlation in these models. Subsequently, we dive into a theoretical analysis which establishes a pivotal connection between the over-correlation and over-smoothing issues. Leveraging these insights, we introduce the Adaptive Feature De-correlation Graph Collaborative Filtering (AFDGCF) framework, which dynamically applies correlation penalties to the feature dimensions of the representation matrix, effectively alleviating both over-correlation and over-smoothing issues. The efficacy of the proposed framework is corroborated through extensive experiments conducted with four representative graph collaborative filtering models across four publicly available datasets.

cs.IR↗

arXiv2024

Electro-optically Modulated Nonlinear Metasurfaces

Tunable nonlinearity facilitates the creation of reconfigurable nonlinear metasurfaces, enabling innovative applications in signal processing, light switching, and sensing. This paper presents a novel approach to electrically modulate SHG from a lithium niobate (LN) metasurface, exploiting the electro-optical (EO) effect. By fabricating a nanohole array metasurface on a thin LN film and applying an electric field, we demonstrate the alteration of the material's refractive index, resulting in resonance shifts and modulation of SHG intensity at specific wavelengths. Our findings provide valuable insights for the development of electrically tunable nonlinear light sources, quantum optics, dynamic nonlinear holography, and nonlinear information processing.

physics.optics↗

arXiv2024

InstructBrush: Learning Attention-based Instruction Optimization for Image Editing

In recent years, instruction-based image editing methods have garnered significant attention in image editing. However, despite encompassing a wide range of editing priors, these methods are helpless when handling editing tasks that are challenging to accurately describe through language. We propose InstructBrush, an inversion method for instruction-based image editing methods to bridge this gap. It extracts editing effects from exemplar image pairs as editing instructions, which are further applied for image editing. Two key techniques are introduced into InstructBrush, Attention-based Instruction Optimization and Transformation-oriented Instruction Initialization, to address the limitations of the previous method in terms of inversion effects and instruction generalization. To explore the ability of instruction inversion methods to guide image editing in open scenarios, we establish a TransformationOriented Paired Benchmark (TOP-Bench), which contains a rich set of scenes and editing types. The creation of this benchmark paves the way for further exploration of instruction inversion. Quantitatively and qualitatively, our approach achieves superior performance in editing and is more semantically consistent with the target editing effects.

cs.GR↗

arXiv2024

TagAlign: Improving Vision-Language Alignment with Multi-Tag Classification

The crux of learning vision-language models is to extract semantically aligned information from visual and linguistic data. Existing attempts usually face the problem of coarse alignment, e.g., the vision encoder struggles in localizing an attribute-specified object. In this work, we propose an embarrassingly simple approach to better align image and text features with no need of additional data formats other than image-text pairs. Concretely, given an image and its paired text, we manage to parse objects (e.g., cat) and attributes (e.g., black) from the description, which are highly likely to exist in the image. It is noteworthy that the parsing pipeline is fully automatic and thus enjoys good scalability. With these parsed semantics as supervision signals, we can complement the commonly used image-text contrastive loss with the multi-tag classification loss. Extensive experimental results on a broad suite of semantic segmentation datasets substantiate the average 5.2\% improvement of our framework over existing alternatives. Furthermore, the visualization results indicate that attribute supervision makes vision-language models accurately localize attribute-specified objects. Project page can be found at https://qinying-liu.github.io/Tag-Align.

cs.CV↗

arXiv2024

HoloVIC: Large-scale Dataset and Benchmark for Multi-Sensor Holographic Intersection and Vehicle-Infrastructure Cooperative

Vehicle-to-everything (V2X) is a popular topic in the field of Autonomous Driving in recent years. Vehicle-infrastructure cooperation (VIC) becomes one of the important research area. Due to the complexity of traffic conditions such as blind spots and occlusion, it greatly limits the perception capabilities of single-view roadside sensing systems. To further enhance the accuracy of roadside perception and provide better information to the vehicle side, in this paper, we constructed holographic intersections with various layouts to build a large-scale multi-sensor holographic vehicle-infrastructure cooperation dataset, called HoloVIC. Our dataset includes 3 different types of sensors (Camera, Lidar, Fisheye) and employs 4 sensor-layouts based on the different intersections. Each intersection is equipped with 6-18 sensors to capture synchronous data. While autonomous vehicles pass through these intersections for collecting VIC data. HoloVIC contains in total on 100k+ synchronous frames from different sensors. Additionally, we annotated 3D bounding boxes based on Camera, Fisheye, and Lidar. We also associate the IDs of the same objects across different devices and consecutive frames in sequence. Based on HoloVIC, we formulated four tasks to facilitate the development of related research. We also provide benchmarks for these tasks.

cs.CV↗

arXiv2024

DreamLIP: Language-Image Pre-training with Long Captions

Language-image pre-training largely relies on how precisely and thoroughly a text describes its paired image. In practice, however, the contents of an image can be so rich that well describing them requires lengthy captions (e.g., with 10 sentences), which are usually missing in existing datasets. Consequently, there are currently no clear evidences on whether and how language-image pre-training could benefit from long captions. To figure this out, we first re-caption 30M images with detailed descriptions using a pre-trained Multi-modality Large Language Model (MLLM), and then study the usage of the resulting captions under a contrastive learning framework. We observe that, each sentence within a long caption is very likely to describe the image partially (e.g., an object). Motivated by this, we propose to dynamically sample sub-captions from the text label to construct multiple positive pairs, and introduce a grouping loss to match the embeddings of each sub-caption with its corresponding local image patches in a self-supervised manner. Experimental results on a wide rage of downstream tasks demonstrate the consistent superiority of our method, termed DreamLIP, over previous alternatives, highlighting its fine-grained representational capacity. It is noteworthy that, on the tasks of image-text retrieval and semantic segmentation, our model trained with 30M image-text pairs achieves on par or even better performance than CLIP trained with 400M pairs. Project page is available at https://zyf0619sjtu.github.io/dream-lip.

cs.CV↗

arXiv2024

Are Made and Missed Different? An analysis of Field Goal Attempts of Professional Basketball Players via Depth Based Testing Procedure

In this paper, we develop a novel depth-based testing procedure on spatial point processes to examine the difference in made and missed field goal attempts for NBA players. Specifically, our testing procedure can statistically detect the differences between made and missed field goal attempts for NBA players. We first obtain the depths of two processes under the polar coordinate system. A two-dimensional Kolmogorov-Smirnov test is then performed to test the difference between the depths of the two processes. Throughout extensive simulation studies, we show our testing procedure with good frequentist properties under both null hypothesis and alternative hypothesis. A comparison against the competing methods shows that our proposed procedure has better testing reliability and testing power. Application to the shot chart data of 191 NBA players in the 2017-2018 regular season offers interesting insights about these players' made and missed shot patterns.

stat.AP↗

arXiv2024

Tightness of the maximum of Ginzburg-Landau fields

We consider the discrete Ginzburg-Landau field with potential satisfying a uniform convexity condition, in the critical dimension $d=2$, and prove that its maximum over boxes of sidelength $N$, centered by an explicit $N$-dependent centering, is tight.

math.PR↗

arXiv2024

Augmenting Transformers with Recursively Composed Multi-grained Representations

We present ReCAT, a recursive composition augmented Transformer that is able to explicitly model hierarchical syntactic structures of raw texts without relying on gold trees during both learning and inference. Existing research along this line restricts data to follow a hierarchical tree structure and thus lacks inter-span communications. To overcome the problem, we propose a novel contextual inside-outside (CIO) layer that learns contextualized representations of spans through bottom-up and top-down passes, where a bottom-up pass forms representations of high-level spans by composing low-level spans, while a top-down pass combines information inside and outside a span. By stacking several CIO layers between the embedding layer and the attention layers in Transformer, the ReCAT model can perform both deep intra-span and deep inter-span interactions, and thus generate multi-grained representations fully contextualized with other spans. Moreover, the CIO layers can be jointly pre-trained with Transformers, making ReCAT enjoy scaling ability, strong performance, and interpretability at the same time. We conduct experiments on various sentence-level and span-level tasks. Evaluation results indicate that ReCAT can significantly outperform vanilla Transformer models on all span-level tasks and baselines that combine recursive networks with Transformers on natural language inference tasks. More interestingly, the hierarchical structures induced by ReCAT exhibit strong consistency with human-annotated syntactic trees, indicating good interpretability brought by the CIO layers.

cs.CL↗

arXiv2024

Pressure tuning of hydrogen bond ordering in the metal-organic framework [(CH3)2NH2]Mn(HCOO)3

The influence of pressure on the hydrogen bond ordering in the perovskite metal-organic framework [(CH3)2NH2]Mn(HCOO)3 has been investigated by dielectric, pyroelectric adn magnetic measurements in a piston-cylinder cell. Under ambient pressure the ordering of hydrogen bonds takes place at TC = 188 K and induces a first-order ferroelectric phase transition. With increasing pressure to p = 3.92 kbar, the order-disorder transition shifts to a lower temperature and retains the first-order ferroelectric nature. However, under higher pressures, the ordering process of hydrogen bonds is split into two transitions: a broad antiferroelectric transition at high temperature and a first-order ferroelectric transition at low temperature. With increasing pressure, the antiferroelectric phase is enhanced whereas the ferroelectric phase is greatly suppressed, which implies that compression of the perovskite framework favors antiparallel arrangement of the hydrogen bonds. The canted anti-ferromagnetic transition was almost unchanged when pressure up to 10.85 kbar. Our study demonstrated that the perovskite metal-organic frameworks are more sensitive to external pressure than conventional perovskite oxides so that their electric properties can be easily tuned by pressure.

cond-mat.mtrl-sci↗

arXiv2024

Intent-aware Recommendation via Disentangled Graph Contrastive Learning

Graph neural network (GNN) based recommender systems have become one of the mainstream trends due to the powerful learning ability from user behavior data. Understanding the user intents from behavior data is the key to recommender systems, which poses two basic requirements for GNN-based recommender systems. One is how to learn complex and diverse intents especially when the user behavior is usually inadequate in reality. The other is different behaviors have different intent distributions, so how to establish their relations for a more explainable recommender system. In this paper, we present the Intent-aware Recommendation via Disentangled Graph Contrastive Learning (IDCL), which simultaneously learns interpretable intents and behavior distributions over those intents. Specifically, we first model the user behavior data as a user-item-concept graph, and design a GNN based behavior disentangling module to learn the different intents. Then we propose the intent-wise contrastive learning to enhance the intent disentangling and meanwhile infer the behavior distributions. Finally, the coding rate reduction regularization is introduced to make the behaviors of different intents orthogonal. Extensive experiments demonstrate the effectiveness of IDCL in terms of substantial improvement and the interpretability.

cs.IR↗

arXiv2024

Noncentrosymmetric Nowotny Chimney Ladder Ferromagnet Cr4Ge7 with a High Curie Temperature of ~ 207 K

Noncentrosymmetric magnets usually host intriguing magnetic interactions inherent the crystal structure with broken inversion symmetry, which can give rise to rich magnetic behaviors. We report herein the high-pressure synthesis, crystal structure, magnetizations and magnetic structure of a so-called Nowotny chimney ladder compound Cr4Ge7. Our analysis on the powder neutron diffraction data revises the crystal structure as a noncentrosymmetric space group (P-4c2, No.116). It exhibits two magnetic orders within the temperature range of 2 - 400 K. The first order at ~ 207 K associated with a small magnetic moment of ~ 0.75 miuB is assigned to a commensurate ferromagnetic structure with a propagation vector k = (0, 0, 0). The weak itinerant ferromagnet nature should be caused by the complex Cr spin orders from different Wyckoff positions. The second order at ~ 18 K is assumed to arise from a competition between the Dzyaloshinskii-Moria and Heisenberg interactions. The results provide an excellent platform for study on intricate interactions between various magnetic exchanges as well as for the exploration of high temperature exotic magnetic properties which host potential applications in next-generation spintronics.

cond-mat.str-el↗

arXiv2024

Mode-resolved thermometry of trapped ion with Deep Learning

In trapped ion system, accurate thermometry of ion is crucial for evaluating the system state and precisely performing quantum operations. However, when the motional state of a single ion is far away from the ground state, the spatial dimension of the phonon state sharply increases, making it difficult to realize accurate and mode-resolved thermometry with existing methods. In this work, we apply deep learning for the first time to the thermometry of trapped ion, providing an efficient and mode-resolved method for accurately estimating large mean phonon numbers. Our trained neural network model can be directly applied to other experimental setups without retraining or post-processing, as long as the related parameters are covered by the model's effective range, and it can also be conveniently extended to other parameter ranges. We have conducted experimental verification based on our surface trap, of which the result has shown the accuracy and efficiency of the method for thermometry of single ion under large mean phonon number, and its mode resolution characteristic can make it better applied to the characterization of system parameters, such as evaluating cooling effectiveness, analyzing surface trap noise.

quant-ph↗

arXiv2024

Characterizing the spatial potential of a surface electrode ion trap

The accurate characterization of the spatial potential generated by a planar electrode in a surface-type Paul trap is of great interest. To achieve this, we employ a simple yet highly precise parametric expression to describe the spatial field of a rectangular-shaped electrode. Based on this, an optimization method is introduced to precisely characterize the axial electric field intensity created by the powered electrode and the stray field. In contrast to existing methods, various types of experimental data, such as the equilibrium position of ions in a linear string, equilibrium positions of single trapped ions and trap frequencies, are utilized for potential estimation in order to mitigate systematic errors. This approach offers significant flexibility in voltage settings for data collection, making it particularly well-suited for surface electrode traps where ion probe trapping height may vary with casual voltage settings. In our demonstration, we successfully minimized the discrepancy between experimental observations and model predictions to an impressive extent. The relative errors of secular frequencies were suppressed within $\pm$ 0.5$\%$, and the positional error of ions was limited to less than 1.2 $μ$m, all surpassing those achieved by existing methodologies.

quant-ph↗

arXiv2024

Demographic Bias of Expert-Level Vision-Language Foundation Models in Medical Imaging

Advances in artificial intelligence (AI) have achieved expert-level performance in medical imaging applications. Notably, self-supervised vision-language foundation models can detect a broad spectrum of pathologies without relying on explicit training annotations. However, it is crucial to ensure that these AI models do not mirror or amplify human biases, thereby disadvantaging historically marginalized groups such as females or Black patients. The manifestation of such biases could systematically delay essential medical care for certain patient subgroups. In this study, we investigate the algorithmic fairness of state-of-the-art vision-language foundation models in chest X-ray diagnosis across five globally-sourced datasets. Our findings reveal that compared to board-certified radiologists, these foundation models consistently underdiagnose marginalized groups, with even higher rates seen in intersectional subgroups, such as Black female patients. Such demographic biases present over a wide range of pathologies and demographic attributes. Further analysis of the model embedding uncovers its significant encoding of demographic information. Deploying AI systems with these biases in medical imaging can intensify pre-existing care disparities, posing potential challenges to equitable healthcare access and raising ethical questions about their clinical application.

cs.CY↗