arXiv subjects

Bin Chen

Publications and source records attributed to Bin Chen.

At least 361 records · Page 20Linked to original sources

arXiv2024

MuseChat: A Conversational Music Recommendation System for Videos

Music recommendation for videos attracts growing interest in multi-modal research. However, existing systems focus primarily on content compatibility, often ignoring the users' preferences. Their inability to interact with users for further refinements or to provide explanations leads to a less satisfying experience. We address these issues with MuseChat, a first-of-its-kind dialogue-based recommendation system that personalizes music suggestions for videos. Our system consists of two key functionalities with associated modules: recommendation and reasoning. The recommendation module takes a video along with optional information including previous suggested music and user's preference as inputs and retrieves an appropriate music matching the context. The reasoning module, equipped with the power of Large Language Model (Vicuna-7B) and extended to multi-modal inputs, is able to provide reasonable explanation for the recommended music. To evaluate the effectiveness of MuseChat, we build a large-scale dataset, conversational music recommendation for videos, that simulates a two-turn interaction between a user and a recommender based on accurate music track information. Experiment results show that MuseChat achieves significant improvements over existing video-based music retrieval methods as well as offers strong interpretability and interactability.

cs.LG↗

arXiv2024

Episodic energy release during the main- and post-impulsive phase of a solar flare

When and where the magnetic field energy is released and converted in eruptive solar flares remains an outstanding topic in solar physics. To shed light on this question, here we report multi-wavelength observations of a C9.4-class eruptive limb flare that occurred on 2017 August 20. The flare, accompanied by a magnetic flux rope eruption and a white light coronal mass ejection, features three post-impulsive X-ray and microwave bursts immediately following its main impulsive phase. For each burst, both microwave and X-ray imaging suggest that the non-thermal electrons are located in the above-the-loop-top region. Interestingly, contrary to many other flares, the peak flux of the three post-impulsive microwave and X-ray bursts shows an increase for later bursts. Spectral analysis reveals that the sources have a hardening spectral index, suggesting a more efficient electron acceleration into the later post-impulsive bursts. We observe a positive correlation between the acceleration of the magnetic flux rope and the non-thermal energy release during the post-impulsive bursts in the same event. Intriguingly, different from some other eruptive events, this correlation does not hold for the main impulse phase of this event, which we interpret as energy release due to the tether-cutting reconnection before the primary flux rope acceleration occurs. In addition, using footpoint brightenings at conjugate flare ribbons, a weakening reconnection guide field is inferred, which may also contribute to the hardening of the non-thermal electrons during the post-impulsive phase.

astro-ph.SR↗

arXiv2024

Dynamic Path-Controllable Deep Unfolding Network for Compressive Sensing

Deep unfolding network (DUN) that unfolds the optimization algorithm into a deep neural network has achieved great success in compressive sensing (CS) due to its good interpretability and high performance. Each stage in DUN corresponds to one iteration in optimization. At the test time, all the sampling images generally need to be processed by all stages, which comes at a price of computation burden and is also unnecessary for the images whose contents are easier to restore. In this paper, we focus on CS reconstruction and propose a novel Dynamic Path-Controllable Deep Unfolding Network (DPC-DUN). DPC-DUN with our designed path-controllable selector can dynamically select a rapid and appropriate route for each image and is slimmable by regulating different performance-complexity tradeoffs. Extensive experiments show that our DPC-DUN is highly flexible and can provide excellent performance and dynamic adjustment to get a suitable tradeoff, thus addressing the main requirements to become appealing in practice. Codes are available at https://github.com/songjiechong/DPC-DUN.

cs.CV↗

arXiv2024

Doppler Signature of a Possible Termination Shock in an Off-Limb Solar Flare

We report striking Doppler velocity gradients observed during the well-observed September 10th 2017 solar flare, and argue that they are consistent with the presence of an above-the-looptop termination shock beneath the flare current sheet. Observations from the Hinode Extreme-ultraviolet Imaging Spectrometer (EIS) measure plasma sheet Doppler shifts up to 35 km/s during the late-phase of the event. By comparing these line-of-sight flows with plane-of-sky measurements, we calculate total velocity downflows of 200+ km/s, orientated 6-10° out of the plane of sky. The observed velocities drop rapidly at the base of the hot plasma sheet seen in extreme ultraviolet, consistent with simulated velocity profiles predicted by our 2.5D magnetohydrodynamics model that features a termination shock at the same location. Finally, the striking velocity deceleration aligns spatially with the suppression of Fe XXIV non-thermal velocities, and a 35--50 keV hard X-ray looptop source observed by the Reuven Ramaty High Energy Solar Spectroscopic Imager (RHESSI). Together, these observations are consistent with the presence of a possible termination shock within the X8.2-class solar flare.

astro-ph.SR↗

arXiv2024

Conversational Crowdsensing: A Parallel Intelligence Powered Novel Sensing Approach

The transition from CPS-based Industry 4.0 to CPSS-based Industry 5.0 brings new requirements and opportunities to current sensing approaches, especially in light of recent progress in Chatbots and Large Language Models (LLMs). Therefore, the advancement of parallel intelligence-powered Crowdsensing Intelligence (CSI) is witnessed, which is currently advancing towards linguistic intelligence. In this paper, we propose a novel sensing paradigm, namely conversational crowdsensing, for Industry 5.0. It can alleviate workload and professional requirements of individuals and promote the organization and operation of diverse workforce, thereby facilitating faster response and wider popularization of crowdsensing systems. Specifically, we design the architecture of conversational crowdsensing to effectively organize three types of participants (biological, robotic, and digital) from diverse communities. Through three levels of effective conversation (i.e., inter-human, human-AI, and inter-AI), complex interactions and service functionalities of different workers can be achieved to accomplish various tasks across three sensing phases (i.e., requesting, scheduling, and executing). Moreover, we explore the foundational technologies for realizing conversational crowdsensing, encompassing LLM-based multi-agent systems, scenarios engineering and conversational human-AI cooperation. Finally, we present potential industrial applications of conversational crowdsensing and discuss its implications. We envision that conversations in natural language will become the primary communication channel during crowdsensing process, enabling richer information exchange and cooperative problem-solving among humans, robots, and AI.

cs.AI↗

arXiv2024

A new analytical model of magnetofluids surrounding rotating black holes

In this study, we develop a simplified magnetofluid model in the framework of GRMHD. We consider an ideal, adiabatic fluid composed of two components, ions and electrons, having a constant ratio between their temperatures. The flows are assumed to be governed by gravity, enabling us to employ the ballistic approximation, treating the streamlines as timelike geodesics. We show that the model is analytically solvble around a rotating black hole if the angular velocity of the geodesic $u^θ$ is vanishing. In the corresponding solution, which is named the conical solution, we derive a comprehensive set of explicit expressions for the thermodynamics and the associated magnetic field. Furthermore, we explore the potential applications of our model to describe the thick disks and the jets at the horizon scale. Our model provides a direct pathway for the study of black hole imaging.

gr-qc↗

arXiv2024

MB-RACS: Measurement-Bounds-based Rate-Adaptive Image Compressed Sensing Network

Conventional compressed sensing (CS) algorithms typically apply a uniform sampling rate to different image blocks. A more strategic approach could be to allocate the number of measurements adaptively, based on each image block's complexity. In this paper, we propose a Measurement-Bounds-based Rate-Adaptive Image Compressed Sensing Network (MB-RACS) framework, which aims to adaptively determine the sampling rate for each image block in accordance with traditional measurement bounds theory. Moreover, since in real-world scenarios statistical information about the original image cannot be directly obtained, we suggest a multi-stage rate-adaptive sampling strategy. This strategy sequentially adjusts the sampling ratio allocation based on the information gathered from previous samplings. We formulate the multi-stage rate-adaptive sampling as a convex optimization problem and address it using a combination of Newton's method and binary search techniques. Additionally, we enhance our decoding process by incorporating skip connections between successive iterations to facilitate a richer transmission of feature information across iterations. Our experiments demonstrate that the proposed MB-RACS method surpasses current leading methods, with experimental evidence also underscoring the effectiveness of each module within our proposed framework.

cs.CV↗

arXiv2024

Long antipaths and anticycles in oriented graphs

Let $δ^{0}(D)$ be the minimum semi-degree of an oriented graph $D$. Jackson (1981) proved that every oriented graph $D$ with $δ^{0}(D)\geq k$ contains a directed path of length $2k$ when $|V(D)|>2k+2$, and a directed Hamilton cycle when $|V(D)|\le 2k+2$. Stein~(2020) further conjectured that every oriented graph $D$ with $δ^{0}(D)>k/2$ contains any orientated path of length $k$. Recently, Klimousová and Stein (DM, 2023) introduced the minimum pseudo-semi-degree $\tildeδ^0(D)$ (a slight weaker than the minimum semi-degree condition as $\tildeδ^0(D)\ge δ^0(D))$ and showed that every oriented graph $D$ with $\tildeδ^{0}(D)\ge (3k-2)/4$ contains each antipath of length $k$ for $k\geq 3$. In this paper, we improve the result of Klimousová and Stein by showing that for all $k\geq 2$, every oriented graph with $\tildeδ^0(D)\ge(2k+1)/3$ contains either an antipath of length at least $k+1$ or an anticycle of length at least $k+1$. Furthermore, we answer a problem raised by Klimousová and Stein in the negative.

math.CO↗

arXiv2024

PHPQ: Pyramid Hybrid Pooling Quantization for Efficient Fine-Grained Image Retrieval

Deep hashing approaches, including deep quantization and deep binary hashing, have become a common solution to large-scale image retrieval due to their high computation and storage efficiency. Most existing hashing methods cannot produce satisfactory results for fine-grained retrieval, because they usually adopt the outputs of the last CNN layer to generate binary codes. Since deeper layers tend to summarize visual clues, e.g., texture, into abstract semantics, e.g., dogs and cats, the feature produced by the last CNN layer is less effective in capturing subtle but discriminative visual details that mostly exist in shallow layers. To improve fine-grained image hashing, we propose Pyramid Hybrid Pooling Quantization (PHPQ). Specifically, we propose a Pyramid Hybrid Pooling (PHP) module to capture and preserve fine-grained semantic information from multi-level features, which emphasizes the subtle discrimination of different sub-categories. Besides, we propose a learnable quantization module with a partial codebook attention mechanism, which helps to optimize the most relevant codewords and improves the quantization. Comprehensive experiments on two widely-used public benchmarks, i.e., CUB-200-2011 and Stanford Dogs, demonstrate that PHPQ outperforms state-of-the-art methods.

cs.CV↗

arXiv2024

Autonomous Crowdsensing: Operating and Organizing Crowdsensing for Sensing Automation

The precise characterization and modeling of Cyber-Physical-Social Systems (CPSS) requires more comprehensive and accurate data, which imposes heightened demands on intelligent sensing capabilities. To address this issue, Crowdsensing Intelligence (CSI) has been proposed to collect data from CPSS by harnessing the collective intelligence of a diverse workforce. Our first and second Distributed/Decentralized Hybrid Workshop on Crowdsensing Intelligence (DHW-CSI) have focused on principles and high-level processes of organizing and operating CSI, as well as the participants, methods, and stages involved in CSI. This letter reports the outcomes of the latest DHW-CSI, focusing on Autonomous Crowdsensing (ACS) enabled by a range of technologies such as decentralized autonomous organizations and operations, large language models, and human-oriented operating systems. Specifically, we explain what ACS is and explore its distinctive features in comparison to traditional crowdsensing. Moreover, we present the ``6A-goal" of ACS and propose potential avenues for future research.

cs.CY↗

arXiv2024

GMMFormer: Gaussian-Mixture-Model Based Transformer for Efficient Partially Relevant Video Retrieval

Given a text query, partially relevant video retrieval (PRVR) seeks to find untrimmed videos containing pertinent moments in a database. For PRVR, clip modeling is essential to capture the partial relationship between texts and videos. Current PRVR methods adopt scanning-based clip construction to achieve explicit clip modeling, which is information-redundant and requires a large storage overhead. To solve the efficiency problem of PRVR methods, this paper proposes GMMFormer, a Gaussian-Mixture-Model based Transformer which models clip representations implicitly. During frame interactions, we incorporate Gaussian-Mixture-Model constraints to focus each frame on its adjacent frames instead of the whole video. Then generated representations will contain multi-scale clip information, achieving implicit clip modeling. In addition, PRVR methods ignore semantic differences between text queries relevant to the same video, leading to a sparse embedding space. We propose a query diverse loss to distinguish these text queries, making the embedding space more intensive and contain more semantic information. Extensive experiments on three large-scale video datasets (i.e., TVR, ActivityNet Captions, and Charades-STA) demonstrate the superiority and efficiency of GMMFormer. Code is available at \url{https://github.com/huangmozhi9527/GMMFormer}.

cs.CV↗

arXiv2023

FFCA-Net: Stereo Image Compression via Fast Cascade Alignment of Side Information

Multi-view compression technology, especially Stereo Image Compression (SIC), plays a crucial role in car-mounted cameras and 3D-related applications. Interestingly, the Distributed Source Coding (DSC) theory suggests that efficient data compression of correlated sources can be achieved through independent encoding and joint decoding. This motivates the rapidly developed deep-distributed SIC methods in recent years. However, these approaches neglect the unique characteristics of stereo-imaging tasks and incur high decoding latency. To address this limitation, we propose a Feature-based Fast Cascade Alignment network (FFCA-Net) to fully leverage the side information on the decoder. FFCA adopts a coarse-to-fine cascaded alignment approach. In the initial stage, FFCA utilizes a feature domain patch-matching module based on stereo priors. This module reduces redundancy in the search space of trivial matching methods and further mitigates the introduction of noise. In the subsequent stage, we utilize an hourglass-based sparse stereo refinement network to further align inter-image features with a reduced computational cost. Furthermore, we have devised a lightweight yet high-performance feature fusion network, called a Fast Feature Fusion network (FFF), to decode the aligned features. Experimental results on InStereo2K, KITTI, and Cityscapes datasets demonstrate the significant superiority of our approach over traditional and learning-based SIC methods. In particular, our approach achieves significant gains in terms of 3 to 10-fold faster decoding speed than other methods.

eess.IV↗

arXiv2023

Signature of Topological Semimetal in Harmonic-honeycomb ReO3

Transition-metal honeycomb compounds are capturing scientific attention due to their distinctive electronic configurations, underscored by the triangular-lattice spin-orbit coupling and competition between multiple interactions, paving the way for potential manifestations of phenomena such as Dirac semimetal, superconductivity, and quantum spin liquid states. These compounds can undergo discernible pressure-induced alterations in their crystallographic and electronic paradigms, as exemplified by our high-pressure (HP) synthesis and exploration of the honeycomb polymorph of ReO3 (P6322). This HP-P6322 polymorph bears a phase transition from P6322 to P63/mmc upon cooling around Tp = 250 K, as evidenced by the evolution of temperature-dependent magnetization (M-T curves), cell dimension, and conductivity initiated by an inherent bifurcation of the oxygen position in the ab plane. Insightful analysis of its band structure positions suggests this HP-P6322 polymorph being a plausible candidate for Dirac semimetal properties. This phase transition evokes anomalies in the temperature-dependent variation of paramagnetism (non-linearity) and a crossover from semiconductor to temperature-independent metal, showing a temperature independent conductivity behavior below ~200 K. Under increasing external pressure, both the Tp and resistance of this HP-polymorph is slightly magnetic-field dependent and undergo a "V"-style evolution (decreasing and then increasing) before becoming pressure independent up to 20.2 GPa. Theoretical calculations pinpoint this anionic disorder as a probable catalyst for the decrement in the conductive efficiency and muted temperature-dependent conductivity response.

cond-mat.mtrl-sci↗

arXiv2023

Large Language Models in Medical Term Classification and Unexpected Misalignment Between Response and Reasoning

This study assesses the ability of state-of-the-art large language models (LLMs) including GPT-3.5, GPT-4, Falcon, and LLaMA 2 to identify patients with mild cognitive impairment (MCI) from discharge summaries and examines instances where the models' responses were misaligned with their reasoning. Utilizing the MIMIC-IV v2.2 database, we focused on a cohort aged 65 and older, verifying MCI diagnoses against ICD codes and expert evaluations. The data was partitioned into training, validation, and testing sets in a 7:2:1 ratio for model fine-tuning and evaluation, with an additional metastatic cancer dataset from MIMIC III used to further assess reasoning consistency. GPT-4 demonstrated superior interpretative capabilities, particularly in response to complex prompts, yet displayed notable response-reasoning inconsistencies. In contrast, open-source models like Falcon and LLaMA 2 achieved high accuracy but lacked explanatory reasoning, underscoring the necessity for further research to optimize both performance and interpretability. The study emphasizes the significance of prompt engineering and the need for further exploration into the unexpected reasoning-response misalignment observed in GPT-4. The results underscore the promise of incorporating LLMs into healthcare diagnostics, contingent upon methodological advancements to ensure accuracy and clinical coherence of AI-generated outputs, thereby improving the trustworthiness of LLMs for medical decision-making.

cs.CL↗

arXiv2023

Towards Compact 3D Representations via Point Feature Enhancement Masked Autoencoders

Learning 3D representation plays a critical role in masked autoencoder (MAE) based pre-training methods for point cloud, including single-modal and cross-modal based MAE. Specifically, although cross-modal MAE methods learn strong 3D representations via the auxiliary of other modal knowledge, they often suffer from heavy computational burdens and heavily rely on massive cross-modal data pairs that are often unavailable, which hinders their applications in practice. Instead, single-modal methods with solely point clouds as input are preferred in real applications due to their simplicity and efficiency. However, such methods easily suffer from limited 3D representations with global random mask input. To learn compact 3D representations, we propose a simple yet effective Point Feature Enhancement Masked Autoencoders (Point-FEMAE), which mainly consists of a global branch and a local branch to capture latent semantic features. Specifically, to learn more compact features, a share-parameter Transformer encoder is introduced to extract point features from the global and local unmasked patches obtained by global random and local block mask strategies, followed by a specific decoder to reconstruct. Meanwhile, to further enhance features in the local branch, we propose a Local Enhancement Module with local patch convolution to perceive fine-grained local context at larger scales. Our method significantly improves the pre-training efficiency compared to cross-modal alternatives, and extensive downstream experiments underscore the state-of-the-art effectiveness, particularly outperforming our baseline (Point-MAE) by 5.16%, 5.00%, and 5.04% in three variants of ScanObjectNN, respectively. The code is available at https://github.com/zyh16143998882/AAAI24-PointFEMAE.

cs.CV↗

arXiv2023

Ground States of Fermionic Nonlinear Schrödinger Systems with Coulomb Potential II: The $L^2$-Critical Case

As a continuation of \cite{me}, we consider ground states of the $N$ coupled fermionic nonlinear Schrödinger system with a parameter $a $ and the Coulomb potential $V(x)$ in the $L^2$-critical case, where $a>0$ represents the attractive strength of the quantum particles. For any given $N\in\mathbb{N}^+$, we prove that the system admits ground states, if and only if the attractive strength $a$ satisfies $0<a<a^*_N$, where the critical constant $0<a^*_N<\infty$ is the same as the best constant of a dual finite-rank Lieb-Thirring inequality. By developing the so-called blow-up analysis of many-body fermionic problems, we also prove the mass concentration behavior of ground states for the system as $a\nearrow a_N^*$.

math-ph↗

arXiv2023

Structural Modulation and BC8 Enrichment of Silicon via Dynamic Decompression

The modern very large-scale integration systems based on silicon semiconductor are facing the unprecedented challenges especially when transistor feature size lowers further, due to the excruciating tunneling effect and thermal management. Besides the common diamond cubic silicon, numerous exotic silicon allotropes with outstanding properties can emerge under high pressure, such as the metastable BC8 and metallic \b{eta}-tin structures. Despite much effort on the controlled synthesis in experiment and theory, the effective approach to rationally prepare Si phases with desired purity is still lacking and their transition mechanism remains controversial. Herein, we systematically investigated on the complicated structural transformations of Si under extreme conditions, and efficiently enriched BC8-Si phase via dynamic decompression strategy. The splendid purity of BC8-Si was achieved up to ~95%, evidently confirmed by Raman spectroscopy and synchrotron X-ray diffraction. We believe these results can shed a light on the controlled preparation of Si metastable phases and their potential applications in nanoelectronics.

cond-mat.mtrl-sci↗

arXiv2023

Pressure-Modulated Structural and Magnetic Phase Transitions in Two-Dimensional FeTe: Tetragonal and Hexagonal Polymorphs

Two-dimensional (2D) Fe-chalcogenides with rich structures, magnetisms and superconductivities are highly desirable to reveal the torturous transition mechanism and explore their potential applications in spintronics and nanoelectronics. Hydrostatic pressure can effectively stimulate novel phase transitions between various ordered states and to plot the seductive phase diagram. Herein, the structural evolution and transport characteristics of 2D FeTe were systematically investigated under extreme conditions through comparing two distinct symmetries, i.e., tetragonal (t-) and hexagonal (h-) FeTe. We found that 2D t-FeTe presented the pressure-induced transition from antiferromagnetic to ferromagnetic states at ~ 3 GPa, corresponding to the tetragonal collapse of layered structure. Contrarily, ferromagnetic order of 2D h-FeTe was retained up to 15 GPa, evidently confirmed by electrical transport and Raman measurements. Furthermore, the detailed P-T phase diagrams of both 2D t-FeTe and h-FeTe were mapped out with the delicate critical conditions. We believe our results can provide a unique platform to elaborate the extraordinary physical properties of Fe-chalcogenides and further to develop their practical applications.

cond-mat.mtrl-sci↗