arXiv subjects

Pengfei Zhou

Publications and source records attributed to Pengfei Zhou.

At least 73 records · Page 4Linked to original sources

arXiv2024

FoodSky: A Food-oriented Large Language Model that Passes the Chef and Dietetic Examination

Food is foundational to human life, serving not only as a source of nourishment but also as a cornerstone of cultural identity and social interaction. As the complexity of global dietary needs and preferences grows, food intelligence is needed to enable food perception and reasoning for various tasks, ranging from recipe generation and dietary recommendation to diet-disease correlation discovery and understanding. Towards this goal, for powerful capabilities across various domains and tasks in Large Language Models (LLMs), we introduce Food-oriented LLM FoodSky to comprehend food data through perception and reasoning. Considering the complexity and typicality of Chinese cuisine, we first construct one comprehensive Chinese food corpus FoodEarth from various authoritative sources, which can be leveraged by FoodSky to achieve deep understanding of food-related data. We then propose Topic-based Selective State Space Model (TS3M) and the Hierarchical Topic Retrieval Augmented Generation (HTRAG) mechanism to enhance FoodSky in capturing fine-grained food semantics and generating context-aware food-relevant text, respectively. Our extensive evaluations demonstrate that FoodSky significantly outperforms general-purpose LLMs in both chef and dietetic examinations, with an accuracy of 67.2% and 66.4% on the Chinese National Chef Exam and the National Dietetic Exam, respectively. FoodSky not only promises to enhance culinary creativity and promote healthier eating patterns, but also sets a new standard for domain-specific LLMs that address complex real-world issues in the food domain. An online demonstration of FoodSky is available at http://222.92.101.211:8200.

cs.CL↗

arXiv2024

Unleashing the Power of Unlabeled Data: A Self-supervised Learning Framework for Cyber Attack Detection in Smart Grids

Modern power grids are undergoing significant changes driven by information and communication technologies (ICTs), and evolving into smart grids with higher efficiency and lower operation cost. Using ICTs, however, comes with an inevitable side effect that makes the power system more vulnerable to cyber attacks. In this paper, we propose a self-supervised learning-based framework to detect and identify various types of cyber attacks. Different from existing approaches, the proposed framework does not rely on large amounts of well-curated labeled data but makes use of the massive unlabeled data in the wild which are easily accessible. Specifically, the proposed framework adopts the BERT model from the natural language processing domain and learns generalizable and effective representations from the unlabeled sensing data, which capture the distinctive patterns of different attacks. Using the learned representations, together with a very small amount of labeled data, we can train a task-specific classifier to detect various types of cyber attacks. Meanwhile, real-world training datasets are usually imbalanced, i.e., there are only a limited number of data samples containing attacks. In order to cope with such data imbalance, we propose a new loss function, separate mean error (SME), which pays equal attention to the large and small categories to better train the model. Experiment results in a 5-area power grid system with 37 buses demonstrate the superior performance of our framework over existing approaches, especially when a very limited portion of labeled data are available, e.g., as low as 0.002\%. We believe such a framework can be easily adopted to detect a variety of cyber attacks in other power grid scenarios.

cs.LG↗

arXiv2024

CMMU: A Benchmark for Chinese Multi-modal Multi-type Question Understanding and Reasoning

Multi-modal large language models(MLLMs) have achieved remarkable progress and demonstrated powerful knowledge comprehension and reasoning abilities. However, the mastery of domain-specific knowledge, which is essential for evaluating the intelligence of MLLMs, continues to be a challenge. Current multi-modal benchmarks for domain-specific knowledge concentrate on multiple-choice questions and are predominantly available in English, which imposes limitations on the comprehensiveness of the evaluation. To this end, we introduce CMMU, a novel benchmark for multi-modal and multi-type question understanding and reasoning in Chinese. CMMU consists of 3,603 questions in 7 subjects, covering knowledge from primary to high school. The questions can be categorized into 3 types: multiple-choice, multiple-response, and fill-in-the-blank, bringing greater challenges to MLLMs. In addition, we propose an evaluation strategy called Positional Error Variance for assessing multiple-choice questions. The strategy aims to perform a quantitative analysis of position bias. We evaluate seven open-source MLLMs along with GPT4-V, Gemini-Pro, and Qwen-VL-Plus. The results demonstrate that CMMU poses a significant challenge to the recent MLLMs. The data and code are available at https://github.com/FlagOpen/CMMU.

cs.CL↗

arXiv2024

DiffHarmony: Latent Diffusion Model Meets Image Harmonization

Image harmonization, which involves adjusting the foreground of a composite image to attain a unified visual consistency with the background, can be conceptualized as an image-to-image translation task. Diffusion models have recently promoted the rapid development of image-to-image translation tasks . However, training diffusion models from scratch is computationally intensive. Fine-tuning pre-trained latent diffusion models entails dealing with the reconstruction error induced by the image compression autoencoder, making it unsuitable for image generation tasks that involve pixel-level evaluation metrics. To deal with these issues, in this paper, we first adapt a pre-trained latent diffusion model to the image harmonization task to generate the harmonious but potentially blurry initial images. Then we implement two strategies: utilizing higher-resolution images during inference and incorporating an additional refinement stage, to further enhance the clarity of the initially harmonized images. Extensive experiments on iHarmony4 datasets demonstrate the superiority of our proposed method. The code and model will be made publicly available at https://github.com/nicecv/DiffHarmony .

cs.CV↗

arXiv2024

Synthesizing Knowledge-enhanced Features for Real-world Zero-shot Food Detection

Food computing brings various perspectives to computer vision like vision-based food analysis for nutrition and health. As a fundamental task in food computing, food detection needs Zero-Shot Detection (ZSD) on novel unseen food objects to support real-world scenarios, such as intelligent kitchens and smart restaurants. Therefore, we first benchmark the task of Zero-Shot Food Detection (ZSFD) by introducing FOWA dataset with rich attribute annotations. Unlike ZSD, fine-grained problems in ZSFD like inter-class similarity make synthesized features inseparable. The complexity of food semantic attributes further makes it more difficult for current ZSD methods to distinguish various food categories. To address these problems, we propose a novel framework ZSFDet to tackle fine-grained problems by exploiting the interaction between complex attributes. Specifically, we model the correlation between food categories and attributes in ZSFDet by multi-source graphs to provide prior knowledge for distinguishing fine-grained features. Within ZSFDet, Knowledge-Enhanced Feature Synthesizer (KEFS) learns knowledge representation from multiple sources (e.g., ingredients correlation from knowledge graph) via the multi-source graph fusion. Conditioned on the fusion of semantic knowledge representation, the region feature diffusion model in KEFS can generate fine-grained features for training the effective zero-shot detector. Extensive evaluations demonstrate the superior performance of our method ZSFDet on FOWA and the widely-used food dataset UECFOOD-256, with significant improvements by 1.8% and 3.7% ZSD mAP compared with the strong baseline RRFS. Further experiments on PASCAL VOC and MS COCO prove that enhancement of the semantic knowledge can also improve the performance on general ZSD. Code and dataset are available at https://github.com/LanceZPF/KEFS.

cs.CV↗

arXiv2023

From Plate to Production: Artificial Intelligence in Modern Consumer-Driven Food Systems

Global food systems confront the urgent challenge of supplying sustainable, nutritious diets in the face of escalating demands. The advent of Artificial Intelligence (AI) is bringing in a personal choice revolution, wherein AI-driven individual decisions transform food systems from dinner tables, to the farms, and back to our plates. In this context, AI algorithms refine personal dietary choices, subsequently shaping agricultural outputs, and promoting an optimized feedback loop from consumption to cultivation. Initially, we delve into AI tools and techniques spanning the food supply chain, and subsequently assess how AI subfields$\unicode{x2013}$encompassing machine learning, computer vision, and speech recognition$\unicode{x2013}$are harnessed within the AI-enabled Food System (AIFS) framework, which increasingly leverages Internet of Things, multimodal sensors and real-time data exchange. We spotlight the AIFS framework, emphasizing its fusion of AI with technologies such as digitalization, big data analytics, biotechnology, and IoT extensively used in modern food systems in every component. This paradigm shifts the conventional "farm to fork" narrative to a cyclical "consumer-driven farm to fork" model for better achieving sustainable, nutritious diets. This paper explores AI's promise and the intrinsic challenges it poses within the food domain. By championing stringent AI governance, uniform data architectures, and cross-disciplinary partnerships, we argue that AI, when synergized with consumer-centric strategies, holds the potential to steer food systems toward a sustainable trajectory. We furnish a comprehensive survey for the state-of-the-art in diverse facets of food systems, subsequently pinpointing gaps and advocating for the judicious and efficacious deployment of emergent AI methodologies.

cs.CY↗

arXiv2023

SeeDS: Semantic Separable Diffusion Synthesizer for Zero-shot Food Detection

Food detection is becoming a fundamental task in food computing that supports various multimedia applications, including food recommendation and dietary monitoring. To deal with real-world scenarios, food detection needs to localize and recognize novel food objects that are not seen during training, demanding Zero-Shot Detection (ZSD). However, the complexity of semantic attributes and intra-class feature diversity poses challenges for ZSD methods in distinguishing fine-grained food classes. To tackle this, we propose the Semantic Separable Diffusion Synthesizer (SeeDS) framework for Zero-Shot Food Detection (ZSFD). SeeDS consists of two modules: a Semantic Separable Synthesizing Module (S$^3$M) and a Region Feature Denoising Diffusion Model (RFDDM). The S$^3$M learns the disentangled semantic representation for complex food attributes from ingredients and cuisines, and synthesizes discriminative food features via enhanced semantic information. The RFDDM utilizes a novel diffusion model to generate diversified region features and enhances ZSFD via fine-grained synthesized features. Extensive experiments show the state-of-the-art ZSFD performance of our proposed method on two food datasets, ZSFooD and UECFOOD-256. Moreover, SeeDS also maintains effectiveness on general ZSD datasets, PASCAL VOC and MS COCO. The code and dataset can be found at https://github.com/LanceZPF/SeeDS.

cs.CV↗

arXiv2023

MgF$_2$ as an effective additive for improving ionic conductivity of ceramic solid electrolytes

As typical solid-state electrolytes (SSEs), {Na}$_{1+x}${Zr}$_2${Si}$_{x}${P}$_{3-x}${O}$_{12}$ NASICONs provide an ideal platform for solid-state batteries (SSBs) that display higher safety and accommodate higher energy densities. The critical points for achieving SSBs with higher efficiencies are to improve essentially the ionic conductivity and to reduce largely the interfacial resistance between SSEs and cathode materials, which would necessitate extremely high level of craftsmanship and high-pressure equipment. An alternative to higher-performance and lower-cost SSBs is additive manufacturing. Here, we report on an effective additive, MgF$_2$, which was used in synthesizing NASICONs, resulting in SSEs with fewer defects and higher performance. With an addition of mere 1 wt$\%$ MgF$_2$ additive, the total room-temperature ionic conductivity of the NASICON electrolyte reaches up to 2.03 mS cm$^{-1}$, improved up to $\sim$ 181.3$\%$, with an activation energy of 0.277 eV. Meanwhile, the stability of the Na plating/stripping behavior in symmetric cells increases from 236 to 654 h. We tried to reveal the microscopic origins of the higher ionic conductivity of MgF$_2$-doped NASICONs by comprehensive in-house characterizations. Our study discovers a novel MgF$_2$ additive and provides an efficient way to prepare higher-performance SSEs, making it possible to fabricate lower-cost SSBs in industries.

physics.app-ph↗

arXiv2022

A comprehensive review on the ferroelectric orthochromates: Synthesis, property, and application

Multiferroics represent a class of advanced materials for promising applications and stand at the forefront of modern science for the special feature possessing both charge polar and magnetic order. Previous studies indicate that the family of RECrO3 (RE = rare earth) compounds is likely another rare candidate system holding both ferroelectricity and magnetism. However, many issues remain unsolved, casting hot disputes about whether RECrO3 is multiferroic or not. For example, an incompatibility exists between reported structural models and observed ferroelectric behaviors, and it is not easy to determine the spin canting degree. To address these questions, one key step is to grow single crystals because they can provide more reliable information than other forms of matter do. In this review, the parent and doped ferroelectric YCrO3 compounds are comprehensively reviewed based on scientific and patent literatures from 1954 to 2022. The materials syntheses with different methods, including poly-, nano-, and single-crystalline samples and thin films, are summarized. The structural, magnetic, ferroelectric and dielectric, optical, and chemical-pressure (on Y and Cr sites by doping) dependent chemical and physical properties and the corresponding phase diagrams, are discussed. Diverse (potential) applications, including anti-corrosion, magnetohydrodynamic electrode, catalyst, negative-temperature-coefficient thermistor, magnetic refrigeration, protective coating, and solid oxide fuel cell, are present. To conclude, we summarize general results, reached consensuses, and existing controversies of the past nearly 69 years of intensive studies and highlight future research opportunities and emerging challenges to address existing issues.

cond-mat.mtrl-sci↗

arXiv2022

Temperature-dependent structure of an intermetallic ErPd$_2$Si$_2$ single crystal: A combined synchrotron and in-house X-ray diffraction study

We have grown intermetallic ErPd$_2$Si$_2$ single crystals employing laser-diodes with the floating-zone method. The temperature-dependent crystallography was determined using synchrotron and in-house X-ray powder diffraction measurements from 20 to 500 K. The diffraction patterns fit well with the tetragonal $I$4/$mmm$ space group (No. 139) with two chemical formulas within one unit cell. Our synchrotron X-ray powder diffraction study shows that the refined lattice constants are $a$ = 4.10320(2) Å, $c$ = 9.88393(5) Å at 298 K and $a$ = 4.11737(2) Å, $c$ = 9.88143(5) Å at 500 K, resulting in the unit-cell volume $V$ = 166.408(1) Å$^3$ (298 K) and 167.517(2) Å$^3$ (500 K). In the whole studied temperature range, we did not find any structural phase transition. Upon cooling, the lattice constants a and c are shortened and elongated, respectively.

cond-mat.mtrl-sci↗

arXiv2022

ISDA: Position-Aware Instance Segmentation with Deformable Attention

Most instance segmentation models are not end-to-end trainable due to either the incorporation of proposal estimation (RPN) as a pre-processing or non-maximum suppression (NMS) as a post-processing. Here we propose a novel end-to-end instance segmentation method termed ISDA. It reshapes the task into predicting a set of object masks, which are generated via traditional convolution operation with learned position-aware kernels and features of objects. Such kernels and features are learned by leveraging a deformable attention network with multi-scale representation. Thanks to the introduced set-prediction mechanism, the proposed method is NMS-free. Empirically, ISDA outperforms Mask R-CNN (the strong baseline) by 2.6 points on MS-COCO, and achieves leading performance compared with recent models. Code will be available soon.

cs.CV↗

arXiv2021

Temperature-dependent structure and magnetization of YCrO$_3$ compound

We have grown a YCrO$_3$ single crystal by the floating-zone method and studied its temperature-dependent crystalline structure and magnetization by X-ray powder diffraction and PPMS DynaCool measurements. All diffraction patterns were well indexed by an orthorhombic structure with space group of $Pbnm$ (No. 62). From 36 to 300 K, no structural phase transition occurs in the pulverized YCrO$_3$ single crystal. The antiferromagnetic phase transition temperature was determined as $T_\textrm{N} =$ 141.58(5) K by the magnetization versus temperature measurements. We found weak ferromagnetic behavior in the magnetic hysteresis loops below $T_\textrm{N}$. Especially, we demonstrated that the antiferromagnetism and weak ferromagnetism appear simutaniously upon cooling. The lattice parameters ($a$, $b$, $c$, and $V$) deviate downward from the Gr$\ddot{\textrm{u}}$neisen law, displaying an anisotropic magnetostriction effect. We extracted temperature variation of the local distortion parameter $Δ$. Compared to the $Δ$ value of Cr ions, Y, O1, and O2 ions show one order of magnitude larger $Δ$ values indicative of much stronger local lattice distortions. Moreover, the calculated bond valence states of Y and O2 ions have obvious subduction charges.

cond-mat.str-el↗

arXiv2021

Boltzmann machines as two-dimensional tensor networks

Restricted Boltzmann machines (RBM) and deep Boltzmann machines (DBM) are important models in machine learning, and recently found numerous applications in quantum many-body physics. We show that there are fundamental connections between them and tensor networks. In particular, we demonstrate that any RBM and DBM can be exactly represented as a two-dimensional tensor network. This representation gives an understanding of the expressive power of RBM and DBM using entanglement structures of the tensor networks, also provides an efficient tensor network contraction algorithm for the computing partition function of RBM and DBM. Using numerical experiments, we demonstrate that the proposed algorithm is much more accurate than the state-of-the-art machine learning methods in estimating the partition function of restricted Boltzmann machines and deep Boltzmann machines, and have potential applications in training deep Boltzmann machines for general machine learning tasks.

cond-mat.stat-mech↗

arXiv2021

FPGA Synthesis of Ternary Memristor-CMOS Decoders

The search for a compatible application of memristor-CMOS logic gates has remained elusive, as the data density benefits are offset by slow switching speeds and resistive dissipation. Active microdisplays typically prioritize pixel density (and therefore resolution) over that of speed, where the most widely used refresh rates fall between 25-240 Hz. Therefore, memristor-CMOS logic is a promising fit for peripheral IO logic in active matrix displays. In this paper, we design and implement a ternary 1-3 line decoder and a ternary 2-9 line decoder which are used to program a seven segment LED display. SPICE simulations are conducted in a 50-nm process, and the decoders are synthesized on an Altera Cyclone IV field-programmable gate array (FPGA) development board which implements a ternary memristor model designed in Quartus II. We compare our hardware results to a binary coded decimal (BCD)-to-seven segment display decoder, and show our memristor-CMOS approach reduces the total IO power consumption by a factor of approximately 6 times at a maximum synthesizable frequency of 293.77MHz. Although the speed is approximately half of the native built-in BCD-to-seven decoder, the comparatively slow refresh rates of typical microdisplays indicate this to be a tolerable trade-off, which promotes data density over speed.

cs.ET↗

arXiv2021

Dynamic Virtual Graph Significance Networks for Predicting Influenza

Graph-structured data and their related algorithms have attracted significant attention in many fields, such as influenza prediction in public health. However, the variable influenza seasonality, occasional pandemics, and domain knowledge pose great challenges to construct an appropriate graph, which could impair the strength of the current popular graph-based algorithms to perform data analysis. In this study, we develop a novel method, Dynamic Virtual Graph Significance Networks (DVGSN), which can supervisedly and dynamically learn from similar "infection situations" in historical timepoints. Representation learning on the dynamic virtual graph can tackle the varied seasonality and pandemics, and therefore improve the performance. The extensive experiments on real-world influenza data demonstrate that DVGSN significantly outperforms the current state-of-the-art methods. To the best of our knowledge, this is the first attempt to supervisedly learn a dynamic virtual graph for time-series prediction tasks. Moreover, the proposed method needs less domain knowledge to build a graph in advance and has rich interpretability, which makes the method more acceptable in the fields of public health, life sciences, and so on.

cs.AI↗

arXiv2020

Enhanced magnetocaloric effect and magnetic phase diagrams of single-crystal GdCrO$_3$

The crystalline structure, magnetism, and magnetocaloric effect of a GdCrO$_3$ single crystal grown with the laser-diode-heated floating-zone technique have been studied. The GdCrO$_3$ single crystal crystallizes into an orthorhombic structure with the space group $Pmnb$ at room temperature. Upon cooling, under a magnetic field of 0.1 T, it undergoes a magnetic phase transition at $T_{\textrm{N-Cr}} =$ 169.28(2) K with Cr$^{3+}$ ions forming a canted antiferromagnetic (AFM) structure, accompanied by a weak ferromagnetism. Subsequently, a spin reorientation takes place at $T_{\textrm{SR}} =$ 5.18(2) K due to Gd$^{3+}$-Cr$^{3+}$ magnetic couplings. Finally, the long-range AFM order of Gd$^{3+}$ ions establishes at $T_{\textrm{N-Gd}} =$ 2.10(2) K. Taking into account the temperature-(in)dependent components of Cr$^{3+}$ moments, we obtained an ideal model for describing the paramagnetic behavior of Gd$^{3+}$ ions within 30--140 K. We observed a magnetic reversal (positive $\rightarrow$ negative $\rightarrow$ positive) at 50 Oe with a minimum centering around 162 K. In the studied temperature range of 1.8-300 K, there exists a strong competition between magnetic susceptibilities of Gd$^{3+}$ and Cr$^{3+}$ ions, leading to puzzling magnetic phenomena. We have built the magnetic-field-dependent phase diagrams of $T_{\textrm{N-Gd}}$, $T_{\textrm{SR}}$, and $T_{\textrm{N-Cr}}$, shedding light on the nature of the intriguing magnetism. Moreover, we calculated the magnetic entropy change and obtained a maximum value at 6 K and $Δμ_0H$ = 14 T, i.e., -$ΔS_{\textrm{M}} \approx$ 57.5 J/kg K. Among all RCrO$_3$ (R = $4f^n$ rare earths, $n =$ 7-14) compounds, the single-crystal GdCrO$_3$ compound exhibits the highest magnetic entropy change, as well as an enhanced adiabatic temperature, creating a prominent magnetocaloric effect for potential application in magnetic refrigeration.

cond-mat.str-el↗

arXiv2020

Crystalline and magnetic structures, magnetization, heat capacity and anisotropic magnetostriction effect in a yttrium-chromium oxide

We have studied a nearly stoichiometric insulating Y$_{0.97(2)}$Cr$_{0.98(2)}$O$_{3.00(2)}$ single crystal by performing measurements of magnetization, heat capacity, and neutron diffraction. Albeit that the YCrO$_3$ compound behaviors like a soft ferromagnet with a coersive force of $\sim$ 0.05 T, there exist strong antiferromagnetic (AFM) interactions between Cr$^{3+}$ spins due to a strongly negative paramagnetic Curie-Weiss temperature, i.e., -433.2(6) K. The coexistence of ferromagnetism and antiferromagnetism may indicate a canted AFM structure. The AFM phase transition occurs at $T_\textrm{N} =$ 141.5(1) K, which increases to $T_\textrm{N}$(5T) = 144.5(1) K at 5 T. Within the accuracy of the present neuron-diffraction studies, we determine a G-type AFM structure with a propagation vector \textbf{k} = (1 1 0) and Cr$^{3+}$ spin directions along the crystallographic \emph{c} axis of the orthorhombic structure with space group \emph{Pnma} below $T_\textrm{N}$. At 12 K, the refined moment size is 2.45(6) $μ_\textrm{B}$, $\sim$ 82\% of the theoretical saturation value 3 $μ_\textrm{B}$. The Cr$^{3+}$ spin interactions are probably two-dimensional Ising like within the reciprocal (1 1 0) scattering plane. Below $T_\textrm{N}$, the lattice configuration (\emph{a}, \emph{b}, \emph{c}, and \emph{V}) deviates largely downward from the Gr$\ddot{\textrm{u}}$neisen law, displaying an anisotropic magnetostriction effect and a magnetoelastic effect. Especially, the sample contraction upon cooling is enhanced below the AFM transition temperature. There is evidence to suggest that the actual crystalline symmetry of YCrO$_3$ compound is probably lower than the currently assumed one. Additionally, we compared the $t_{2\textrm{g}}$ YCrO$_3$ and the $e_\textrm{g}$ La$_{7/8}$Sr$_{1/8}$MnO$_3$ single crystals for a further understanding of the reason for the possible symmetry lowering.

cond-mat.str-el↗

arXiv2020

Contracting Arbitrary Tensor Networks: General Approximate Algorithm and Applications in Graphical Models and Quantum Circuit Simulations

We present a general method for approximately contracting tensor networks with an arbitrary connectivity. This enables us to release the computational power of tensor networks to wide use in inference and learning problems defined on general graphs. We show applications of our algorithm in graphical models, specifically on estimating free energy of spin glasses defined on various of graphs, where our method largely outperforms existing algorithms including the mean-field methods and the recently proposed neural-network-based methods. We further apply our method to the simulation of random quantum circuits, and demonstrate that, with a trade off of negligible truncation errors, our method is able to simulate large quantum circuits that are out of reach of the state-of-the-art simulation methods.

physics.comp-ph↗