arXiv subjects

Liang Zhang

Publications and source records attributed to Liang Zhang.

At least 235 records · Page 13Linked to original sources

arXiv2024

3DG: A Framework for Using Generative AI for Handling Sparse Learner Performance Data From Intelligent Tutoring Systems

Learning performance data (e.g., quiz scores and attempts) is significant for understanding learner engagement and knowledge mastery level. However, the learning performance data collected from Intelligent Tutoring Systems (ITSs) often suffers from sparsity, impacting the accuracy of learner modeling and knowledge assessments. To address this, we introduce the 3DG framework (3-Dimensional tensor for Densification and Generation), a novel approach combining tensor factorization with advanced generative models, including Generative Adversarial Network (GAN) and Generative Pre-trained Transformer (GPT), for enhanced data imputation and augmentation. The framework operates by first representing the data as a three-dimensional tensor, capturing dimensions of learners, questions, and attempts. It then densifies the data through tensor factorization and augments it using Generative AI models, tailored to individual learning patterns identified via clustering. Applied to data from an AutoTutor lesson by the Center for the Study of Adult Literacy (CSAL), the 3DG framework effectively generated scalable, personalized simulations of learning performance. Comparative analysis revealed GAN's superior reliability over GPT-4 in this context, underscoring its potential in addressing data sparsity challenges in ITSs and contributing to the advancement of personalized educational technology.

cs.CY↗

arXiv2024

AstroSat and NICER timing view of the Z-type Neutron Star X-ray binary GX 340+0

The timing properties of the Z-type low-mass X-ray binaries provide insights into the emission components involved in producing the unique Z-shaped track in the hardness-intensity diagrams of these sources. In this work, we investigate the AstroSat and NICER observations of the GX 340+0 covering the complete 'Z'-track from the horizontal branch (HB) to the extended flaring branch (EFB). For the first time, we present the Z-track as seen in soft X-rays using the AstroSat/SXT and NICER (the soft colour is defined as a ratio of 3-6 keV to 0.5-3 keV). The shape of the track is distinctly different in soft X-rays, strongly suggesting the presence of additional components active in soft X-rays. The detailed timing analysis revealed significant quasi-periodic oscillation throughout the HB and the normal branch (NB) using LAXPC and the first NICER detection of 33.1 +/- 1.1 Hz horizontal branch oscillation (HBO) in 3-6 keV. The oscillations at the HB/NB vertex are observed to have higher frequencies (41-52 Hz) than the HB oscillations (16-31 Hz) and NB oscillations (6.2-8 Hz) but significantly lower rms (~1.6%). The HB oscillation is also limited to the energy range of 3-20 keV, indicating an association of HBO origin with the non-thermal component. It is also supported by earlier studies that found the strongest X-ray polarisation during HB.

astro-ph.HE↗

arXiv2024

Enhancing Large Language Model Performance To Answer Questions and Extract Information More Accurately

Large Language Models (LLMs) generate responses to questions; however, their effectiveness is often hindered by sub-optimal quality of answers and occasional failures to provide accurate responses to questions. To address these challenges, a fine-tuning process is employed, involving feedback and examples to refine models. The objective is to enhance AI models through continuous feedback loops, utilizing metrics such as cosine similarity, LLM evaluation and Rouge-L scores to evaluate the models. Leveraging LLMs like GPT-3.5, GPT4ALL, and LLaMA2, and Claude, this approach is benchmarked on financial datasets, including the FinanceBench and RAG Instruct Benchmark Tester Dataset, illustrating the necessity of fine-tuning. The results showcase the capability of fine-tuned models to surpass the accuracy of zero-shot LLMs, providing superior question and answering capabilities. Notably, the combination of fine-tuning the LLM with a process known as Retrieval Augmented Generation (RAG) proves to generate responses with improved accuracy.

cs.CL↗

arXiv2024

Studies on the soft intermediate state X-ray flare of MAXI J1535-571 during its 2017 outburst

We analyzed an observation with the Nuclear Spectroscopic Telescope Array of the black-hole X-ray binary MAXI J1535-571 in the soft intermediate state, in which we detected a 2.5-ks long flare. Our spectral fitting results suggest that MAXI J1535-571 possesses a high spin of 0.97 (-0.10/+0.02) and a low inclination of approximately 24 deg. We observed a gradual increase in the inner disc radius, as determined from fits to the continuum spectrum. This trend is inconsistent with an increased flux ratio of the thermal component, as well as the source evolving towards the soft state. This inconsistency may be attributed to a gradual decrease of the color correction factor. Additionally, with a flare velocity of approximately 0.5 c and a higher hardness ratio during the flare period, the quasi-simultaneous detection of a type-B QPO in the Neutron Star Interior Composition Explorer data, and quasi-simultaneous ejecta launch through radio observations collectively provide strong evidence supporting the possibility that the flare originated from a discrete jet ejection.

astro-ph.HE↗

arXiv2024

The First Polarimetric View on Quasi-Periodic Oscillations in a Black Hole X-ray Binary

We present the first polarimetric analysis of Quasi-Periodic Oscillations (QPO) in a black hole binary utilizing \textit{IXPE} data. Our study focuses on Swift J1727.8--1613, which experienced a massive outburst that was observed by various telescopes across different wavelengths. The \textit{IXPE} observation we studied was conducted during the Hard-Intermediate state. The polarization degree (PD) and polarization angle (PA) were measured at 4.28$\pm$0.20\% and $1.9^{\circ}\pm1.4^{\circ}$, respectively. Remarkably, significant QPO signals were detected during this observation, with a QPO frequency of approximately 1.34 Hz and a fractional root-mean-square (RMS) amplitude of about 12.3\%. Furthermore, we conducted a phase-resolved analysis of the QPO using the Hilbert-Huang transform technique. The photon index showed a strong modulation with respect to the QPO phase. In contrast, the PD and PA exhibit no modulations in relation to the QPO phase, which is inconsistent with the expectation of the Lense-Thirring precession of the inner flow. Further theoretical studies are needed to conform with the observational results.

astro-ph.HE↗

arXiv2024

Improving Classification Performance With Human Feedback: Label a few, we label the rest

In the realm of artificial intelligence, where a vast majority of data is unstructured, obtaining substantial amounts of labeled data to train supervised machine learning models poses a significant challenge. To address this, we delve into few-shot and active learning, where are goal is to improve AI models with human feedback on a few labeled examples. This paper focuses on understanding how a continuous feedback loop can refine models, thereby enhancing their accuracy, recall, and precision through incremental human input. By employing Large Language Models (LLMs) such as GPT-3.5, BERT, and SetFit, we aim to analyze the efficacy of using a limited number of labeled examples to substantially improve model accuracy. We benchmark this approach on the Financial Phrasebank, Banking, Craigslist, Trec, Amazon Reviews datasets to prove that with just a few labeled examples, we are able to surpass the accuracy of zero shot large language models to provide enhanced text classification performance. We demonstrate that rather than needing to manually label millions of rows of data, we just need to label a few and the model can effectively predict the rest.

cs.LG↗

arXiv2024

The two-way knowledge interaction interface between humans and neural networks

Despite neural networks (NN) have been widely applied in various fields and generally outperforms humans, they still lack interpretability to a certain extent, and humans are unable to intuitively understand the decision logic of NN. This also hinders the knowledge interaction between humans and NN, preventing humans from getting involved to give direct guidance when NN's decisions go wrong. While recent research in explainable AI has achieved interpretability of NN from various perspectives, it has not yet provided effective methods for knowledge exchange between humans and NN. To address this problem, we constructed a two-way interaction interface that uses structured representations of visual concepts and their relationships as the "language" for knowledge exchange between humans and NN. Specifically, NN provide intuitive reasoning explanations to humans based on the class-specific structural concepts graph (C-SCG). On the other hand, humans can modify the biases present in the C-SCG through their prior knowledge and reasoning ability, and thus provide direct knowledge guidance to NN through this interface. Through experimental validation, based on this interaction interface, NN can provide humans with easily understandable explanations of the reasoning process. Furthermore, human involvement and prior knowledge can directly and effectively contribute to enhancing the performance of NN.

cs.HC↗

arXiv2024

Optimal Guarantees for Algorithmic Reproducibility and Gradient Complexity in Convex Optimization

Algorithmic reproducibility measures the deviation in outputs of machine learning algorithms upon minor changes in the training process. Previous work suggests that first-order methods would need to trade-off convergence rate (gradient complexity) for better reproducibility. In this work, we challenge this perception and demonstrate that both optimal reproducibility and near-optimal convergence guarantees can be achieved for smooth convex minimization and smooth convex-concave minimax problems under various error-prone oracle settings. Particularly, given the inexact initialization oracle, our regularization-based algorithms achieve the best of both worlds - optimal reproducibility and near-optimal gradient complexity - for minimization and minimax optimization. With the inexact gradient oracle, the near-optimal guarantees also hold for minimax optimization. Additionally, with the stochastic gradient oracle, we show that stochastic gradient descent ascent is optimal in terms of both reproducibility and gradient complexity. We believe our results contribute to an enhanced understanding of the reproducibility-convergence trade-off in the context of convex optimization.

cs.LG↗

arXiv2024

Image classification network enhancement methods based on knowledge injection

The current deep neural network algorithm still stays in the end-to-end training supervision method like Image-Label pairs, which makes traditional algorithm is difficult to explain the reason for the results, and the prediction logic is difficult to understand and analyze. The current algorithm does not use the existing human knowledge information, which makes the model not in line with the human cognition model and makes the model not suitable for human use. In order to solve the above problems, the present invention provides a deep neural network training method based on the human knowledge, which uses the human cognition model to construct the deep neural network training model, and uses the existing human knowledge information to construct the deep neural network training model. This paper proposes a multi-level hierarchical deep learning algorithm, which is composed of multi-level hierarchical deep neural network architecture and multi-level hierarchical deep learning framework. The experimental results show that the proposed algorithm can effectively explain the hidden information of the neural network. The goal of our study is to improve the interpretability of deep neural networks (DNNs) by providing an analysis of the impact of knowledge injection on the classification task. We constructed a knowledge injection dataset with matching knowledge data and image classification data. The knowledge injection dataset is the benchmark dataset for the experiments in the paper. Our model expresses the improvement in interpretability and classification task performance of hidden layers at different scales.

cs.CV↗

arXiv2024

Content-Conditioned Generation of Stylized Free hand Sketches

In recent years, the recognition of free-hand sketches has remained a popular task. However, in some special fields such as the military field, free-hand sketches are difficult to sample on a large scale. Common data augmentation and image generation techniques are difficult to produce images with various free-hand sketching styles. Therefore, the recognition and segmentation tasks in related fields are limited. In this paper, we propose a novel adversarial generative network that can accurately generate realistic free-hand sketches with various styles. We explore the performance of the model, including using styles randomly sampled from a prior normal distribution to generate images with various free-hand sketching styles, disentangling the painters' styles from known free-hand sketches to generate images with specific styles, and generating images of unknown classes that are not in the training set. We further demonstrate with qualitative and quantitative evaluations our advantages in visual quality, content accuracy, and style imitation on SketchIME.

cs.CV↗

arXiv2024

Flowmind2Digital: The First Comprehensive Flowmind Recognition and Conversion Approach

Flowcharts and mind maps, collectively known as flowmind, are vital in daily activities, with hand-drawn versions facilitating real-time collaboration. However, there's a growing need to digitize them for efficient processing. Automated conversion methods are essential to overcome manual conversion challenges. Existing sketch recognition methods face limitations in practical situations, being field-specific and lacking digital conversion steps. Our paper introduces the Flowmind2digital method and hdFlowmind dataset to address these challenges. Flowmind2digital, utilizing neural networks and keypoint detection, achieves a record 87.3% accuracy on our dataset, surpassing previous methods by 11.9%. The hdFlowmind dataset, comprising 1,776 annotated flowminds across 22 scenarios, outperforms existing datasets. Additionally, our experiments emphasize the importance of simple graphics, enhancing accuracy by 9.3%.

cs.CV↗

arXiv2024

A multimodal gesture recognition dataset for desktop human-computer interaction

Gesture recognition is an indispensable component of natural and efficient human-computer interaction technology, particularly in desktop-level applications, where it can significantly enhance people's productivity. However, the current gesture recognition community lacks a suitable desktop-level (top-view perspective) dataset for lightweight gesture capture devices. In this study, we have established a dataset named GR4DHCI. What distinguishes this dataset is its inherent naturalness, intuitive characteristics, and diversity. Its primary purpose is to serve as a valuable resource for the development of desktop-level portable applications. GR4DHCI comprises over 7,000 gesture samples and a total of 382,447 frames for both Stereo IR and skeletal modalities. We also address the variances in hand positioning during desktop interactions by incorporating 27 different hand positions into the dataset. Building upon the GR4DHCI dataset, we conducted a series of experimental studies, the results of which demonstrate that the fine-grained classification blocks proposed in this paper can enhance the model's recognition accuracy. Our dataset and experimental findings presented in this paper are anticipated to propel advancements in desktop-level gesture recognition research.

cs.CV↗

arXiv2024

Velocity-based sparse photon clustering for space debris ranging by single-photon Lidar

Single-photon Lidar (SPL) offers unprecedented sensitivity and time resolution, which enables Satellite Laser Ranging (SLR) systems to identify space debris from distances spanning thousands of kilometers. However, existing SPL systems face limitations in distance-trajectory extraction due to the widespread and undifferentiated noise photons. In this paper, we propose a novel velocity-based sparse photon clustering algorithm, leveraging the velocity correlation of the target's echo signal photons in the distance-time dimension, by computing and searching the velocity and acceleration of photon distance points between adjacent pulses over a period of time and subsequently clustering photons with the same velocity and acceleration. Our algorithm can extract object trajectories from sparse photon data, even in low signal-to-noise ratio (SNR) conditions. To verify our method, we establish a ground simulation experimental setup for a single-photon ranging Lidar system. The experimental results show that our algorithm can extract the quadratic track with over 99 percent accuracy in only tens of milliseconds, with a signal photon counting rate of 5 percent at -20 dB SNR. Our method provides an effective approach for detecting and sensing extremely weak signals at the sub-photon level in space.

physics.data-an↗

arXiv2023

Conditional Variational Autoencoder for Sign Language Translation with Cross-Modal Alignment

Sign language translation (SLT) aims to convert continuous sign language videos into textual sentences. As a typical multi-modal task, there exists an inherent modality gap between sign language videos and spoken language text, which makes the cross-modal alignment between visual and textual modalities crucial. However, previous studies tend to rely on an intermediate sign gloss representation to help alleviate the cross-modal problem thereby neglecting the alignment across modalities that may lead to compromised results. To address this issue, we propose a novel framework based on Conditional Variational autoencoder for SLT (CV-SLT) that facilitates direct and sufficient cross-modal alignment between sign language videos and spoken language text. Specifically, our CV-SLT consists of two paths with two Kullback-Leibler (KL) divergences to regularize the outputs of the encoder and decoder, respectively. In the prior path, the model solely relies on visual information to predict the target text; whereas in the posterior path, it simultaneously encodes visual information and textual knowledge to reconstruct the target text. The first KL divergence optimizes the conditional variational autoencoder and regularizes the encoder outputs, while the second KL divergence performs a self-distillation from the posterior path to the prior path, ensuring the consistency of decoder outputs. We further enhance the integration of textual information to the posterior path by employing a shared Attention Residual Gaussian Distribution (ARGD), which considers the textual information in the posterior path as a residual component relative to the prior path. Extensive experiments conducted on public datasets (PHOENIX14T and CSL-daily) demonstrate the effectiveness of our framework, achieving new state-of-the-art results while significantly alleviating the cross-modal representation discrepancy.

cs.CL↗

arXiv2023

Opportunities and Challenges of Applying Large Language Models in Building Energy Efficiency and Decarbonization Studies: An Exploratory Overview

In recent years, the rapid advancement and impressive capabilities of Large Language Models (LLMs) have been evident across various domains. This paper explores the application, implications, and potential of LLMs in building energy efficiency and decarbonization studies. The wide-ranging capabilities of LLMs are examined in the context of the building energy field, including intelligent control systems, code generation, data infrastructure, knowledge extraction, and education. Despite the promising potential of LLMs, challenges including complex and expensive computation, data privacy, security and copyright, complexity in fine-tuned LLMs, and self-consistency are discussed. The paper concludes with a call for future research focused on the enhancement of LLMs for domain-specific tasks, multi-modal LLMs, and collaborative research between AI and energy experts.

eess.SY↗

arXiv2023

Enhance Sketch Recognition's Explainability via Semantic Component-Level Parsing

Free-hand sketches are appealing for humans as a universal tool to depict the visual world. Humans can recognize varied sketches of a category easily by identifying the concurrence and layout of the intrinsic semantic components of the category, since humans draw free-hand sketches based a common consensus that which types of semantic components constitute each sketch category. For example, an airplane should at least have a fuselage and wings. Based on this analysis, a semantic component-level memory module is constructed and embedded in the proposed structured sketch recognition network in this paper. The memory keys representing semantic components of each sketch category can be self-learned and enhance the recognition network's explainability. Our proposed networks can deal with different situations of sketch recognition, i.e., with or without semantic components labels of strokes. Experiments on the SPG and SketchIME datasets demonstrate the memory module's flexibility and the recognition network's explainability. The code and data are available at https://github.com/GuangmingZhu/SketchESC.

cs.CV↗

arXiv2023

High Q and high gradient performance of the first medium-temperature baking 1.3 GHz cryomodule

World's first 1.3 GHz cryomodule containing eight 9-cell superconducting radio-frequency (RF) cavities treated by medium-temperature furnace baking (mid-T bake) was developed, assembled and tested at IHEP for the Dalian Advanced Light Source (DALS) and CEPC R&D. The 9-cell cavities in the cryomodule achieved an unprecedented highest average Q0 of 3.8E10 at 16 MV/m and 3.6E10 at 21 MV/m in the horizontal test. The cryomodule can operate stably up to a total CW RF voltage greater than 191 MV, with an average cavity CW accelerating gradient of more than 23 MV/m. The results significantly exceed the specifications of CEPC, DALS and the other high repetition rate free electron laser facilities (LCLS-II, LCLS-II-HE, SHINE, S3FEL). There is evidence that the mid-T bake cavity may not require fast cool-down or long processing time in the cryomodule. This paper reviews the cryomodule performance and discusses some important issues in cryomodule assembly and testing.

physics.acc-ph↗

arXiv2023

Optimizing and Fine-tuning Large Language Model for Urban Renewal

This study aims to innovatively explore adaptive applications of large language models (LLM) in urban renewal. It also aims to improve its performance and text generation quality for knowledge question-answering (QA) tasks. Based on the ChatGLM, we automatically generate QA datasets using urban renewal scientific literature corpora in a self-instruct manner and then conduct joint fine-tuning training on the model using the Prefix and LoRA fine-tuning methods to create an LLM for urban renewal. By guiding the LLM to automatically generate QA data based on prompt words and given text, it is possible to quickly obtain datasets in the urban renewal field and provide data support for the fine-tuning training of LLMs. The experimental results show that the joint fine-tuning training method proposed in this study can significantly improve the performance of LLM on the QA tasks. Compared with LoRA fine-tuning, the method improves the Bleu and Rouge metrics on the test by about 5%; compared with the model before fine-tuning, the method improves the Bleu and Rouge metrics by about 15%-20%. This study demonstrates the effectiveness and superiority of the joint fine-tuning method using Prefix and LoRA for ChatGLM in the urban renewal knowledge QA tasks. It provides a new approach for fine-tuning LLMs on urban renewal-related tasks.

cs.CL↗