arXiv subjects

Qian Niu

Publications and source records attributed to Qian Niu.

At least 55 records · Page 3Linked to original sources

arXiv2025

Surveying the MLLM Landscape: A Meta-Review of Current Surveys

The rise of Multimodal Large Language Models (MLLMs) has become a transformative force in the field of artificial intelligence, enabling machines to process and generate content across multiple modalities, such as text, images, audio, and video. These models represent a significant advancement over traditional unimodal systems, opening new frontiers in diverse applications ranging from autonomous agents to medical diagnostics. By integrating multiple modalities, MLLMs achieve a more holistic understanding of information, closely mimicking human perception. As the capabilities of MLLMs expand, the need for comprehensive and accurate performance evaluation has become increasingly critical. This survey aims to provide a systematic review of benchmark tests and evaluation methods for MLLMs, covering key topics such as foundational concepts, applications, evaluation methodologies, ethical concerns, security, efficiency, and domain-specific applications. Through the classification and analysis of existing literature, we summarize the main contributions and methodologies of various surveys, conduct a detailed comparative analysis, and examine their impact within the academic community. Additionally, we identify emerging trends and underexplored areas in MLLM research, proposing potential directions for future studies. This survey is intended to offer researchers and practitioners a comprehensive understanding of the current state of MLLM evaluation, thereby facilitating further progress in this rapidly evolving field.

cs.CL↗

arXiv2025

Deep Learning and Machine Learning, Advancing Big Data Analytics and Management: Unveiling AI's Potential Through Tools, Techniques, and Applications

Artificial intelligence (AI), machine learning, and deep learning have become transformative forces in big data analytics and management, enabling groundbreaking advancements across diverse industries. This article delves into the foundational concepts and cutting-edge developments in these fields, with a particular focus on large language models (LLMs) and their role in natural language processing, multimodal reasoning, and autonomous decision-making. Highlighting tools such as ChatGPT, Claude, and Gemini, the discussion explores their applications in data analysis, model design, and optimization. The integration of advanced algorithms like neural networks, reinforcement learning, and generative models has enhanced the capabilities of AI systems to process, visualize, and interpret complex datasets. Additionally, the emergence of technologies like edge computing and automated machine learning (AutoML) democratizes access to AI, empowering users across skill levels to engage with intelligent systems. This work also underscores the importance of ethical considerations, transparency, and fairness in the deployment of AI technologies, paving the way for responsible innovation. Through practical insights into hardware configurations, software environments, and real-world applications, this article serves as a comprehensive resource for researchers and practitioners. By bridging theoretical underpinnings with actionable strategies, it showcases the potential of AI and LLMs to revolutionize big data management and drive meaningful advancements across domains such as healthcare, finance, and autonomous systems.

cs.CL↗

arXiv2025

Mastering AI: Big Data, Deep Learning, and the Evolution of Large Language Models -- AutoML from Basics to State-of-the-Art Techniques

A comprehensive guide to Automated Machine Learning (AutoML) is presented, covering fundamental principles, practical implementations, and future trends. The paper is structured to assist both beginners and experienced practitioners, with detailed discussions on popular AutoML tools such as TPOT, AutoGluon, and Auto-Keras. Emerging topics like Neural Architecture Search (NAS) and AutoML's applications in deep learning are also addressed. It is anticipated that this work will contribute to ongoing research and development in the field of AI and machine learning.

cs.LG↗

arXiv2025

From Word Vectors to Multimodal Embeddings: Techniques, Applications, and Future Directions For Large Language Models

Word embeddings and language models have transformed natural language processing (NLP) by facilitating the representation of linguistic elements in continuous vector spaces. This review visits foundational concepts such as the distributional hypothesis and contextual similarity, tracing the evolution from sparse representations like one-hot encoding to dense embeddings including Word2Vec, GloVe, and fastText. We examine both static and contextualized embeddings, underscoring advancements in models such as ELMo, BERT, and GPT and their adaptations for cross-lingual and personalized applications. The discussion extends to sentence and document embeddings, covering aggregation methods and generative topic models, along with the application of embeddings in multimodal domains, including vision, robotics, and cognitive science. Advanced topics such as model compression, interpretability, numerical encoding, and bias mitigation are analyzed, addressing both technical challenges and ethical implications. Additionally, we identify future research directions, emphasizing the need for scalable training techniques, enhanced interpretability, and robust grounding in non-textual modalities. By synthesizing current methodologies and emerging trends, this survey offers researchers and practitioners an in-depth resource to push the boundaries of embedding-based language models.

cs.CL↗

arXiv2025

From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing

Remote sensing has evolved from simple image acquisition to complex systems capable of integrating and processing visual and textual data. This review examines the development and application of multi-modal language models (MLLMs) in remote sensing, focusing on their ability to interpret and describe satellite imagery using natural language. We cover the technical underpinnings of MLLMs, including dual-encoder architectures, Transformer models, self-supervised and contrastive learning, and cross-modal integration. The unique challenges of remote sensing data--varying spatial resolutions, spectral richness, and temporal changes--are analyzed for their impact on MLLM performance. Key applications such as scene description, object detection, change detection, text-to-image retrieval, image-to-text generation, and visual question answering are discussed to demonstrate their relevance in environmental monitoring, urban planning, and disaster response. We review significant datasets and resources supporting the training and evaluation of these models. Challenges related to computational demands, scalability, data quality, and domain adaptation are highlighted. We conclude by proposing future research directions and technological advancements to further enhance MLLM utility in remote sensing.

cs.CV↗

arXiv2025

Large Language Models and Cognitive Science: A Comprehensive Review of Similarities, Differences, and Challenges

This comprehensive review explores the intersection of Large Language Models (LLMs) and cognitive science, examining similarities and differences between LLMs and human cognitive processes. We analyze methods for evaluating LLMs cognitive abilities and discuss their potential as cognitive models. The review covers applications of LLMs in various cognitive fields, highlighting insights gained for cognitive science research. We assess cognitive biases and limitations of LLMs, along with proposed methods for improving their performance. The integration of LLMs with cognitive architectures is examined, revealing promising avenues for enhancing artificial intelligence (AI) capabilities. Key challenges and future research directions are identified, emphasizing the need for continued refinement of LLMs to better align with human cognition. This review provides a balanced perspective on the current state and future potential of LLMs in advancing our understanding of both artificial and human intelligence.

cs.AI↗

arXiv2025

From Text to Multimodality: Exploring the Evolution and Impact of Large Language Models in Medical Practice

Large Language Models (LLMs) have rapidly evolved from text-based systems to multimodal platforms, significantly impacting various sectors including healthcare. This comprehensive review explores the progression of LLMs to Multimodal Large Language Models (MLLMs) and their growing influence in medical practice. We examine the current landscape of MLLMs in healthcare, analyzing their applications across clinical decision support, medical imaging, patient engagement, and research. The review highlights the unique capabilities of MLLMs in integrating diverse data types, such as text, images, and audio, to provide more comprehensive insights into patient health. We also address the challenges facing MLLM implementation, including data limitations, technical hurdles, and ethical considerations. By identifying key research gaps, this paper aims to guide future investigations in areas such as dataset development, modality alignment methods, and the establishment of ethical guidelines. As MLLMs continue to shape the future of healthcare, understanding their potential and limitations is crucial for their responsible and effective integration into medical practice.

cs.CY↗

arXiv2025

Securing Large Language Models: Addressing Bias, Misinformation, and Prompt Attacks

Large Language Models (LLMs) demonstrate impressive capabilities across various fields, yet their increasing use raises critical security concerns. This article reviews recent literature addressing key issues in LLM security, with a focus on accuracy, bias, content detection, and vulnerability to attacks. Issues related to inaccurate or misleading outputs from LLMs is discussed, with emphasis on the implementation from fact-checking methodologies to enhance response reliability. Inherent biases within LLMs are critically examined through diverse evaluation techniques, including controlled input studies and red teaming exercises. A comprehensive analysis of bias mitigation strategies is presented, including approaches from pre-processing interventions to in-training adjustments and post-processing refinements. The article also probes the complexity of distinguishing LLM-generated content from human-produced text, introducing detection mechanisms like DetectGPT and watermarking techniques while noting the limitations of machine learning enabled classifiers under intricate circumstances. Moreover, LLM vulnerabilities, including jailbreak attacks and prompt injection exploits, are analyzed by looking into different case studies and large-scale competitions like HackAPrompt. This review is concluded by retrospecting defense mechanisms to safeguard LLMs, accentuating the need for more extensive research into the LLM security field.

cs.CR↗

arXiv2025

Deep Learning and Machine Learning, Advancing Big Data Analytics and Management: Tensorflow Pretrained Models

The application of TensorFlow pre-trained models in deep learning is explored, with an emphasis on practical guidance for tasks such as image classification and object detection. The study covers modern architectures, including ResNet, MobileNet, and EfficientNet, and demonstrates the effectiveness of transfer learning through real-world examples and experiments. A comparison of linear probing and model fine-tuning is presented, supplemented by visualizations using techniques like PCA, t-SNE, and UMAP, allowing for an intuitive understanding of the impact of these approaches. The work provides complete example code and step-by-step instructions, offering valuable insights for both beginners and advanced users. By integrating theoretical concepts with hands-on practice, the paper equips readers with the tools necessary to address deep learning challenges efficiently.

cs.LG↗

arXiv2025

Deep Learning and Machine Learning with GPGPU and CUDA: Unlocking the Power of Parallel Computing

General Purpose Graphics Processing Unit (GPGPU) computing plays a transformative role in deep learning and machine learning by leveraging the computational advantages of parallel processing. Through the power of Compute Unified Device Architecture (CUDA), GPUs enable the efficient execution of complex tasks via massive parallelism. This work explores CPU and GPU architectures, data flow in deep learning, and advanced GPU features, including streams, concurrency, and dynamic parallelism. The applications of GPGPU span scientific computing, machine learning acceleration, real-time rendering, and cryptocurrency mining. This study emphasizes the importance of selecting appropriate parallel architectures, such as GPUs, FPGAs, TPUs, and ASICs, tailored to specific computational tasks and optimizing algorithms for these platforms. Practical examples using popular frameworks such as PyTorch, TensorFlow, and XGBoost demonstrate how to maximize GPU efficiency for training and inference tasks. This resource serves as a comprehensive guide for both beginners and experienced practitioners, offering insights into GPU-based parallel computing and its critical role in advancing machine learning and artificial intelligence.

cs.DC↗

arXiv2025

Deep Learning and Machine Learning -- Object Detection and Semantic Segmentation: From Theory to Applications

An in-depth exploration of object detection and semantic segmentation is provided, combining theoretical foundations with practical applications. State-of-the-art advancements in machine learning and deep learning are reviewed, focusing on convolutional neural networks (CNNs), YOLO architectures, and transformer-based approaches such as DETR. The integration of artificial intelligence (AI) techniques and large language models for enhancing object detection in complex environments is examined. Additionally, a comprehensive analysis of big data processing is presented, with emphasis on model optimization and performance evaluation metrics. By bridging the gap between traditional methods and modern deep learning frameworks, valuable insights are offered for researchers, data scientists, and engineers aiming to apply AI-driven methodologies to large-scale object detection tasks.

cs.CV↗

arXiv2025

Deep Learning and Machine Learning -- Natural Language Processing: From Theory to Application

With a focus on natural language processing (NLP) and the role of large language models (LLMs), we explore the intersection of machine learning, deep learning, and artificial intelligence. As artificial intelligence continues to revolutionize fields from healthcare to finance, NLP techniques such as tokenization, text classification, and entity recognition are essential for processing and understanding human language. This paper discusses advanced data preprocessing techniques and the use of frameworks like Hugging Face for implementing transformer-based models. Additionally, it highlights challenges such as handling multilingual data, reducing bias, and ensuring model robustness. By addressing key aspects of data processing and model fine-tuning, this work aims to provide insights into deploying effective and ethically sound AI solutions.

cs.CL↗

arXiv2025

Large Language Model Benchmarks in Medical Tasks

With the increasing application of large language models (LLMs) in the medical domain, evaluating these models' performance using benchmark datasets has become crucial. This paper presents a comprehensive survey of various benchmark datasets employed in medical LLM tasks. These datasets span multiple modalities including text, image, and multimodal benchmarks, focusing on different aspects of medical knowledge such as electronic health records (EHRs), doctor-patient dialogues, medical question-answering, and medical image captioning. The survey categorizes the datasets by modality, discussing their significance, data structure, and impact on the development of LLMs for clinical tasks such as diagnosis, report generation, and predictive decision support. Key benchmarks include MIMIC-III, MIMIC-IV, BioASQ, PubMedQA, and CheXpert, which have facilitated advancements in tasks like medical report generation, clinical summarization, and synthetic data generation. The paper summarizes the challenges and opportunities in leveraging these benchmarks for advancing multimodal medical intelligence, emphasizing the need for datasets with a greater degree of language diversity, structured omics data, and innovative approaches to synthesis. This work also provides a foundation for future research in the application of LLMs in medicine, contributing to the evolving field of medical artificial intelligence.

cs.CL↗

arXiv2025

Berry Curvature Induced Spin Nernst and Thermal Edelstein Effects in Proximity Superconductors

We propose two thermo-spintronic responses in proximity induced superconductors with spin-orbit coupled band - spin Nernst effect and thermal Edelstein effect stemming respectively from momentum-space and mixed superconducting Berry curvatures. We unveil that the Bloch band spin-orbit coupling and pairing are entangled in shaping the superconducting Berry curvatures rather than in an additive manner. The resulting thermo-spintronic responses are significantly enhanced at low temperatures by the emergence of Bogoliubov Fermi surface, and can be effectively controlled by tuning the latter. The effects render a probe of Bogoliubov Fermi surface and superconducting Berry curvatures supported by it. Our work reveals Berry curvature properties in topologically trivial proximity superconductors with spin-orbit coupling, and opens a new route to superconducting spintronics.

cond-mat.supr-con↗

arXiv2025

Proper Definition of Intrinsic Nonlinear Current

We show that the three commonly employed approaches that define the same dc (or low-frequency) intrinsic linear anomalous Hall response actually lead to different results for intrinsic nonlinear transport. The difference is due to an intrinsic anomalous distribution (IAD). It originates from a nonlinear field effect during scattering, but its value is completely independent of scattering, because it represents the local equilibration of electron wave packets with field corrected energy. The proper definition of intrinsic current that is detectable in experiment must incorporate the effect of IAD. We also show that IAD is indispensable for consistency with fundamental physical relations. In addition, we predict that under ac driving, the intrinsic reponses in rectified and double-frequency channels exhibit distinct frequency dependence, for which we estimate the signals that can be probed in antiferromagnetic CuMnAs.

cond-mat.mes-hall↗

arXiv2025

Spin-Valley Locking and Pure Spin-Triplet Superconductivity in Noncollinear Antiferromagnets Proximitized to Conventional Superconductors

Unconventional antiferromagnets with spin-split bands, such as noncollinear magnets and the recently discovered altermagnets, serve as new constituents to explore unconventional superconductivity. Here, we unveil a new type and previously unappreciated nature of spin-valley locking in noncollinear antiferromagnets and exploit this texture to achieve pure spin-triplet superconductivity. Using chiral antiferromagnetic kagome lattices (e.g., Mn$_3$Ge and Mn$_3$Ga) coupled to conventional $s$-wave superconductors as prototypical examples, we demonstrate that the antiferromagnetic chirality strongly favors spin-triplet pairing via superconducting proximity effect, while suppressing spin-singlet pairing in the antiferromagnets away from the interfaces. Crucially, such a long-sought spin-triplet superconducting state is established without invoking the prevailing mechanism of spin-orbit coupling or net magnetization. Furthermore, the spin-triplet supercurrent is resilient to both in-plane and out-of-plane Zeeman fields, which exhibits distinct superiority to Ising superconductivity, serving as a compelling experimental signature of the triplet pairing and spin-valley-locked texture.

cond-mat.supr-con↗

arXiv2025

Rigid-Body Anisotropy in Noncollinear Antiferromagnets

Characterizing the anisotropic structure in noncollinear antiferromagnets is essential for antiferromagnetic spintronics. In this work, we provide a microscopic theory linking the anisotropy effects induced by the rigid-body rotation of spin order to spin-orbit coupling. Our method goes beyond the conventional magnetic group theory, offering a concise yet powerful tool to characterize diverse anisotropy effects in complex magnetic systems. Using the group representation theory of the spin group, we obtain a set of basis functions formed from tensor elements of spin-orbit vector--which originates from spin-orbit coupling and is tied to the rigid-body rotation of the spin order--to systematically describe the structure of anisotropy effects. As a concrete example, we apply our framework to coplanar antiferromagnets Mn$_3$Sn and Mn$_3$Ir, demonstrating that the corresponding basis functions can well capture both the geometric and magnitude dependencies of the magnetic anisotropy energy and anomalous Hall conductivity. Finally, we discuss the generalization of our framework to broader classes of anisotropy phenomena in magnetic systems.

cond-mat.mtrl-sci↗

arXiv2025

Quantum Anomalous Hall Effect in Flat Bands with Paramagnetism

Quantum anomalous Hall effect has been widely explored in both ferromagnetic and antiferromagnetic systems. Here, we propose an interaction-driven paramagnetic quantum anomalous Hall effect emerging in the Fermion-Hubbard model on a dice lattice with weak spin-orbit coupling. Based on exact diagonalization calculations, the time-reversal symmetry breaking in the ground state is evidenced by nonuniform loop currents between nearest-neighbor sites. The many-body ground state possesses a Chern number of $\mathcal{C}=2$ or $6$, and strong correlation effects in the half-filled flat bands lead to a well-defined first excitation gap and a clear insulating gap, ensuring the robustness against thermal fluctuations and external perturbations. The interplay between spin-orbit coupling and Hubbard interaction allows tunability of various magnetic ground states, generating a rich phase diagram with competing ferromagnetic, antiferromagnetic, and paramagnetic orders.

cond-mat.str-el↗