SearcharxivSearch

arXiv subjects

Jingang Zhou

Publications and source records attributed to Jingang Zhou.

3 recordsLinked to original sources

APTER: Adaptive Post-Training with Expert-Grounded Rubrics

As large language models enter professional domains, they must satisfy domain constraints, include critical evidence, and provide complete reasoning rather than merely produce fluent responses. Existing post-training methods often rely on holistic preferences or outcome-level verification, while recent rubric-based methods usually generate rubrics independently for each query. In specialized domains, such unconstrained rubrics may omit critical requirements and vary across samples, hindering the diagnosis and targeted repair of persistent capability deficiencies. We propose APTER (Adaptive Post-Training with Expert-Grounded Rubrics), a framework that integrates structured domain knowledge into fine-grained evaluation, optimization, and diagnosis for specialized complex reasoning. First, expert-grounded rubric construction starts from an expert criteria framework built by domain experts, where each criterion represents a stable professional capability. For each query, APTER selects relevant criteria and instantiates them into query-level rubrics linked to their source criteria, turning reusable expert criteria into executable query-level supervision without reference answers. Second, adaptive post-training uses rubric verdicts as both optimization and criterion-level diagnostic signals. Aggregating low-scoring verdicts by criterion ID reveals persistent deficiencies and triggers targeted supervised fine-tuning updates during reinforcement learning. Experiments on mathematical reasoning and medical question answering show consistent gains across both domains. Across three model generations, APTER improves the mathematics and medical averages over the corresponding base models by up to 15.86 and 8.04 points, respectively. Code and rubric datasets are available at https://github.com/AntDT-APTER/APTER.

cs.AI

Continual Learning for Generative AI: From LLMs to MLLMs and Beyond

The rapid advancement of generative models has empowered modern AI systems to comprehend and produce highly sophisticated content, even achieving human-level performance in specific domains. However, these models are fundamentally constrained by \emph{catastrophic forgetting}, \ie~a persistent challenge where models experience performance degradation on previously learned tasks when adapting to new tasks. To address this practical limitation, numerous approaches have been proposed to enhance the adaptability and scalability of generative AI in real-world applications. In this work, we present a comprehensive survey of continual learning methods for mainstream generative AI models, encompassing large language models, multimodal large language models, vision-language-action models, and diffusion models. Drawing inspiration from the memory mechanisms of the human brain, we systematically categorize these approaches into three paradigms: architecture-based, regularization-based, and replay-based methods, while elucidating their underlying methodologies and motivations. We further analyze continual learning setups for different generative models, including training objectives, benchmarks, and core backbones, thereby providing deeper insights into the field. The project page of this paper is available at https://github.com/Ghy0501/Awesome-Continual-Learning-in-Generative-Models.

cs.LG

Enhanced anisotropic superconductivity in the topological nodal-line semimetal InxTaS2

Coexistence of topological bands and charge density wave (CDW) in topological materials has attracted immense attentions because of their fantastic properties, such as axionic-CDW, three-dimensional quantum Hall effect, etc. In this work, a nodal-line semimetal InxTaS2 characterized by CDW and superconductivity is successfully synthesized, whose structure and topological bands (two separated Wely rings) are similar to In0.58TaSe2. A 2 x 2 commensurate CDW is observed at low temperature in InxTaS2, identified by transport properties and STM measurements. Moreover, superconductivity emerges below 0.69 K, and the anisotropy ratio of upper critical field [Gamma = H||ab c2(0)=H||c c2(0)] is significantly enhanced compared to 2H-TaS2, which shares the same essential layer unit. According to the Lawrence-Doniach model, the enhanced Gamma may be explained by the reduced effective mass in kx-ky plane, where Weyl rings locate. Therefore, this type of layered topological systems may offer a platform to investigate highly anisotropic superconductivity and to understand the extremely large upper critical field in the bulk or in the two-dimensional limit.

cond-mat.supr-con