SearcharxivSearch

arXiv subjects

Dongju Jang

Publications and source records attributed to Dongju Jang.

3 recordsLinked to original sources

Explain with Visual Keypoints Like a Real Mentor! A Benchmark for Multimodal Solution Explanation

With the rapid advancement of mathematical reasoning capabilities in Large Language Models (LLMs), AI systems are increasingly being adopted in educational settings to support students' comprehension of problem-solving processes. However, a critical component remains underexplored in current LLM-generated explanations: multimodal explanation. In real-world instructional contexts, human tutors routinely employ visual aids, such as diagrams, markings, and highlights, to enhance conceptual clarity. To bridge this gap, we introduce the multimodal solution explanation task, designed to evaluate whether models can identify visual keypoints, such as auxiliary lines, points, angles, and generate explanations that incorporate these key elements essential for understanding. To evaluate model performance on this task, we propose ME2, a multimodal benchmark consisting of 1,000 math problems annotated with visual keypoints and corresponding explanatory text that references those elements. Our empirical results show that current models struggle to identify visual keypoints. In the task of generating keypoint-based explanations, open-source models also face notable difficulties. This highlights a significant gap in current LLMs' ability to perform mathematical visual grounding, engage in visually grounded reasoning, and provide explanations in educational contexts. We expect that the multimodal solution explanation task and the ME2 dataset will catalyze further research on LLMs in education and promote their use as effective, explanation-oriented AI tutors.

cs.CL

Subtle Risks, Critical Failures: A Framework for Diagnosing Physical Safety of LLMs for Embodied Decision Making

Large Language Models (LLMs) are increasingly used for decision making in embodied agents, yet existing safety evaluations often rely on coarse success rates and domain-specific setups, making it difficult to diagnose why and where these models fail. This obscures our understanding of embodied safety and limits the selective deployment of LLMs in high-risk physical environments. We introduce SAFEL, the framework for systematically evaluating the physical safety of LLMs in embodied decision making. SAFEL assesses two key competencies: (1) rejecting unsafe commands via the Command Refusal Test, and (2) generating safe and executable plans via the Plan Safety Test. Critically, the latter is decomposed into functional modules, goal interpretation, transition modeling, action sequencing, enabling fine-grained diagnosis of safety failures. To support this framework, we introduce EMBODYGUARD, a PDDL-grounded benchmark containing 942 LLM-generated scenarios covering both overtly malicious and contextually hazardous instructions. Evaluation across 13 state-of-the-art LLMs reveals that while models often reject clearly unsafe commands, they struggle to anticipate and mitigate subtle, situational risks. Our results highlight critical limitations in current LLMs and provide a foundation for more targeted, modular improvements in safe embodied reasoning.

cs.AI

Fully printed flexible perovskite solar modules with improved energy alignment by tin oxide surface modification

Fully printed flexible perovskite solar cells (f-PSCs) show great potential for the commercialization of perovskite photovoltaics owing to their compatibility with high-throughput roll-to-roll (R2R) production. However, the challenge remains in the deficiency in controlling interfacial recombination losses of the functional layer, causing remarkable loss of power conversion efficiency (PCE) in industrial production. Here, a fullerene-substituted alkylphosphonic acid dipole layer is introduced between the R2R-printed tin oxide electron transport layer and the perovskite active layer to reduce the energetic barrier and to suppress surface recombination at the buried interface. The resulting f-PSCs exhibit a PCE of 17.0% with negligible hysteresis, retain 95% of their initial PCE over 3000 bending cycles and achieve a T95 lifetime of 1200 h under 1 sun and 65 degreeC in nitrogen atmosphere. Moreover, the fully printed flexible perovskite solar mini-modules (f-PSMs) with a 20.25 cm2 aperture area achieve a PCE of 11.6%. The encapsulated f-PSMs retain 90% of their initial PCE after 500 h damp-heat testing at 65 degreeC and 85% relative humidity (ISOS-D3). This work marks an important progress toward the realization of efficient and stable flexible perovskite photovoltaics for commercialization.

cond-mat.mtrl-sci