Searcharxiv⌕ Search

arXiv subjects

Jina Kang

Publications and source records attributed to Jina Kang.

2 recordsLinked to original sources

SecODD: Adapting the Operational Design Domain from Driving Autonomy to Autonomous Cyber Defense

Security operations centers are beginning to delegate detection, triage, and containment to Autonomous Cyber Defense (ACD) agents at execution time. Erroneous high-impact playbooks can disrupt critical services and create accountability gaps among deployers, SOC supervisors, vendors, managed service providers, and infrastructure providers. We propose SecODD, an execution-time governance framework for ACD that adapts the Operational Design Domain concept from autonomous-vehicle regulation to cyber autonomy. It defines the authorized scope of automated defensive actions, models when meaningful human intervention must remain possible, and specifies auditable due-care conditions through a Mitigation Safe Harbor. Four engineering requirements---tamper-evident logging, human-in-the-loop orchestration, rollback playbooks, and safe-state transition controls---are evaluated through a per-scenario audit matrix that illustrates how two ACD failure modes can be translated into pass/fail audit outcomes. The result is an evidence-oriented framework that authorizes ACD only when autonomous actions are bounded, interruptible, recoverable, and reconstructable from evidence.

cs.CR↗

Can LLMs Reliably Simulate Human Learner Actions? A Simulation Authoring Framework for Open-Ended Learning Environments

Simulating learner actions helps stress-test open-ended interactive learning environments and prototype new adaptations before deployment. While recent studies show the promise of using large language models (LLMs) for simulating human behavior, such approaches have not gone beyond rudimentary proof-of-concept stages due to key limitations. First, LLMs are highly sensitive to minor prompt variations, raising doubts about their ability to generalize to new scenarios without extensive prompt engineering. Moreover, apparently successful outcomes can often be unreliable, either because domain experts unintentionally guide LLMs to produce expected results, leading to self-fulfilling prophecies; or because the LLM has encountered highly similar scenarios in its training data, meaning that models may not be simulating behavior so much as regurgitating memorized content. To address these challenges, we propose Hyp-Mix, a simulation authoring framework that allows experts to develop and evaluate simulations by combining testable hypotheses about learner behavior. Testing this framework in a physics learning environment, we found that GPT-4 Turbo maintains calibrated behavior even as the underlying learner model changes, providing the first evidence that LLMs can be used to simulate realistic behaviors in open-ended interactive learning environments, a necessary prerequisite for useful LLM behavioral simulation.

cs.AI↗