SearcharxivSearch

arXiv subjects

Ka Ching Chan

Publications and source records attributed to Ka Ching Chan.

5 recordsLinked to original sources

From Structural Equation Modelling to Double Machine Learning: Robustness Analysis for Survey-Based Research

Structural equation modelling (SEM) is widely used in survey-based business and information systems research to assess latent constructs and theory-driven structural relationships. However, SEM path significance is obtained within a particular model specification and may not show whether findings remain stable under alternative estimation frameworks. This study develops and demonstrates a staged robustness analysis framework that connects SEM, ordinary least squares (OLS) regression, and Double Machine Learning (DML). SEM is first used to refine the measurement structure and estimate the robustness-baseline SEM model, in which the full theory-specified structural path system is retained for downstream robustness analysis before final structural path evaluation. OLS regression is then applied to SEM-derived construct scores as a transparent regression benchmark. Finally, DML-style residualisation is used to examine whether each tested focal relationship remains stable after flexible machine-learning-based adjustment for observed controls. Learner-sensitivity checks compare Random Forest, Gradient Boosting, and Support Vector Machine learners, and selected reverse-direction diagnostics are used to examine directional sensitivity. The framework is demonstrated using a FinTech Digital Customer Intimacy survey model. The findings identify which relationships are stable across SEM, OLS, and DML-style checks, and which require more cautious interpretation. A reproducible Google Colab workbook and generated result files are publicly available, providing a reusable template that researchers and students can adapt to other survey-based latent-construct studies. The paper contributes a practical robustness workflow and interpretation guide for survey-based researchers seeking to complement SEM with conventional and machine-learning-based robustness checks.

cs.LG

Applying SHAPR in AI-Assisted Research Software Development: Lessons Learnt from Building a Share Trading System

Generative AI is changing how research software is developed, but rapid AI-assisted development can weaken continuity, traceability, and methodological clarity. SHAPR (Solo, Human-centred, AI-assisted PRactice) was proposed as a framework for structuring AI-assisted research software development. This paper presents a documented case of applying SHAPR to the development of a modular share trading system. From the outset, the project adopted a SHAPR-informed working configuration that shaped how interaction, implementation, and documentation were organised. Across iterative development cycles, the project generated a structured evidence base including reflection notes, development cycle review notes, source-of-truth documents, contracts, quick captures, workflow notes, and evolving code artefacts. The case showed that continuous documentation updates, supported by quick capture and AI-assisted refinement, helped maintain organised and usable project knowledge throughout development. Five recurring lessons were identified: contracts stabilised AI-assisted coding, a maintained source-of-truth layer improved coherence, cycle-boundary snapshots strengthened continuity, code and documentation co-evolved through quick capture and iterative refinement, and environment setup itself contributed to knowledge generation. The case also illustrates a practical SHAPR operating configuration in which a ChatGPT Project and cycle-specific chats supported interaction, reasoning, summarisation, and coding collaboration, PyCharm supported artefact implementation, and Obsidian supported external working memory, structured documentation, reflection, continuity, and repository-oriented note organisation, while remaining consistent with SHAPR's tool-agnostic principle. The paper contributes practical guidance and good practices for researchers conducting AI-assisted research software development.

cs.SE

SHAPR: Operationalising Human-AI Collaborative Research Through Structured Knowledge Generation

SHAPR (Solo Human-Centred and AI-Assisted Practice) is a framework for research software development that integrates human-centred decision-making with AI-assisted capabilities. While prior work introduced SHAPR as a conceptual framework, this paper focuses on its operationalisation as a structured, traceable, and knowledge-generating approach to AI-assisted research practice. We present a set of interconnected models describing how research activities are organised through iterative cycles (Explore-Build-Use-Evaluate-Learn), how artefacts evolve through development and use, and how empirical evidence is transformed into conceptual knowledge. Central to this process are Structured Knowledge Units (SKUs), which provide modular and reusable representations of insights derived from practice, supporting knowledge accumulation across cycles. The framework introduces evidence and traceability as a cross-cutting mechanism linking human decisions, AI-assisted development, and artefact evolution to enable transparency, reproducibility, and systematic refinement. SHAPR is also positioned as an AI-executable research framework, as its structured processes and documentation can be interpreted by generative AI systems to guide research workflows. Simultaneously, SHAPR supports a continuum of AI involvement, allowing researchers to balance control, learning, and automation across different contexts. Beyond individual workflows, SHAPR is conceptualised as an integrated research system combining LLM workspaces, development environments, cloud storage, and version control to support scalable, knowledge-centred research practices. Overall, SHAPR provides a practical and theoretically grounded foundation for conducting rigorous, transparent, and reproducible research in AI-assisted environments, contributing to the development of scalable and methodologically sound research practices.

cs.SE

SHAPR: A Solo Human-Centred and AI-Assisted Practice Framework for Research Software Development

Research software has become a central vehicle for inquiry and learning in many Higher Degree Research (HDR) contexts, where solo researchers increasingly develop software-based artefacts as part of their research methodology. At the same time, generative artificial intelligence is reshaping development practice, offering powerful forms of assistance while introducing new challenges for accountability, reflection, and methodological rigour. Although Action Design Research (ADR) provides a well-established foundation for studying and constructing socio-technical artefacts, it offers limited guidance on how its principles can be operationalised in the day-to-day practice of solo, AI-assisted research software development. This paper proposes the SHAPR framework (Solo, Human-centred, AI-assisted PRactice) as a practice-level operational framework that complements ADR by translating its high-level principles into actionable guidance for contemporary research contexts. SHAPR supports the enactment of ADR Building-Intervention-Evaluation cycles by making explicit the roles, artefacts, reflective practices, and lightweight governance mechanisms required to sustain human accountability and learning in AI-assisted development. The contribution of the paper is conceptual: SHAPR itself is treated as the primary design artefact and unit of analysis and is evaluated formatively through reflective analysis of its internal coherence, alignment with ADR principles, and applicability to solo research practice. By explicitly linking research software development, Human-AI collaboration, and reflective learning, this study contributes to broader discussions on how SHAPR can support both knowledge production and HDR researcher training.

cs.SE

Integration of physical equipment and simulators for on-campus and online delivery of practical networking labs

This paper presents the design and development of a networking laboratory that integrates physical networking equipment with the open source GNS3 network simulators for delivery of practical networking classes simultaneously to both on-campus and online students. This transformation work has resulted in significant increase in laboratory capacity, reducing repeating classes. The integrated platform offers students the real world experience of using real equipment, and the convenience of easy setup and reconfiguration by using simulators. A practical exercise in setting up an OSPF/BGP network is presented as an example to illustrate the experimental design before and after the integration of GNS3 simulators. In summary, we report our experiences with the integrated platform, from infrastructure, network design to experiment design; and the learning and teaching experiences of using GNS3 in classes.

cs.NI