arXiv subjects

Pak-Lok Poon

Publications and source records attributed to Pak-Lok Poon.

6 recordsLinked to original sources

arXiv2026

Information Technology Curriculum: General or Specialized? An Australia's Census Study

Despite the strong employment prospect for information technology (IT) graduates, a comprehensive study investigating the status quo of offering different types of IT degree by Australian universities does not exist. To address this issue, this paper investigates how Australian universities offer three different types of IT degree: general, specialized, and those with majors. Using effect size analysis, we have observed some interesting phenomena about the correlation between how Australian universities offer their IT degrees and different factors, including, for example, type and reputation of universities, degree level, research component, supporting infrastructure, and industry engagement. Our census study painted the status quo of offering different types of IT degree by Australian universities, and provided insights into whether these IT degrees properly address the IT industry's needs. Based on the findings, we have also highlighted some insights and made recommendations on how to improve IT students' learning outcomes and graduates' employability.

cs.CY↗

arXiv2025

PSALM: applying Proportional SAmpLing strategy in Metamorphic testing

Metamorphic testing (MT) alleviates the oracle problem by checking metamorphic relations (MRs) across multiple test executions. The fault detection effectiveness of MT is influenced not only by the choice and quality of MRs, but also by how source test cases and metamorphic groups (MGs) are selected. While substantial research has focused on designing, generating, and validating MRs, systematic methods for source test case selection and MG selection remain largely unexplored. Although the Proportional Sampling Strategy (PSS) provides strong theoretical guarantees in traditional testing, its assumptions cannot be directly applied in MT due to differences in selection domains, test units, and failure distributions. This paper proposes PSALM, an adaptation of PSS to MT for both source test case selection and MG selection. We formally prove that PSALM is never inferior to random selection regardless of how the source test case and MG domains are partitioned. We further identify the conditions under which applying PSALM to source test case selection and MG selection yields identical effectiveness. A comprehensive empirical study on eight subject programs and 184 mutants shows that the results are consistent with our theoretical analysis and that PSALM generally performs more effectively than existing selection strategies such as ART and MT-ART. These results demonstrate that PSALM provides a theoretically grounded and practically effective selection strategy for MT.

cs.SE↗

arXiv2024

A FinTech Clustering Framework: Technology, Model, and Stakeholder Perspectives

Nowadays, the global booming of FinTech can be seen everywhere. FinTech has created innovative disruptions to traditional, long-established financial institutions (e.g., banks and insurance companies) in financial services markets. Despite of its popularity, there are many different definitions of FinTech. This problem occurs because many existing studies only focus on a particular aspect of FinTech without a comprehensive and in-depth analysis. This problem will hinder further development and industrial application of FinTech. In view of this problem, we perform a narrative review involving over 100 relevant studies or reports, with a view to developing a FinTech clustering framework for providing a more comprehensive and holistic view of FinTech. Furthermore, we use an Indian FinTech firm to illustrate how to apply our clustering framework for analysis.

q-fin.GN↗

arXiv2024

Metamorphic Relation Generation: State of the Art and Visions for Future Research

Metamorphic testing has become one mainstream technique to address the notorious oracle problem in software testing, thanks to its great successes in revealing real-life bugs in a wide variety of software systems. Metamorphic relations, the core component of metamorphic testing, have continuously attracted research interests from both academia and industry. In the last decade, a rapidly increasing number of studies have been conducted to systematically generate metamorphic relations from various sources and for different application domains. In this article, based on the systematic review on the state of the art for metamorphic relations' generation, we summarize and highlight visions for further advancing the theory and techniques for identifying and constructing metamorphic relations, and discuss potential research trends in related areas.

cs.SE↗

arXiv2021

Use of Metamorphic Relations as Knowledge Carriers to Train Deep Neural Networks

Training multiple-layered deep neural networks (DNNs) is difficult. The standard practice of using a large number of samples for training often does not improve the performance of a DNN to a satisfactory level. Thus, a systematic training approach is needed. To address this need, we introduce an innovative approach of using metamorphic relations (MRs) as "knowledge carriers" to train DNNs. Based on the concept of metamorphic testing and MRs (which play the role of a test oracle in software testing), we make use of the notion of metamorphic group of inputs as concrete instances of MRs (which are abstractions of knowledge) to train a DNN in a systematic and effective manner. To verify the viability of our training approach, we have conducted a preliminary experiment to compare the performance of two DNNs: one trained with MRs and the other trained without MRs. We found that the DNN trained with MRs has delivered a better performance, thereby confirming that our approach of using MRs as knowledge carriers to train DNNs is promising. More work and studies, however, are needed to solidify and leverage this approach to generate widespread impact on effective DNN training.

cs.LG↗

arXiv2019

METTLE: a METamorphic testing approach to assessing and validating unsupervised machine LEarning systems

Unsupervised machine learning is the training of an artificial intelligence system using information that is neither classified nor labeled, with a view to modeling the underlying structure or distribution in a dataset. Since unsupervised machine learning systems are widely used in many real-world applications, assessing the appropriateness of these systems and validating their implementations with respect to individual users' requirements and specific application scenarios$\,/\,$contexts are indisputably two important tasks. Such assessment and validation tasks, however, are fairly challenging due to the absence of a priori knowledge of the data. In view of this challenge, we develop a $\textbf{MET}$amorphic $\textbf{T}$esting approach to assessing and validating unsupervised machine $\textbf{LE}$arning systems, abbreviated as METTLE. Our approach provides a new way to unveil the (possibly latent) characteristics of various machine learning systems, by explicitly considering the specific expectations and requirements of these systems from individual users' perspectives. To support METTLE, we have further formulated 11 generic metamorphic relations (MRs), covering users' generally expected characteristics that should be possessed by machine learning systems. To demonstrate the viability and effectiveness of METTLE we have performed an experiment involving six commonly used clustering systems. Our experiment has shown that, guided by user-defined MR-based adequacy criteria, end users are able to assess, validate, and select appropriate clustering systems in accordance with their own specific needs. Our investigation has also yielded insightful understanding and interpretation of the behavior of the machine learning systems from an end-user software engineering's perspective, rather than a designer's or implementor's perspective, who normally adopts a theoretical approach.

cs.SE↗