arXiv subjects

Hongquan Xu

Publications and source records attributed to Hongquan Xu.

12 recordsLinked to original sources

arXiv2026

Prompt engineering using order-of-addition experiments: An application to generating two-level fractional factorial designs

Large language models (LLMs) are becoming ubiquitous in engineering and science because they can turn prompts into data analysis code, experimental designs, formulations of optimization problems, among other applications. However, many LLMs suffer from a phenomenon called order dependency, in which the order of phrases in the prompt affects their performance on a given task. To overcome this issue, we introduce a systematic method that uses order-of-addition experiments to quantify the ordering effect of elements in a prompt and identify their best positions. We demonstrate our methodology by constructing two-level fractional factorial designs using state-of-the-art LLMs. We show that order-of-addition experiments can elucidate order dependency in these LLMs, and can help us to identify a high-quality prompt configuration for the task.

stat.AP↗

arXiv2021

Orthogonal Subsampling for Big Data Linear Regression

The dramatic growth of big datasets presents a new challenge to data storage and analysis. Data reduction, or subsampling, that extracts useful information from datasets is a crucial step in big data analysis. We propose an orthogonal subsampling (OSS) approach for big data with a focus on linear regression models. The approach is inspired by the fact that an orthogonal array of two levels provides the best experimental design for linear regression models in the sense that it minimizes the average variance of the estimated parameters and provides the best predictions. The merits of OSS are three-fold: (i) it is easy to implement and fast; (ii) it is suitable for distributed parallel computing and ensures the subsamples selected in different batches have no common data points; and (iii) it outperforms existing methods in minimizing the mean squared errors of the estimated parameters and maximizing the efficiencies of the selected subsamples. Theoretical results and extensive numerical results show that the OSS approach is superior to existing subsampling approaches. It is also more robust to the presence of interactions among covariates and, when they do exist, OSS provides more precise estimates of the interaction effects than existing methods. The advantages of OSS are also illustrated through analysis of real data.

stat.ME↗

arXiv2020

A Class of Multilevel Nonregular Designs for Studying Quantitative Factors

Fractional factorial designs are widely used for designing screening experiments. Nonregular fractional factorial designs can have better properties than regular designs, but their construction is challenging. Current research on the construction of nonregular designs focuses on two-level designs. We provide a novel class of multilevel nonregular designs by permuting levels of regular designs. We develop a theory illustrating how levels can be permuted without computer search and accordingly propose a sequential method for constructing nonregular designs. Compared to regular designs, these nonregular designs can provide more accurate estimations on factorial effects and more efficient screening for experiments with quantitative factors. We further explore the space-filling property of the obtained designs and demonstrate their superiority.

stat.ME↗

arXiv2018

Application of Kriging Models for a Drug Combination Experiment on Lung Cancer

Combinatorial drugs have been widely applied in disease treatment, especially chemotherapy for cancer, due to its improved efficacy and reduced toxicity compared with individual drugs. The study of combinatorial drugs requires efficient experimental designs and proper follow-up statistical modelling techniques. Linear and non-linear models are often used in the response surface modelling for such experiments. We propose the use of Kriging models to better depict the response surfaces of combinatorial drugs and take into account the measurement error. We further study how proper experimental designs can reduce the required number of runs. We illustrate our method via a combinatorial drug experiment on lung cancer. We demonstrate that only 27 runs are needed to predict all 512 runs in the original experiment and achieve better precision than existing analysis.

stat.AP↗

arXiv2014

Generalized resolution for orthogonal arrays

The generalized word length pattern of an orthogonal array allows a ranking of orthogonal arrays in terms of the generalized minimum aberration criterion (Xu and Wu [Ann. Statist. 29 (2001) 1066-1077]). We provide a statistical interpretation for the number of shortest words of an orthogonal array in terms of sums of $R^2$ values (based on orthogonal coding) or sums of squared canonical correlations (based on arbitrary coding). Directly related to these results, we derive two versions of generalized resolution for qualitative factors, both of which are generalizations of the generalized resolution by Deng and Tang [Statist. Sinica 9 (1999) 1071-1082] and Tang and Deng [Ann. Statist. 27 (1999) 1914-1926]. We provide a sufficient condition for one of these to attain its upper bound, and we provide explicit upper bounds for two classes of symmetric designs. Factor-wise generalized resolution values provide useful additional detail.

math.ST↗

arXiv2012

Uniform fractional factorial designs

The minimum aberration criterion has been frequently used in the selection of fractional factorial designs with nominal factors. For designs with quantitative factors, however, level permutation of factors could alter their geometrical structures and statistical properties. In this paper uniformity is used to further distinguish fractional factorial designs, besides the minimum aberration criterion. We show that minimum aberration designs have low discrepancies on average. An efficient method for constructing uniform minimum aberration designs is proposed and optimal designs with 27 and 81 runs are obtained for practical use. These designs have good uniformity and are effective for studying quantitative factors.

math.ST↗

arXiv2011

A trigonometric approach to quaternary code designs with application to one-eighth and one-sixteenth fractions

The study of good nonregular fractional factorial designs has received significant attention over the last two decades. Recent research indicates that designs constructed from quaternary codes (QC) are very promising in this regard. The present paper shows how a trigonometric approach can facilitate a systematic understanding of such QC designs and lead to new theoretical results covering hitherto unexplored situations. We focus attention on one-eighth and one-sixteenth fractions of two-level factorials and show that optimal QC designs often have larger generalized resolution and projectivity than comparable regular designs. Moreover, some of these designs are found to have maximum projectivity among all designs.

math.ST↗

arXiv2009

Quarter-fraction factorial designs constructed via quaternary codes

The research of developing a general methodology for the construction of good nonregular designs has been very active in the last decade. Recent research by Xu and Wong [Statist. Sinica 17 (2007) 1191--1213] suggested a new class of nonregular designs constructed from quaternary codes. This paper explores the properties and uses of quaternary codes toward the construction of quarter-fraction nonregular designs. Some theoretical results are obtained regarding the aliasing structure of such designs. Optimal designs are constructed under the maximum resolution, minimum aberration and maximum projectivity criteria. These designs often have larger generalized resolution and larger projectivity than regular designs of the same size. It is further shown that some of these designs have generalized minimum aberration and maximum projectivity among all possible designs.

math.ST↗

arXiv2008

Recent Developments in Nonregular Fractional Factorial Designs

Nonregular fractional factorial designs such as Plackett-Burman designs and other orthogonal arrays are widely used in various screening experiments for their run size economy and flexibility. The traditional analysis focuses on main effects only. Hamada and Wu (1992) went beyond the traditional approach and proposed an analysis strategy to demonstrate that some interactions could be entertained and estimated beyond a few significant main effects. Their groundbreaking work stimulated much of the recent developments in design criterion creation, construction and analysis of nonregular designs. This paper reviews important developments in optimality criteria and comparison, including projection properties, generalized resolution, various generalized minimum aberration criteria, optimality results, construction methods and analysis strategies for nonregular designs.

stat.ME↗

arXiv2008

A complementary design theory for doubling

Chen and Cheng [Ann. Statist. 34 (2006) 546--558] discussed the method of doubling for constructing two-level fractional factorial designs. They showed that for $9N/32\le n\le 5N/16$, all minimum aberration designs with $N$ runs and $n$ factors are projections of the maximal design with $5N/16$ factors which is constructed by repeatedly doubling the $2^{5-1}$ design defined by $I=ABCDE$. This paper develops a general complementary design theory for doubling. For any design obtained by repeated doubling, general identities are established to link the wordlength patterns of each pair of complementary projection designs. A rule is developed for choosing minimum aberration projection designs from the maximal design with $5N/16$ factors. It is further shown that for $17N/64\le n\le 5N/16$, all minimum aberration designs with $N$ runs and $n$ factors are projections of the maximal design with $N$ runs and $5N/16$ factors.

math.ST↗

arXiv2007

Blocked regular fractional factorial designs with minimum aberration

This paper considers the construction of minimum aberration (MA) blocked factorial designs. Based on coding theory, the concept of minimum moment aberration due to Xu [Statist. Sinica 13 (2003) 691--708] for unblocked designs is extended to blocked designs. The coding theory approach studies designs in a row-wise fashion and therefore links blocked designs with nonregular and supersaturated designs. A lower bound on blocked wordlength pattern is established. It is shown that a blocked design has MA if it originates from an unblocked MA design and achieves the lower bound. It is also shown that a regular design can be partitioned into maximal blocks if and only if it contains a row without zeros. Sufficient conditions are given for constructing MA blocked designs from unblocked MA designs. The theory is then applied to construct MA blocked designs for all 32 runs, 64 runs up to 32 factors, and all 81 runs with respect to four combined wordlength patterns.

math.ST↗

arXiv2006

Construction of optimal multi-level supersaturated designs

A supersaturated design is a design whose run size is not large enough for estimating all the main effects. The goodness of multi-level supersaturated designs can be judged by the generalized minimum aberration criterion proposed by Xu and Wu [Ann. Statist. 29 (2001) 1066--1077]. A new lower bound is derived and general construction methods are proposed for multi-level supersaturated designs. Inspired by the Addelman--Kempthorne construction of orthogonal arrays, several classes of optimal multi-level supersaturated designs are given in explicit form: Columns are labeled with linear or quadratic polynomials and rows are points over a finite field. Additive characters are used to study the properties of resulting designs. Some small optimal supersaturated designs of 3, 4 and 5 levels are listed with their properties.

math.ST↗