Searcharxiv⌕ Search

arXiv subjects

Jochen Schmid

Publications and source records attributed to Jochen Schmid.

At least 19 recordsLinked to original sources
arXiv2026

Accelerating nanodrug development in continuous flow systems using informed prediction models based on low-cost surrogate nanoparticles

The development of nanotherapeutics often involves extensive empirical optimization due to the sensitivity of nanoparticle properties, such as size and polydispersity index (PDI), to minor changes in process parameters. Factors like formulation concentration, flow rates, and mixing ratios can significantly influence clinical efficacy and therapeutic outcomes. The absence of predictive mathematical frameworks has made iterative experimental screening necessary, increasing both costs and development time. This study introduces and validates a predictive modeling approach based on shape constraints, aiming to enhance the estimation of nanoparticle characteristics across various process conditions. Using controlled microfluidic methods, liposomes and lipid nanoparticles were systematically prepared under varying lipid concentrations, flow rates, and aqueous-to-organic mixing ratios. The shape-constrained model, informed by both experimental data and expert knowledge, was subsequently validated for a pharmaceutical application using minimal empirical data. Results reveal that shape-constrained modeling facilitates accurate prediction of nanoparticle size and dispersity, reducing the need for extensive experimental workflows. This framework supports rational and efficient process development for manufacturing nanomedicine systems.

cs.LG↗
arXiv2026

An adaptive discretization algorithm for locally optimal experimental design with constraints

We develop a novel iterative algorithm for locally optimal experimental design under constraints, like budget or performance constraints. It is an adaptive discretization algorithm. In every iteration, a discretized version of the constrained-design problem is solved and then the discretization is adaptively refined by adding an approximate violator of a suitable sufficient $\eps$-optimality condition for the current design. We prove that with $\eps = 0$, our algorithm converges to an optimal design and that with $\eps > 0$, our algorithm finitely terminates at an $\eps$-optimal design. Compared to the existing algorithms on constrained experimental design, our algorithm comes with considerably less computational effort because the nonlinear subproblems in our algorithm have a smaller dimension and have to be solved only approximately and only in selected iterations (typically the last few). Additionally, our algorithm covers a considerably larger class of constraints. We demonstrate the good convergence properties of the algorithm on experimental design problems from chemical engineering that feature time and yield constraints.

math.OC↗
arXiv2026

Automated Batch Distillation Process Simulation for a Large Hybrid Dataset for Deep Anomaly Detection

Anomaly detection (AD) in chemical processes based on deep learning offers significant opportunities but requires large, diverse, and well-annotated training datasets that are rarely available from industrial operations. In a recent work, we introduced a large, fully annotated experimental dataset for batch distillation under normal and anomalous operating conditions. In the present study, we augment this dataset with a corresponding simulation dataset, creating a novel hybrid dataset. The simulation data is generated in an automated workflow with a novel Python-based process simulator that employs a tailored index-reduction strategy for the underlying differential-algebraic equations. Leveraging the rich metadata and structured anomaly annotations of the experimental database, experimental records are automatically translated into simulation scenarios. After calibration to a single reference experiment, the dynamics of the other experiments are well predicted. This enabled the fully automated, consistent generation of time-series data for a large number of experimental runs, covering both normal operation and a wide range of actuator- and control-related anomalies. The resulting hybrid dataset is released openly. From a process simulation perspective, this work demonstrates the automated, consistent simulation of large-scale experimental campaigns, using batch distillation as an example. From a data-driven AD perspective, the hybrid dataset provides a unique basis for simulation-to-experiment style transfer, the generation of pseudo-experimental data, and future research on deep AD methods in chemical process monitoring.

cs.LG↗
arXiv2025

DiffStyleTS: Diffusion Model for Style Transfer in Time Series

Style transfer combines the content of one signal with the style of another. It supports applications such as data augmentation and scenario simulation, helping machine learning models generalize in data-scarce domains. While well developed in vision and language, style transfer methods for time series data remain limited. We introduce DiffTSST, a diffusion-based framework that disentangles a time series into content and style representations via convolutional encoders and recombines them through a self-supervised attention-based diffusion process. At inference, encoders extract content and style from two distinct series, enabling conditional generation of novel samples to achieve style transfer. We demonstrate both qualitatively and quantitatively that DiffTSST achieves effective style transfer. We further validate its real-world utility by showing that data augmentation with DiffTSST improves anomaly detection in data-scarce regimes.

cs.LG↗
arXiv2025

An equation-based batch distillation simulation to evaluate the effect of multiplicities in thermodynamic activity coefficients

In this paper, we investigate the influence of multiplicities in activity coefficients on batch distillation processes. In order to do so, we develop a rigorous simulation of batch distillation processes based on the MESH equations. In particular, we propose a novel index reduction method to transform the original index-$2$ system into a well-posed differential-algebraic system of index $1$. With the help of this simulation, we then explore whether the alternative NRTL parameters, which yield indistinguishable activity coefficients and VLE diagrams when compared to the reference data, can produce distinguishable profiles in dynamic simulations. As it turns out, this can happen in general and we explain the reasons behind the dynamic distinguishability.

math.OC↗
arXiv2024

Incorporating Shape Knowledge into Regression Models

Informed learning is an emerging field in machine learning that aims to compensate for insufficient data with prior knowledge. Shape knowledge covers many types of prior knowledge concerning the relationship of a function's output with respect to input variables, for example, monotonicity, convexity, etc. This shape knowledge -- when formalized into algebraic inequalities (shape constraints) -- can then be incorporated into the training of regression models via a constraint problem formulation. The defined shape-constrained regression problem is, mathematically speaking, a semi-infinite program (SIP). Although off-the-shelf algorithms can be used at this point to solve the SIP, we recommend an adaptive feasible-point algorithm that guarantees optimality up to arbitrary precision and strict fulfillment of the shape constraints. We apply this semi-infinite approach for shape-constrained regression (SIASCOR) to three application examples from manufacturing and one artificial example. One application example has not been considered in a shape-constrained regression setting before, so we used a methodology (ISI) to capture the shape knowledge and define corresponding shape constraints. Finally, we compare the SIASCOR method with a purely data-driven automated machine learning method (AutoML) and another approach for shape-constrained regression (SIAMOR) that uses a different solution algorithm.

math.OC↗
arXiv2024

Cubature-based uncertainty estimation for nonlinear regression models

Calibrating model parameters to measured data by minimizing loss functions is an important step in obtaining realistic predictions from model-based approaches, e.g., for process optimization. This is applicable to both knowledge-driven and data-driven model setups. Due to measurement errors, the calibrated model parameters also carry uncertainty. In this contribution, we use cubature formulas based on sparse grids to calculate the variance of the regression results. The number of cubature points is close to the theoretical minimum required for a given level of exactness. We present exact benchmark results, which we also compare to other cubatures. This scheme is then applied to estimate the prediction uncertainty of the NRTL model, calibrated to observations from different experimental designs.

stat.ME↗
arXiv2024

Adaptive discretization algorithms for locally optimal experimental design

We develop adaptive discretization algorithms for locally optimal experimental design of nonlinear prediction models. With these algorithms, we refine and improve a pertinent state-of-the-art algorithm in various respects. We establish novel termination, convergence, and convergence rate results for the proposed algorithms. In particular, we prove a sublinear convergence rate result under very general assumptions on the design criterion and, most notably, a linear convergence result under the additional assumption that the design criterion is strongly convex and the design space is finite. Additionally, we prove the finite termination at approximately optimal designs, including upper bounds on the number of iterations until termination. And finally, we illustrate the practical use of the proposed algorithms by means of two application examples from chemical engineering: one with a stationary model and one with a dynamic model.

math.OC↗
arXiv2024

Sequential optimal experimental design for vapor-liquid equilibrium modeling

We propose a general methodology of sequential locally optimal design of experiments for explicit or implicit nonlinear models, as they abound in chemical engineering and, in particular, in vapor-liquid equilibrium modeling. As a sequential design method, our method iteratively alternates between performing experiments, updating parameter estimates, and computing new experiments. Specifically, our sequential design method computes a whole batch of new experiments in each iteration and this batch of new experiments is designed in a two-stage locally optimal manner. In essence, this means that in every iteration the combined information content of the newly proposed experiments and of the already performed experiments is maximized. In order to solve these two-stage locally optimal design problems, a recent and efficient adaptive discretization algorithm is used. We demonstrate the benefits of the proposed methodology on the example of of the parameter estimation for the non-random two-liquid model for narrow azeotropic vapor-liquid equilibria. As it turns out, our sequential optimal design method requires substantially fewer experiments than traditional factorial design to achieve the same model precision and prediction quality. Consequently, our method can contribute to a substantially reduced experimental effort in vapor-liquid equilibrium modeling and beyond.

math.OC↗
arXiv2022

Capturing and incorporating expert knowledge into machine learning models for quality prediction in manufacturing

Increasing digitalization enables the use of machine learning methods for analyzing and optimizing manufacturing processes. A main application of machine learning is the construction of quality prediction models, which can be used, among other things, for documentation purposes, as assistance systems for process operators, or for adaptive process control. The quality of such machine learning models typically strongly depends on the amount and the quality of data used for training. In manufacturing, the size of available datasets before start of production is often limited. In contrast to data, expert knowledge commonly is available in manufacturing. Therefore, this study introduces a general methodology for building quality prediction models with machine learning methods on small datasets by integrating shape expert knowledge, that is, prior knowledge about the shape of the input-output relationship to be learned. The proposed methodology is applied to a brushing process with $125$ data points for predicting the surface roughness as a function of five process variables. As opposed to conventional machine learning methods for small datasets, the proposed methodology produces prediction models that strictly comply with all the expert knowledge specified by the involved process specialists. In particular, the direct involvement of process experts in the training of the models leads to a very clear interpretation and, by extension, to a high acceptance of the models. Another merit of the proposed methodology is that, in contrast to most conventional machine learning methods, it involves no time-consuming and often heuristic hyperparameter tuning or model selection step.

cs.LG↗
arXiv2021

Approximate solutions of convex semi-infinite optimization problems in finitely many iterations

We develop two adaptive discretization algorithms for convex semi-infinite optimization, which terminate after finitely many iterations at approximate solutions of arbitrary precision. In particular, they terminate at a feasible point of the considered optimization problem. Compared to the existing finitely feasible algorithms for general semi-infinite optimization problems, our algorithms work with considerably smaller discretizations and are thus computationally favorable. Also, our algorithms terminate at approximate solutions of arbitrary precision, while for general semi-infinite optimization problems the best possible approximate-solution precision can be arbitrarily bad. All occurring finite optimization subproblems in our algorithms have to be solved only approximately, and continuity is the only regularity assumption on our objective and constraint functions. Applications to parametric and non-parametric regression problems under shape constraints are discussed.

math.OC↗
arXiv2021

Calibrated simplex-mapping classification

We propose a novel methodology for general multi-class classification in arbitrary feature spaces, which results in a potentially well-calibrated classifier. Calibrated classifiers are important in many applications because, in addition to the prediction of mere class labels, they also yield a confidence level for each of their predictions. In essence, the training of our classifier proceeds in two steps. In a first step, the training data is represented in a latent space whose geometry is induced by a regular $(n-1)$-dimensional simplex, $n$ being the number of classes. We design this representation in such a way that it well reflects the feature space distances of the datapoints to their own- and foreign-class neighbors. In a second step, the latent space representation of the training data is extended to the whole feature space by fitting a regression model to the transformed data. With this latent-space representation, our calibrated classifier is readily defined. We rigorously establish its core theoretical properties and benchmark its prediction and calibration properties by means of various synthetic and real-world data sets from different application domains.

stat.ML↗
arXiv2020

Compensating data shortages in manufacturing with monotonicity knowledge

Optimization in engineering requires appropriate models. In this article, a regression method for enhancing the predictive power of a model by exploiting expert knowledge in the form of shape constraints, or more specifically, monotonicity constraints, is presented. Incorporating such information is particularly useful when the available data sets are small or do not cover the entire input space, as is often the case in manufacturing applications. The regression subject to the considered monotonicity constraints is set up as a semi-infinite optimization problem, and an adaptive solution algorithm is proposed. The method is applicable in multiple dimensions and can be extended to more general shape constraints. It is tested and validated on two real-world manufacturing processes, namely laser glass bending and press hardening of sheet metal. It is found that the resulting models both comply well with the expert's monotonicity knowledge and predict the training data accurately. The suggested approach leads to lower root-mean-squared errors than comparative methods from the literature for the sparse data sets considered in this work.

cs.LG↗
arXiv2020

Approximation, characterization, and continuity of multivariate monotonic regression functions

We deal with monotonic regression of multivariate functions $f: Q \to \mathbb{R}$ on a compact rectangular domain $Q$ in $\mathbb{R}^d$, where monotonicity is understood in a generalized sense: as isotonicity in some coordinate directions and antitonicity in some other coordinate directions. As usual, the monotonic regression of a given function $f$ is the monotonic function $f^*$ that has the smallest (weighted) mean-squared distance from $f$. We establish a simple general approach to compute monotonic regression functions: namely, we show that the monotonic regression $f^*$ of a given function $f$ can be approximated arbitrarily well -- with simple bounds on the approximation error in both the $2$-norm and the $\infty$-norm -- by the monotonic regression $f_n^*$ of grid-constant functions $f_n$. We also establish the continuity of the monotonic regression $f^*$ of a continuous function $f$ along with an explicit averaging formula for $f^*$. And finally, we deal with generalized monotonic regression where the mean-squared distance from standard monotonic regression is replaced by more complex distance measures which arise, for instance, in maximum smoothed likelihood estimation. We will see that the solution of such generalized monotonic regression problems is simply given by the standard monotonic regression $f^*$.

math.OC↗
arXiv2020

Simulation and optimal control of the Williams-Otto process using Pyomo

We illustrate the advantages the high-level open-source software package Pyomo has in rapidly setting up and solving dynamic simulation and optimization problems. In order to do so, we use the example of the Williams-Otto process. We show how to simulate the process dynamics using the collocation method and the IPOPT solver provided by Pyomo. We also discuss waste minimization and yield maximization as two examplary process optimization problems. And finally, we present and compare two approaches to setpoint tracking: one based on proportional-integral feedback control and one based on optimal open-loop control.

math.OC↗
arXiv2019

Asymptotic gain results for attractors of semilinear systems

We establish asymptotic gain along with input-to-state practical stability results for disturbed semilinear systems w.r.t. the global attractor of the respective undisturbed system. We apply our results to a large class of nonlinear reaction-diffusion equations comprising disturbed Chaffee--Infante equations, for example.

math.AP↗
arXiv2019

Infinite-time admissibility under compact perturbations

We investigate the behavior of infinite-time admissibility under compact perturbations. We show, by means of two completely different examples, that infinite-time admissibility is not preserved under compact perturbations $Q$ of the underlying semigroup generator $A$, even if $A$ and $A+Q$ both generate strongly stable semigroups.

math.OC↗