SearcharxivSearch

arXiv subjects

Julien Siebert

Publications and source records attributed to Julien Siebert.

18 recordsLinked to original sources

Causal Software Engineering: A Vision and Roadmap

Software engineering increasingly involves making high-stakes decisions under uncertainty, using signals from code, field data, and socio-technical processes. Recent AI-driven support (e.g., anomaly detection, predictive analytics, AIOps, as well as LLM-based agents) has amplified engineers' ability to detect patterns and synthesize content and recommendations, but many critical questions are interventional or counterfactual: What is the expected impact of changing a load-balancing strategy? Would an outage have been avoided under a different release plan? Correlational models answer "what tends to co-occur"; they struggle to answer "what would happen if we act." We propose Causal Software Engineering (CSE) as a future paradigm in which causal models and causal reasoning systematically inform activities across the software lifecycle, augmenting existing practices with explicit assumptions, uncertainty-aware effect estimates, and counterfactual diagnosis. We outline (i) a causal-first workflow view spanning development and operations, (ii) a staged roadmap for tools and organizational adoption, and (iii) an evaluation and benchmark agenda for measuring progress.

cs.SE

Evaluating the effectiveness of LLM-based interoperability

Background: Systems of systems are becoming increasingly dynamic and heterogeneous, and this adds pressure on the long-standing challenge of interoperability. Besides its technical aspect, interoperability has also an economic side, as development time efforts are required to build the interoperability artifacts. Objectives: With the recent advances in the field of large language models (LLMs), we aim at analyzing the effectiveness of LLM-based strategies to make systems interoperate autonomously, at runtime, without human intervention. Method: We selected 13 open source LLMs and curated four versions of a dataset in the agricultural interoperability use case. We performed three runs of each model with each version of the dataset, using two different strategies. Then we compared the effectiveness of the models and the consistency of their results across multiple runs. Results: qwen2.5-coder:32b was the most effective model using both strategies DIRECT (average pass@1 >= 0.99) and CODEGEN (average pass@1 >= 0.89) in three out of four dataset versions. In the fourth dataset version, which included an unit conversion, all models using the strategy DIRECT failed, whereas using CODEGEN qwen2.5-coder:32b succeeded with an average pass@1 = 0.75. Conclusion: Some LLMs can make systems interoperate autonomously. Further evaluation in different domains is recommended, and further research on reliability strategies should be conducted.

cs.SE

Evaluation of large language models for assessing code maintainability

Increased availability of open-source software repositories and recent advances in code analysis using large language models (LLMs) has triggered a wave of new work to automate software engineering tasks that were previously very difficult to automate. In this paper, we investigate a recent line of work that hypothesises that comparing the probability of code generated by LLMs with the probability the current code would have had can indicate potential quality problems. We investigate the association between the cross-entropy of code generated by ten different models (based on GPT2 and Llama2) and the following quality aspects: readability, understandability, complexity, modularisation, and overall maintainability assessed by experts and available in an benchmark dataset. Our results show that, controlling for the number of logical lines of codes (LLOC), cross-entropy computed by LLMs is indeed a predictor of maintainability on a class level (the higher the cross-entropy the lower the maintainability). However, this relation is reversed when one does not control for LLOC (e.g., comparing small classes with longer ones). Furthermore, while the complexity of LLMs affects the range of cross-entropy (smaller models tend to have a wider range of cross-entropy), this plays a significant role in predicting maintainability aspects. Our study limits itself on ten different pretrained models (based on GPT2 and Llama2) and on maintainability aspects collected by Schnappinger et al. When controlling for logical lines of code (LLOC), cross-entropy is a predictor of maintainability. However, while related work has shown the potential usefulness of cross-entropy at the level of tokens or short sequences, at the class level this criterion alone may prove insufficient to predict maintainability and further research is needed to make best use of this information in practice.

cs.SE

Badgers: generating data quality deficits with Python

Generating context specific data quality deficits is necessary to experimentally assess data quality of data-driven (artificial intelligence (AI) or machine learning (ML)) applications. In this paper we present badgers, an extensible open-source Python library to generate data quality deficits (outliers, imbalanced data, drift, etc.) for different modalities (tabular data, time-series, text, etc.). The documentation is accessible at https://fraunhofer-iese.github.io/badgers/ and the source code at https://github.com/Fraunhofer-IESE/badgers

cs.LG

Applications of statistical causal inference in software engineering

This paper reviews existing work in software engineering that applies statistical causal inference methods. These methods aim at estimating causal effects from observational data. The review covers 32 papers published between 2010 and 2022. Our results show that the application of statistical causal inference methods is relatively recent and that the corresponding research community remains relatively fragmented.

cs.SE

Challenges related to system-of-systems for greening and climate adaptation in smart cities

This paper presents the results of interviews conducted as part of the DYNASOS project. The objective was to collect challenges related to the design, implementation and management of system-of-systems (SoS) in the context of climate adaptation and greening of smart cities. 23 individuals from cities, academia, and industry were interviewed between March and May 2022 and 57 distinct challenges were collected and analyzed. Our results show that while technical issues (such as interoperability or data acquisition) persist, non-technical issues are the main obstacles. Difficulties in information sharing, effective communication, and synchronization between different actors are the most important challenges.

cs.SE

Towards a Roadmap for Trustworthy Dynamic Systems-of-Systems

This paper gives insights into the DynaSoS project, which aims to propose a cross-domain roadmap for systems engineering research into trustworthy dynamic systems-of-systems with autonomous components. The project follows a methodology that combines interviews and workshops with experts from various domains and a literature review. In this paper, we motivate the project, discuss five application areas with their drivers and visions, and draw initial conclusions with respect to challenges that a research roadmap should address. Our goal is to share initial results with the research community about the DynaSoS project and invite them to contribute to the derivation of the research roadmap.

cs.SE

Software Engineering for AI-Based Systems: A Survey

AI-based systems are software systems with functionalities enabled by at least one AI component (e.g., for image- and speech-recognition, and autonomous driving). AI-based systems are becoming pervasive in society due to advances in AI. However, there is limited synthesized knowledge on Software Engineering (SE) approaches for building, operating, and maintaining AI-based systems. To collect and analyze state-of-the-art knowledge about SE for AI-based systems, we conducted a systematic mapping study. We considered 248 studies published between January 2010 and March 2020. SE for AI-based systems is an emerging research area, where more than 2/3 of the studies have been published since 2018. The most studied properties of AI-based systems are dependability and safety. We identified multiple SE approaches for AI-based systems, which we classified according to the SWEBOK areas. Studies related to software testing and software quality are very prevalent, while areas like software maintenance seem neglected. Data-related issues are the most recurrent challenges. Our results are valuable for: researchers, to quickly understand the state of the art and learn which topics need more research; practitioners, to learn about the approaches and challenges that SE entails for AI-based systems; and, educators, to bridge the gap among SE and AI in their curricula.

cs.SE

A systematic review of Python packages for time series analysis

This paper presents a systematic review of Python packages with a focus on time series analysis. The objective is to provide (1) an overview of the different time series analysis tasks and preprocessing methods implemented, and (2) an overview of the development characteristics of the packages (e.g., documentation, dependencies, and community size). This review is based on a search of literature databases as well as GitHub repositories. Following the filtering process, 40 packages were analyzed. We classified the packages according to the analysis tasks implemented, the methods related to data preparation, and the means for evaluating the results produced (methods and access to evaluation data). We also reviewed documentation aspects, the licenses, the size of the packages' community, and the dependencies used. Among other things, our results show that forecasting is by far the most frequently implemented task, that half of the packages provide access to real datasets or allow generating synthetic data, and that many packages depend on a few libraries (the most used ones being numpy, scipy and pandas). We hope that this review can help practitioners and researchers navigate the space of Python packages dedicated to time series analysis. We will provide an updated list of the reviewed packages online at https://siebert-julien.github.io/time-series-analysis-python/.

cs.MS

Quantitative estimates of impact induced crustal erosion during accretion and its influence on the Sm/Nd ratio of the Earth

Dynamical scenarios of terrestrial planets formation involve strong perturbations of the inner part of the solar system by the giant-planets, leading to enhanced impact velocities and subsequent collisional erosion. We quantitatively estimate the effect of collisional erosion on the resulting composition of Earth, and estimate how it may provide information on the dynamical context of its formation. We simulate and quantify the erosion of Earth's crust in the context of Solar System formation scenarios, including the classical model and Grand Tack scenario that invokes orbital migration of Jupiter during the gaseous disk phase (Walsh et al., 2011; Raymond et al., 2018). We find that collisional erosion of the early crust is unlikely to produce an excess of about 6% of the Sm/Nd ratio in terrestrial rock samples compared to chondrites for most simulations. Only Grand Tack simulations in which the last giant impact on Earth occurred later than 50 million years after the start of Solar System formation can account for such an offset. However, this time frame is consistent with current cosmochemical and dynamical estimates of the Moon forming impact (Chyba, 1991; Walker, 2009; Touboul et al.,2007, 2009, 2015; Pepin and Porcelli, 2006; Norman et al., 2003; Nyquist et al., 2006; Boyet et al.,2015). Such a late fractionation in the Sm/Nd ratio is unlikely to be responsible for a 20-ppm $^{142}$Nd excess in terrestrial rocks due to the half life of the radiogenic system. Additionally, such a large and late fractionation in the Sm/Nd ratio would accordingly induce non-observed anomalies in the $^{143}$Nd/$^{144}$Nd ratio. Considering our results, the Grand Tack model with a late Moon-forming impact cannot be easily reconciled with the Nd isotopic Earth contents.

astro-ph.EP

Towards Guidelines for Assessing Qualities of Machine Learning Systems

Nowadays, systems containing components based on machine learning (ML) methods are becoming more widespread. In order to ensure the intended behavior of a software system, there are standards that define necessary quality aspects of the system and its components (such as ISO/IEC 25010). Due to the different nature of ML, we have to adjust quality aspects or add additional ones (such as trustworthiness) and be very precise about which aspect is really relevant for which object of interest (such as completeness of training data), and how to objectively assess adherence to quality requirements. In this article, we present the construction of a quality model (i.e., evaluation objects, quality aspects, and metrics) for an ML system based on an industrial use case. This quality model enables practitioners to specify and assess quality requirements for such kinds of ML systems objectively. In the future, we want to learn how the term quality differs between different types of ML systems and come up with general guidelines for specifying and assessing qualities of ML systems.

cs.SE

A history of violence: insights into post-accretionary heating in carbonaceous chondrites from volatile element abundances, Zn isotopes, and water contents

Carbonaceous chondrites (CCs) may have been the carriers of water, volatile and moderately volatile elements to Earth. Investigating the abundances of these elements, their relative volatility, and isotopes of state-change tracer elements such as Zn, and linking these observations to water contents, provide vital information on the processes that govern the abundances and isotopic signatures of these species in CCs and other planetary bodies. Here we report Zn isotopic data for 28 CCs (20 CM, 6 CR, 1 C2-ung, and 1 CV3), as well as trace element data for Zn, In, Sn, Tl, Pb, and Bi in 16 samples (8 CM, 6 CR, 1 C2-ung, and 1 CV3), that display a range of elemental abundances from case-normative to intensely depleted. We use these data, water content data from literature and Zn isotopes to investigate volatile depletions and to discern between closed and open system heating. Trace element data have been used to construct relative volatility scales among the elements for the CM and CR chondrites. From least volatile to most, the scale in CM chondrites is Pb-Sn-Bi-In-Zn-Tl, and for CR chondrites it is Tl-Zn-Sn-Pb-Bi-In. These observations suggest that heated CM and CR chondrites underwent volatile loss under different conditions to one another and to that of the solar nebula, e.g. differing oxygen fugacities. Furthermore, the most water and volatile depleted samples are highly enriched in the heavy isotopes of Zn. Taken together, these lines of evidence strongly indicate that heated CM and CR chondrites incurred open system heating, stripping them of water and volatiles concomitantly, during post-accretionary shock impact(s).

astro-ph.EP

Nonlinearity of local dynamics promotes multi-chimeras

Chimera states are complex spatio-temporal patterns in which domains of synchronous and asynchronous dynamics coexist in coupled systems of oscillators. We examine how the character of the individual elements influences chimera states by studying networks of nonlocally coupled Van der Pol oscillators. Varying the bifurcation parameter of the Van der Pol system, we can interpolate between regular sinusoidal and strongly nonlinear relaxation oscillations, and demonstrate that more pronounced nonlinearity induces multi-chimera states with multiple incoherent domains. We show that the stability regimes for multi-chimera states and the mean phase velocity profiles of the oscillators change significantly as the nonlinearity becomes stronger. Furthermore, we reveal the influence of time delay on chimera patterns.

nlin.AO

Front and Turing patterns induced by Mexican-hat-like nonlocal feedback

We consider the effects of a Mexican-hat-shaped nonlocal spatial coupling, i.e., symmetric long-range inhibition superimposed with short-range excitation, upon front propagation in a model of a bistable reaction-diffusion system. We show that the velocity of front propagation can be controlled up to a certain coupling strength beyond which spatially periodic patterns, such as Turing patterns or coexistence of spatially homogeneous solutions and Turing patterns, may be induced. This behaviour is investigated through a linear stability analysis of the spatially homogeneous steady states and numerical investigations of the full nonlinear equations in dependence upon the nonlocal coupling strength and the ratio of the excitatory and inhibitory coupling ranges.

nlin.PS

Dynamics of reaction-diffusion patterns controlled by asymmetric nonlocal coupling as limiting case of differential advection

A one-component bistable reaction-diffusion system with asymmetric nonlocal coup ling is derived as limiting case of a two-component activator-inhibitor reaction -diffusion model with differential advection. The effects of asymmetric nonlocal couplings in such a bistable reaction-diffusi on system are then compared to the previously studied case of a system with symm etric nonlocal coupling. We carry out a linear stability analysis of the spatially homogeneous steady sta tes of the model and numerical simulations of the model to show how the asymmetr ic nonlocal coupling controls and alters the steady states and the front dynamic s in the system. In a second step, a third fast reaction-diffusion equation is included which ind uces the formation of more complex patterns. A linear stability analysis predicts traveling waves for asymmetric nonlocal coupling in contrast to a stationary Turing patterns for a system with symmetric nonlocal coupling. These findings are verified by direct numerical integration of the full equations with nonlocal coupling.

nlin.PS

Control of chemical wave propagation

Using the Schlögl model as a paradigmatic example of a bistable reaction-diffusion system, we discuss some physically feasible options of open and closed loop spatio-temporal control of chemical wave propagation.

nlin.PS

Modélisation multi-niveaux dans AA4MM

In this article, we propose to represent a multi-level phenomenon as a set of interacting models. This perspective makes the levels of representation and their relationships explicit. To deal with coherence, causality and coordination issues between models, we rely on AA4MM, a metamodel dedicated to such a representation. We illustrate our proposal and we show the interest of our approach on a flocking phenomenon.

cs.MA

Statistical mechanics of the self-gravitating gases

The self-gravitating systems are formed by particles interacting through gravity. They describe structure formation in the universe. As a consequence of the long range interaction of gravity, they are inhomogeneous even at thermal equilibrium. We study the self-gravitating systems with several kinds of particles and the self-gravitating systems in the presence of the cosmological constant $ Lambda$. We formulate the statistical mechanics and the mean field approach describing the gaseous phase. We explicitely compute the density of particles and thermodynamic quantities. The presence of $ Lambda$ extends the domain of stability of the gaseous phase. Monte Carlo simulations show that the mean field describes the gaseous phase with an excellent accuracy. Scalling law of the self-gravitating systems with several kinds of particles is found. At the critical point the fractal dimension is independant of their composition and is $1.6...$~.

astro-ph