Length Matters: Clustering System Log Messages using Length of Words

Keiichi Shima

Home/Archive/arXiv

arXiv · 1611.03213

Length Matters: Clustering System Log Messages using Length of Words

Keiichi Shima

View original source ↗Read source document ↗Export metadata ↓

Abstract

The analysis techniques of system log messages (syslog messages) have a long history from when the syslog mechanism was invented. Typically, the analysis consists of two parts, one is a message template generation, and the other is finding something interesting using the messages classified by the inferred templates. It is important to generate better templates to achieve better, precise, or convincible analysis results. In this paper, we propose a classification methodology using the length of words of each message. Our method is suitable for online template generation because it does not require two-pass analysis to generate template messages, that is an important factor considering increasing amount of log messages produced by a large number of system components such as cloud infrastructure.

Explore related subjects

cs.OH

Keep this discovery

BibTeX RIS

Keiichi Shima. 2016-11-10. Length Matters: Clustering System Log Messages using Length of Words. https://arxiv.org/abs/1611.03213

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Circular Economy Synergies and Trade-offs in Data Centres

This report analyses data centre (DC) sustainability and circularity, revealing existing synergies and trade-offs: The PUE is too coarse, mixing cooling and power provisioning. It wrongly attributes server fan consumption and transformation losses to IT energy. It does not measure compute but infrastructure efficiency, which is already outstanding. Compute energy, however, is exploding. Better energy metrics for DCs would thus cover i) compute efficiency, ii) transformation efficiency, and iii) cooling overhead. Trade-offs exist between cooling energy and water as well as on-site and upstream water: Consuming water on-site lowers the cooling energy, which also lowers the water consumed upstream in power generation. For 'wet' electricity, there is little competition: It is worth spending more on-site energy to save both electricity and related upstream water. For 'dry' electricity, there is a trade-off. Waste heat recovery brings energy circularity but has limited uses and is not the same energy quality, a fact not reflected by current metrics. A better metric would consider the avoided energy through heat recovery instead of the amount recovered. Material circularity can be achieved by interpreting the 9R framework in the context of DCs. Circularity-enhancing measures can be categorised into product design, process design and business models, choice of materials, and operating conditions. Together, they have effects across all circularity levels. The relation between DCs and the power grid is complex. Modern DCs present new challenges for the grid. Mitigation includes battery storage and onsite generation. These measures have, in turn, further consequences, both beneficial and detrimental. They can offer grid flexibility as well as innovations in the field of energy. But they also bring noise, pollution, and GHGs, and compete with the energy sector for resources.

cs.OH↗

arXiv2026

Digital Twin Modeling of a Highly Automated Agricultural Tractor

In efforts to increase research efficiency and availability, a digital twin of our research tractor (AMX G-trac) is created, focusing especially on the CAN communication for data reading and actuation command following the ISOBUS protocol. Mevea Simulation Software is utilized as the foundation, providing the kinematic model and visuals, while Python is used to read and write CAN messages over a Kvaser CanKing virtual CAN channel. Various performance tests involving straight line and turning behavior are performed in both the digital twin simulation and in the real world to measure similarity. Results indicate that the Mevea model behaves very comparable in its lateral dynamics, often within 5-10 percent, but requires better data to fully capture the longitudinal aspects like acceleration. The final model described in this paper sets the table for a second iteration to include more tractor functions such as hydraulics and tractor-implement dynamics.

cs.OH↗

arXiv2026

Risk-based Design for Sustainability in Cloud Systems: Insights from an Experts' Survey

Cloud Systems' Sustainability is critical in Cloud Computing, especially with the growing demand in many industries. Sustainability risks in Cloud Computing can be tricky, mostly because of system complexity and their impact on performance. Thus, this research focuses on Risk-based design (RBD) and how it can support the early identification of possible risks for Cloud System Sustainability, as well as respective mitigation strategies of each risk. In order to successfully identify risks of Cloud System Sustainability, an Expert Survey is conducted including experts with different roles from different industries, to identify possible sustainability risks of a Cloud System on all different levels. Thematic analysis of the responses resulted in a categorization of risks, as well as in the identification of mitigation strategies and factors affecting each risk. Such findings can be helpful for researchers and practitioners that utilize RBD when building sustainable Cloud systems.

cs.OH↗