Searcharxiv⌕ Search

arXiv subjects

Timo Oksanen

Publications and source records attributed to Timo Oksanen.

At least 19 recordsLinked to original sources

Weight-space programming for tractor guidance controller: large language models natively write neural network weights that steer a real tractor

Weight-space programming is a process where a large language model reads and writes the weights of a neural network directly, guided by a natural language specification, without an optimiser or gradient descent. This study applies it to automatic tractor guidance, where a 253-parameter neural network steers along paths of lines and arcs and must be adapted when the machine changes, such as a slower steering actuator. GPT-6 Astra and Claude Fable 5.1 (also 5.2) edited the network for our research tractor using a small budget of simulated evaluations to repair a network trained for another tractor and write a controller into a network with zero weights. We compared them with an evolution strategy, gradient descent and pure pursuit in simulation and on the real tractor. Both models read the network and analysed the closed loop with control theory correctly, and Fable's repair without simulation succeeded only occasionally. With simulated feedback, both models repaired the trained network in single sessions and wrote a working controller from zero weights, whereas from zero the evolution strategy found none. The controllers written from zero were sparse and in a classical cascaded structure; one model edited the trained network while the other replaced it. Gradient descent reached higher accuracy with far more simulation, and all language model controllers steered the real tractor without intervention, with errors of the same order as pure pursuit. Language models can program the weights of a neural controller directly, much as control engineers design one. We call this Weight-Space Engineering.

cs.LG↗

Machine-Readable Operator Manuals over the ISO 11783 Network for Offline, Multilingual LLM Assistance

If agricultural machinery is to support intelligent, offline assistance, then the system must access technical documentation dynamically. In this paper, the Semantic Synchronization of operator manuals over ISO 11783-based CAN buses is analyzed, defined as the process that brings the local knowledge base of a tractor-side assistant into agreement with the operator manual of the connected implement. Data transfer performance was benchmarked using Markdown, JSON, and XML; various open-weight Large Language Models (LLMs) were also evaluated in cross-lingual query tasks. The automatic evaluation of the answers was validated against four human raters. A complete manual was transferred over a physical ISO 11783 network in 31 to 89 s, depending on format and transport settings, which is comparable to the object pool upload that operators already wait for at the first coupling of an implement. Markdown produced the smallest files, while the question-answering performance was comparable across the three formats for most models. With retrieval-augmented generation, locally run models answered most questions on the English manual correctly, with no advantage of the largest model over 7B and 8B models, but performed worse on the five other language editions. Keyword retrieval failed across languages, whereas semantic retrieval provided the cross-lingual capability. The exchange requires only a new parameter group that uses the existing request and transport mechanisms of ISO 11783, which makes it a candidate for standardization. The study is a proof of concept with inference on PC-grade hardware; deployment on embedded agricultural hardware remains future work.

cs.CL↗

INVAR-Agri: Detecting Discrepancies in Multilingual Operator Manuals of Agricultural Implements with a Fine-Tuned LLM

Operator manuals of agricultural implements are delivered in many languages, and the standards require that competent persons review every translation, which makes this review the bottleneck. This paper presents a proof of concept that compares two training workflows on the same LLM, EuroLLM-1.7B-Instruct, trained on operator manuals of one manufacturer. In approach A, a back-translator translates each language version back into English, and an English reader compares it with the English version. In approach B, a checker reads the English version and the translation together, where the checker reports differences. The test sets contain errors planted in numbers, units, opposite words, obligations, negations, and conditions in 24 languages, and they include unmodified text and meaning-preserving edits for alerts and false alarms. The trained back-translator concealed many planted errors, most of all weakened obligations, while translation-quality scores rose. In contrast, the separately trained checker detected most planted errors, although it was weak for units and for number changes unlike those in training. A check by the author confirmed the concealment. In addition, a simple rule check caught the number and unit changes, but it alerted on harmless rewrites. A check of alerts on real Finnish translations showed that most alerts were false, caused by language-specific wording, so the precision on real text remains a limitation. Within this setting, a trained checker might support, not replace, the review by competent persons, and firmer conclusions need more data.

cs.CL↗

Multi-Reference Path Tracking Control for an Agricultural Tractor with Nonlinear Model Predictive Control

Guiding a tractor along a predefined reference path is a key component of precision agriculture. This study develops a path tracking controller based on Nonlinear Model Predictive Control, which incorporates multiple segments of a piecewise-linear reference path directly into the objective function. In addition, methods for selecting viable reference segments from the full path are presented. The control system is evaluated during a field test with a tractor controlled via the Tractor Implement Management steering interface. The NMPC solver converged on average after 3.45 ms and tracked the curved reference path with a mean absolute cross-track error of 6.1 cm.

cs.RO↗

Terramechanics-Inspired Sensor Fusion for Slip and Mass Flow Estimation in Agricultural Conveyor Systems

Precision farming requires accurate knowledge of implement states. In organic fertilizer spreaders, heterogeneous material and variable field conditions complicate flow-rate prediction, and tilt angles alter the slip behaviour between transport floor and material. This paper presents a model-based sensor fusion method for slip and mass-flow estimation, integrating weighing, conveyor-speed, and inertial measurements in an Extended Kalman Filter with a volumetric flow model and a longitudinal dynamics model. Validation on real-world cattle-manure spreading shows mass estimates tracking the raw weight with an RMSE of 11.9 kg and integrated mass flow within 8.4 % of the observed mass loss.

eess.SP↗

Identification of the Steering and Speed Systems of a Four-Wheel-Steering Tractor for Optimal Control

Model-based control design requires sufficiently accurate model of the system-to-be-controlled. This paper addresses the system identification of steering and speed control of a four-wheel-steering agricultural tractor for the purpose of developing path tracking control. To this end, we investigate the steering and speed control systems of the tractor. These are complex systems with digital, mechatronic, and hydraulic components challenging to model based on first principles. We take a data-driven approach to estimating the system models. The resulting model combines the kinematic model of the vehicle, actuators modelled as first-order systems, and estimated values for time constants and transport delays.

eess.SY↗

Plant Growth Estimation with a Camera-Based Vegetation Index Mapping System for Agricultural Ground Vehicles

This work presents a camera-based sensor for mapping plant growth over an agricultural field. The sensor can be used on ground-based vehicles like a tractor and relies on RTK-GNSS to correctly merge many multispectral images onto one map. NDVI is used as an index to estimate plant growth, but the approach can be used with other indices as well depending on the camera. The images from the camera are projected onto the estimated ground plane using perspective projection. This computationally simple approach allows for real-time processing of all images on the field even with low-end hardware. The results are compared to a commercially established vehicle-mounted sensor. Absolute values are hard to compare, but both sensors show similar trends. The camera-based approach also allows for filtering of ground and non-ground areas, potentially reducing the impact of crop density on the average measured NDVI.

eess.IV↗

Concept of a Sensor Test Environment for Dusty Agricultural Conditions

Dust in agriculture presents a significant challenge for autonomous agricultural machinery. Dust can impair the performance of sensors and algorithms. This work, therefore, presents a concept for a proving ground consisting of an indoor and outdoor area. The indoor area comprises a laboratory test bench where dust circulates in a closed system and a test hall where life-size objects can be placed. The outdoor area features dedicated test setups that enable reproducible data to be recorded with and without dust during real-world agriculture work. The proving ground and the setups are visualized in 3D.

cs.CV↗

Corner Cases: Headland Coverage Path Planning for Autonomous Driving in Arable Farming

This paper presents a new method for headland coverage path planning for arable fields. Several earlier approaches suggest covering the headland with nested polygons and smooth turns, however, covering the field corners entirely requires manoeuvres with reversing. In the new method, the polygon corners are modified to allow a reversing turn. A comparison to two other methods considering gap, overlap, and crossing the field boundary shows an improvement in the coverage result especially in field corners of around 90 degrees, and 240 degrees and above. Applicability of the new method is shown with several examples of real polygonal field maps.

cs.RO↗

Digital Twin Modeling of a Highly Automated Agricultural Tractor

In efforts to increase research efficiency and availability, a digital twin of our research tractor (AMX G-trac) is created, focusing especially on the CAN communication for data reading and actuation command following the ISOBUS protocol. Mevea Simulation Software is utilized as the foundation, providing the kinematic model and visuals, while Python is used to read and write CAN messages over a Kvaser CanKing virtual CAN channel. Various performance tests involving straight line and turning behavior are performed in both the digital twin simulation and in the real world to measure similarity. Results indicate that the Mevea model behaves very comparable in its lateral dynamics, often within 5-10 percent, but requires better data to fully capture the longitudinal aspects like acceleration. The final model described in this paper sets the table for a second iteration to include more tractor functions such as hydraulics and tractor-implement dynamics.

cs.OH↗

Design and Benchmarking of the Data Distribution Service for Real-Time Interoperable Agricultural Machinery Communications

Inter-manufacturer plug-and-play communication in agricultural machinery is currently based on the ISO 11783 standard series, which specifies a 250 kbit/s CAN bus communication layer. To support higher-bandwidth use cases, the ISO~23870 series is being developed for next-generation Ethernet-based agricultural machine-to-machine communication. Modern Ethernet/IP-based architectures often make use of a middleware for discovery, data exchange, quality of service configuration, and security. This paper evaluates the Data Distribution Service (DDS) as a candidate middleware for secure, plug-and-play agricultural machinery networking. DDS-based proof-of-concept communication design is presented for a representative Task Controller (TC) and implement scenario, including implement-description topics and separate best-effort and reliable topics for runtime process data. Design was implemented in C++ using the FastDDS library and benchmarked on embedded hardware representative of agricultural machinery. Runtime throughput was evaluated for one-to-one and one-to-two TC-implement scenarios under four DDS security configurations. The results show that DDS security mechanisms substantially reduce maximum throughput on embedded hardware. In the tested best-effort scenarios, signing and encryption reduced mean throughput by approximately 70-84% compared with the unsecured configuration. Encrypted one-to-one best-effort case achieved approximately 4980 received process data updates per second on both the TC and implement, corresponding to about 50 process data updates per second per simulated section for 100 rate-controllable sections. These results indicate that DDS is a technically plausible middleware candidate for secure Ethernet-based agricultural machinery interoperability, while further work is required to evaluate latency, scalability, vendor interoperability, and lower-power devices.

cs.NI↗

Electric Axle and Wheel Module Driveline Concepts for Self-propelled Agricultural Machinery and Equipment Carriers

Direct electric drivelines without power-split open new design freedom for frame and suspension design, along with often lower energy losses. This paper focuses on self-propelled agricultural machinery (combine and forage harvest-ers, root crop harvesters), equipment carriers, propelled trailers and field robots. For a typical vehicle with four driven wheels, the electric motors can be packaged as two axle modules or four wheel modules, both defined herein as self-contained mechatronic units with integrated power electronics, distributed control intelligence and steering. Axle module and wheel module concepts are compared in detail against engineering requirements including loads, effi-ciency, steerability, controllability, braking, suspension, structural load support, asymmetric wheel loading and manu-facturing cost. The wheel module offers maximum design freedom, redundancy and controllability, while the axle module provides lower cost, structural rigidity, automatic load sharing through the differential and the ability to be used in existing vehicle structures. Both concepts are defined such that distributed control intelligence and steering are integral to each unit, requiring only a DC power bus and communication interface from the vehicle.

eess.SY↗

EcoTIM: Fuel-saving multi-brand tillage with ISO 11783 TIM

Tillage operations account for a large share of on-farm diesel consumption, yet the fuel efficiency of the combined tractor-implement system is not optimised in current practice. Modern continuously variable transmission (CVT) tractors minimise engine fuel consumption internally, but they treat the implement as an unknown load and do not account for the effect of vehicle speed on implement draft force. This paper presents EcoTIM, a distributed fuel-optimisation concept in which the tractor and tillage implement cooperate through the extended ISO 11783 (ISOBUS) Tractor Implement Management (TIM) interface to minimise fuel consumption per hectare in real time. In the EcoTIM concept, the tractor Electric Control Unit fuses its internal engine, transmission, and traction efficiencies into a single combined efficiency value and its derivative with respect to vehicle speed, and broadcasts both to the implement at the standard 100 ms CAN bus cycle. The implement ECU combines these two received scalars with its own analytically known draft force model to evaluate the fuel-consumption gradient, and commands the optimal speed, and as a novel TIM extension, the desired acceleration, back to the tractor. Because only two scalar values are exchanged and neither party discloses proprietary subsystem models, the architecture is inherently multi-brand and plug-and-play. The required data exchange is realised with three new messages and one backward-compatible byte-level extension to the standard TIM speed command, and this paper proposes that these messages are standardised within ISO 11783. The acceleration command enables feed-forward torque and CVT ratio planning on the tractor side, improving transient response compared with speed-only TIM commands. This paper also contains a proof-of-concept simulation with six tillage scenarios and a spatially varying 1km test track for initial concept validation.

eess.SY↗

EmbC-Test: How to Speed Up Embedded Software Testing Using LLMs and RAG

Manual development of automatic tests for embedded C software is a strenuous and time-consuming task that does not scale well. With the accelerating pace of software release cycles, verification increasingly becomes the bottleneck in the embedded development workflow. This paper presents a Retrieval-Augmented Generation (RAG) pipeline as a solution for partial automation of the verification process. By grounding a large language model in project-specific artifacts, the approach reduces hallucinations and improves project alignment. An industrial evaluation showed that the generated tests are 100 % syntactically correct, with 85 % successfully passing runtime validation. The proposed solution has the potential to save up to 66 % of the testing time compared to manual test writing while generating 270 tests per hour.

cs.SE↗

Agri-Query: A Case Study on RAG vs. Long-Context LLMs for Cross-Lingual Technical Question Answering

We present a case study evaluating large language models (LLMs) with 128K-token context windows on a technical question answering (QA) task. Our benchmark is built on a user manual for an agricultural machine, available in English, French, and German. It simulates a cross-lingual information retrieval scenario where questions are posed in English against all three language versions of the manual. The evaluation focuses on realistic "needle-in-a-haystack" challenges and includes unanswerable questions to test for hallucinations. We compare nine long-context LLMs using direct prompting against three Retrieval-Augmented Generation (RAG) strategies (keyword, semantic, hybrid), with an LLM-as-a-judge for evaluation. Our findings for this specific manual show that Hybrid RAG consistently outperforms direct long-context prompting. Models like Gemini 2.5 Flash and the smaller Qwen 2.5 7B achieve high accuracy (over 85%) across all languages with RAG. This paper contributes a detailed analysis of LLM performance in a specialized industrial domain and an open framework for similar evaluations, highlighting practical trade-offs and challenges.

cs.CL↗

Smart Prism with Tilt Compensation for CAN bus on Mobile Machinery Using Robotic Total Stations

Accurate reference trajectories are required to validate autonomous agricultural robots and highly automated off-road vehicles under real-world field conditions. In practice, robotic total stations provide millimeter-level prism center coordinates, but the point of interest on the vehicle is typically displaced by a lever arm, ranging from decimeters to multiple meters. Roll and pitch motions, as typically observed in off-road machinery, therefore introduce horizontal point of interest errors far exceeding the measurement accuracy of robotic total stations observations. This paper presents the design, implementation, and validation of a Smart Prism prototype that augments a robotic total station prism with an inertial measurement unit to enable real-time tilt compensation. The prototype integrates an STM32H7 microcontroller and a Murata SCH16T-series IMU and estimates roll and pitch angles using an adaptive complementary filter. The tilt-compensated point of interest coordinates are obtained by transforming a calibrated lever arm from the body frame into the navigation frame and combining it with robotic total station prism positions. To support vehicle-side integration, the system can transmit prism and tilt-compensated point of interest coordinates on the Controller Area Network bus, allowing the point of interest to be treated as a virtual position sensor (e.g., co-located with a rear-axle reference point). Experiments with a fixed ground reference point, using a prism to point of interest lever arm of approximately 1.07m and manual roll/pitch excursions of up to 60 deg, yield three-dimensional root-mean-square errors between 2.9mm and 23.6mm across five test series. The results demonstrate that IMU-based tilt compensation enables reference measurements suitable for validating centimeter-level navigation systems under dynamic field conditions.

eess.SY↗

ISO FastLane: Faster ISO 11783 with Dual Stack Approach as a Short Term Solution

The agricultural industry has been searching for a high-speed successor to the 250~kbit/s CAN bus backbone of ISO~11783 (ISOBUS) for over a decade, yet no protocol-level solution has reached standardization. Meanwhile, modern planters, sprayers, and Virtual Terminals are already constrained by the bus bandwidth. This paper presents ISO FastLane, a gateway-less dual-stack approach that routes point-to-point ISOBUS traffic over Ethernet while keeping broadcast messages on the existing CAN bus. The solution requires no new state machines, no middleware, and no changes to application layer code: only a simple Layer~3 routing decision and a lightweight peer discovery mechanism called Augmented Address Claim (AACL). Legacy devices continue to operate unmodified and unaware of FastLane traffic. Preliminary tests reported on the paper demonstrate that ISO FastLane accelerates Virtual Terminal object pool uploads by factor of 8 and sustains Task Controller message rates over 100 times beyond the current specification limit. Because ISO FastLane builds entirely on existing J1939 and ISO~11783 conventions, it can be implemented by ISOBUS engineers in a matter of weeks. This is delivering tangible performance gains today, without waiting for the long-term High Speed ISOBUS solution.

cs.NI↗

RB-Dust -- A Reference-based Dataset for Vision-based Dust Removal

Dust in the agricultural landscape is a significant challenge and influences, for example, the environmental perception of autonomous agricultural machines. Image enhancement algorithms can be used to reduce dust. However, these require dusty and dust-free images of the same environment for validation. In fact, to date, there is no dataset that we are aware of that addresses this issue. Therefore, we present the agriscapes RB-Dust dataset, which is named after its purpose of reference-based dust removal. It is not possible to take pictures from the cabin during tillage, as this would cause shifts in the images. Because of this, we built a setup from which it is possible to take images from a stationary position close to the passing tractor. The test setup was based on a half-sided gate through which the tractor could drive. The field tests were carried out on a farm in Bavaria, Germany, during tillage. During the field tests, other parameters such as soil moisture and wind speed were controlled, as these significantly affect dust development. We validated our dataset with contrast enhancement and image dehazing algorithms and analyzed the generalizability from recordings from the moving tractor. Finally, we demonstrate the application of dust removal based on a high-level vision task, such as person classification. Our empirical study confirms the validity of RB-Dust for vision-based dust removal in agriculture.

cs.CV↗