Tag Archives: Embedded Computers

Time series events recognition in embedded devices

Pau Gairí, Tomas Palleja, Marcel Tresanchez, Real-time recognition of multivariate event-based time series on embedded devices using recurrent neural networks: A practical study, Engineering Applications of Artificial Intelligence, Volume 182, Part 1, 2026,10.1016/j.engappai.2026.115787.

Real-time time-series recognition on embedded devices remains challenging due to limited computational resources and memory capacity, but also because of the operational constraints imposed by randomly triggered, event-driven sensing applications with variable duration. Most deep learning approaches rely on offline processing, complete-sequence inference, and pre-established deployment frameworks. In contrast, hardware-aware design along with recurrent architectures can distribute inference across the time-series evolution, enabling low latency solutions that better suit time-critical applications. This work combines recurrent neural networks with gated units and microcontroller-oriented processing to enable multivariate, event-based classification directly on embedded hardware. On one hand, a peripheral-driven approach for acquisition, preprocessing, and sample-rate adaptation is introduced, including real-time dynamic linearization and normalization strategies for incomplete time series. On the other hand, a lightweight deep recurrent architecture is tailored to the characteristics of each input and extended with a multi-objective output. Additionally, a dedicated multi-label dataset together with an automated clustering and labelling methodology enables an event-based training strategy with shared objectives that ensures stable inference and efficient memory usage on the device. The proposed methodology was evaluated across different architectural configurations, identifying optimal trade-offs between computational cost and classification accuracy. The on-device implementation shows that 32-bit floating-point inference using the microcontroller Floating-Point Unit avoids additional compression while preserving up to 99% of the best model performance. The optimized kernel achieves a macro F1-score (average of per-class harmonic means of precision and recall) of 0.840, while real-time validation under real application conditions confirms robust operation with a macro F1-score of 0.898.

Image resizing for achieving real-time in embedded AI

Hu, Y., Liu, S., Abdelzaher, T. et al. Real-time task scheduling with image resizing for criticality-based machine perception, Real-Time Syst 58, 430\u2013455 (2022) DOI: 10.1007/s11241-022-09387-6.

This paper extends a previous conference publication that proposed a real-time task scheduling framework for criticality-based machine perception, leveraging image resizing as the tool to control the accuracy and execution time trade-off. Criticality-based machine perception reduces the computing demand of on-board AI-based machine inference pipelines (that run on embedded hardware) in applications such as autonomous drones and cars. By segmenting inputs, such as individual video frames, into smaller parts and allowing the downstream AI-based perception module to process some segments ahead of (or at a higher quality than) others, limited machine resources are spent more judiciously on more important parts of the input (e.g., on foreground objects in lieu of backgrounds). In recent work, we explored the use of image resizing as a way to offer a middle ground between full-resolution processing and dropping, thus allowing more flexibility in handling less important parts of the input. In this journal extension, we make the following contributions: (i) We relax a limiting assumption of our prior work; namely, the need for a \u201cperfect sensor” to identify which parts of the image are more critical. Instead, we investigate the use of real LiDAR measurements for quick-and-dirty image segmentation ahead of AI-based processing. (ii) We explore another dimension of freedom in the scheduler: namely, merging several nearby objects into a consolidated segment for downstream processing. We formulate the scheduling problem as an optimal resize-merge problem and design a solution for it. Experiments on an AI-powered embedded platform with a real-world driving dataset demonstrate the practicality and effectiveness of our proposed framework.

A new method for nonlinear optimization aimed to embedded computers, and a nice state of the art of that problem

N. Y. Chiang, R. Huang and V. M. Zavala, An Augmented Lagrangian Filter Method for Real-Time Embedded Optimization, IEEE Transactions on Automatic Control, vol. 62, no. 12, pp. 6110-6121, DOI: 10.1109/TAC.2017.2694806.

We present a filter line-search algorithm for nonconvex continuous optimization that combines an augmented Lagrangian function and a constraint violation metric to accept and reject steps. The approach is motivated by real-time optimization applications that need to be executed on embedded computing platforms with limited memory and processor speeds. The proposed method enables primal-dual regularization of the linear algebra system that in turn permits the use of solution strategies with lower computing overheads. We prove that the proposed algorithm is globally convergent and we demonstrate the developments using a nonconvex real-time optimization application for a building heating, ventilation, and air conditioning system. Our numerical tests are performed on a standard processor and on an embedded platform. We demonstrate that the approach reduces solution times by a factor of over 1000.