Tag Archives: Quadrotor

RL for multiple tasks in the case of quadrotors and a short state of the art about the general problem

J. Xing, I. Geles, Y. Song, E. Aljalbout and D. Scaramuzza, Multi-Task Reinforcement Learning for Quadrotors, IEEE Robotics and Automation Letters, vol. 10, no. 3, pp. 2112-2119, March 2025, DOI: 10.1109/LRA.2024.3520894.

Reinforcement learning (RL) has shown great effectiveness in quadrotor control, enabling specialized policies to develop even human-champion-level performance in single-task scenarios. However, these specialized policies often struggle with novel tasks, requiring a complete retraining of the policy from scratch. To address this limitation, this paper presents a novel multi-task reinforcement learning (MTRL) framework tailored for quadrotor control, leveraging the shared physical dynamics of the platform to enhance sample efficiency and task performance. By employing a multi-critic architecture and shared task encoders, our framework facilitates knowledge transfer across tasks, enabling a single policy to execute diverse maneuvers, including high-speed stabilization, velocity tracking, and autonomous racing. Our experimental results, validated both in simulation and real-world scenarios, demonstrate that our framework outperforms baseline approaches in terms of sample efficiency and overall task performance. Video is available at https://youtu.be/HfK9UT1OVnY.

An interesting simulation educational software for control systems engineering based on controlling a quadrotor

S. Khan, M. H. Jaffery, A. Hanif and M. R. Asif, Teaching Tool for a Control Systems Laboratory Using a Quadrotor as a Plant in MATLAB, IEEE Transactions on Education, vol. 60, no. 4, pp. 249-256, DOI: 10.1109/TE.2017.2653762.

This paper presents a MATLAB-based application to teach the guidance, navigation, and control concepts of a quadrotor to undergraduate students, using a graphical user interface (GUI) and 3-D animations. The Simulink quadrotor model is controlled by a proportional integral derivative controller and a linear quadratic regulator controller. The GUI layout’s many components can be easily programmed to perform various experiments by considering the simulation of the quadrotor as a plant; it incorporates control systems (CS) fundamentals such as time domain response, transfer function and state-space form, pole-zero location, root locus, frequency domain response, steady-state error, position and disturbance response, controller design and tuning, unity, and the use of a Kalman filter as a feedback sensor. 3-D animations are used to display the quadrotor flying in any given condition selected by the user. For each simulation, users can view the output response in the form of 3-D animations, and can run time plots. The quadrotor educational tool (QET) helps students in the CS laboratory understand basic CS concepts. The QET was evaluated based on student feedback, grades, satisfaction, and interest in CS.