Journal Article10.1109/lra.2023.3333662
Automatically-Tuned Model Predictive Control for an Underwater Soft Robot
W. D. Null,William Edwards,Dohun Jeong,Teodor Tchalakov,James Menezes,Kris Hauser,Y. Z +6 more
7
TL;DR: This study develops an automatically-tuned model predictive control (MPC) method, AutoMPC, for controlling an underwater soft robot, achieving higher accuracy and reliability than state-of-the-art baselines in- and out-of-distribution of training data.
read more
Abstract: Soft robots have desirable qualities for use in underwater environments thanks to their inherent compliance and lack of need for exposed hardware. Nevertheless, these advantages come at the cost of considerable control challenges. Data-driven model predictive control (MPC) is an approach that has shown promise in controlling soft robots. However, manually tuning the many hyperparameters in the learned dynamics model and the optimizer can be extremely tedious. In this work, we explore using data-driven MPC to control an underwater soft robot, and employ the AutoMPC method to automatically tune the hyperparameters and generate the controller. In the process, we extend AutoMPC's capabilities to handle multi-task tuning and we add a barrier cost function to enforce actuator constraints. Our experiments show that the AutoMPC controller reaches targets with significantly higher accuracy and reliability than state-of-the-art baselines both in- and out-of-distribution of the training data.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
DiffTune-MPC: Closed-Loop Learning for Model Predictive Control
Ran Tao,Sheng Cheng,Xiaofeng Wang,Shenlong Wang,Naira Hovakimyan +4 more
TL;DR: DiffTune-MPC is presented, a novel learning method, to learn the cost function of an MPC in a closed-loop manner and the influence of constraints (from actuation limits) on learning is illustrated.
3
Applications of metaheuristic optimization algorithms in model predictive control for chemical engineering processes: A systematic review
Mohamad Al Bannoud,Carlos Alexandre Moreira da Silva,Tiago Dias Martins +2 more
3
Efficient Automatic Tuning for Data-driven Model Predictive Control via Meta-Learning
TL;DR: AutoMPC's efficiency and stability are improved using meta-learning-based Portfolio optimization, which stabilizes the tuning process and optimizes initial designs for BO.
1
Deep Learning Methods in Soft Robotics: Architectures and Applications
Tomáš Čakurda,M Trojanová,Pavlo Pomin,Alexander Hošovský +3 more
TL;DR: This review summarizes state-of-the-art deep learning architectures for soft robotics, discussing their applications in soft manipulators, grippers, sensors, and e-skins, and analyzing their features and benefits for addressing various soft robotics challenges and issues.
1
DiffTune-MPC: Closed-Loop Learning for Model Predictive Control
Ran Tao,Sheng Cheng,Xiaofeng Wang,Shenlong Wang,Naira Hovakimyan +4 more
References
Design and Kinematic Modeling of Constant Curvature Continuum Robots: A Review
Robert J. Webster,Bryan A. Jones +1 more
TL;DR: This discussion elucidates what has been articulated in different ways by a number of researchers in the past several years, namely that constant-curvature kinematics can be considered as consisting of two separate submappings: one that is general and applies to all continuum robots, and another that is robot-specific.
•Proceedings Article
Efficient and robust automated machine learning
Matthias Feurer,Aaron Klein,Katharina Eggensperger,Jost Tobias Springenberg,Manuel Blum,Frank Hutter +5 more
- 07 Dec 2015
TL;DR: This work introduces a robust new AutoML system based on scikit-learn, which improves on existing AutoML methods by automatically taking into account past performance on similar datasets, and by constructing ensembles from the models evaluated during the optimization.
•Posted Content
Conservative Q-Learning for Offline Reinforcement Learning
TL;DR: Conservative Q-learning (CQL) is proposed, which aims to address limitations of offline RL methods by learning a conservative Q-function such that the expected value of a policy under this Q- function lower-bounds its true value.
1.3K
•Journal Article
D4RL: Datasets for Deep Data-Driven Reinforcement Learning
TL;DR: This work introduces benchmarks specifically designed for the offline setting, guided by key properties of datasets relevant to real-world applications of offline RL, and releases benchmark tasks and datasets with a comprehensive evaluation of existing algorithms and an evaluation protocol together with an open-source codebase.
Synthesis and stabilization of complex behaviors through online trajectory optimization
Yuval Tassa,Tom Erez,Emanuel Todorov +2 more
- 24 Dec 2012
TL;DR: An online trajectory optimization method and software platform applicable to complex humanoid robots performing challenging tasks such as getting up from an arbitrary pose on the ground and recovering from large disturbances using dexterous acrobatic maneuvers is presented.