dazeley-deepreinforcement-.pdf (628.24 kB)
Deep reinforcement learning with Interactive Feedback in a Human–Robot Environment
journal contribution
posted on 2020-01-01, 00:00 authored by Ithan Moreira, Javier Rivas, Francisco Cruz Naranjo, Richard DazeleyRichard Dazeley, Angel Ayala, Bruno FernandesRobots are extending their presence in domestic environments every day, it being more common to see them carrying out tasks in home scenarios. In the future, robots are expected to increasingly perform more complex tasks and, therefore, be able to acquire experience from different sources as quickly as possible. A plausible approach to address this issue is interactive feedback, where a trainer advises a learner on which actions should be taken from specific states to speed up the learning process. Moreover, deep reinforcement learning has been recently widely used in robotics to learn the environment and acquire new skills autonomously. However, an open issue when using deep reinforcement learning is the excessive time needed to learn a task from raw input images. In this work, we propose a deep reinforcement learning approach with interactive feedback to learn a domestic task in a Human–Robot scenario. We compare three different learning methods using a simulated robotic arm for the task of organizing different objects; the proposed methods are (i) deep reinforcement learning (DeepRL); (ii) interactive deep reinforcement learning using a previously trained artificial agent as an advisor (agent–IDeepRL); and (iii) interactive deep reinforcement learning using a human advisor (human–IDeepRL). We demonstrate that interactive approaches provide advantages for the learning process. The obtained results show that a learner agent, using either agent–IDeepRL or human–IDeepRL, completes the given task earlier and has fewer mistakes compared to the autonomous DeepRL approach.
History
Journal
Applied SciencesVolume
10Issue
16Article number
5574Pagination
1 - 16Publisher
MDPI AGLocation
Basel, SwitzerlandPublisher DOI
Link to full text
eISSN
2076-3417Language
engPublication classification
C1 Refereed article in a scholarly journalUsage metrics
Categories
No categories selectedKeywords
roboticsinteractive deepreinforcement learningdeep reinforcement learningdomestic scenarioScience & TechnologyPhysical SciencesTechnologyChemistry, MultidisciplinaryEngineering, MultidisciplinaryMaterials Science, MultidisciplinaryPhysics, AppliedChemistryEngineeringMaterials SciencePhysicsinteractive deep reinforcement learning
Licence
Exports
RefWorks
BibTeX
Ref. manager
Endnote
DataCite
NLM
DC