<oai_dc:dc xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
  <dc:creator>Shahid, Asad Ali</dc:creator>
  <dc:creator>Sesin, Jorge Said Vidal</dc:creator>
  <dc:creator>Pecioski, Damjan</dc:creator>
  <dc:creator>Braghin, Francesco</dc:creator>
  <dc:creator>Piga, Dario</dc:creator>
  <dc:creator>Roveda, Loris</dc:creator>
  <dc:date>2021</dc:date>
  <dc:description xmlns:ns0="xml" ns0:lang="en">Many real-world tasks require multiple agents to work together.  When talking aboutmultiple agents in robotics, it is usually referenced to multiple manipulators in collaboration tosolve a given task, where each one is controlled by a single agent. However, due to the increasingdevelopment of modular and re-configurable robots, it is also important to investigate the possibilityof implementing multi-agent controllers that learn how to manage the manipulator’s degrees offreedom (DoF) in separated clusters for the execution of a given application (e.g., being able toface faults or, partially, new kinematics configurations). Within this context, this paper focuses onthe decentralization of the robot control action learning and (re)execution considering a genericmulti-DoF manipulator.  Indeed, the proposed framework employs a multi-agent paradigm andinvestigates how such a framework impacts the control action learning process. Multiple variations ofthe multi-agent framework have been proposed and tested in this research, comparing the achievedperformance w.r.t. a centralized (i.e., single-agent) control action learning framework, previouslyproposed by some of the authors.  As a case study, a manipulation task (i.e., grasping and lifting)of an unknown object (to the robot controller) has been considered for validation, employing aFranka EMIKA panda robot. The MuJoCo environment has been employed to implement and testthe proposed multi-agent framework. The achieved results show that the proposed decentralizedapproach is capable of accelerating the learning process at the beginning with respect to the single-agent framework while also reducing the computational effort.  In fact, when decentralizing thecontroller, it is shown that the number of variables involved in the action space can be efficientlyseparated into several groups and several agents. This simplifies the original complex problem intomultiple ones, efficiently improving the task learning process.</dc:description>
  <dc:format>application/pdf</dc:format>
  <dc:identifier>https://localhost:5000/ark:/12658/srd1321041</dc:identifier>
  <dc:identifier>https://susi.usi.ch/global/documents/321041</dc:identifier>
  <dc:identifier>https://susi.usi.ch/documents/321041/files/Roveda_2021_MDPI_applsci.pdf</dc:identifier>
  <dc:language>eng</dc:language>
  <dc:relation>info:eu-repo/semantics/altIdentifier/doi/10.3390/app112110227</dc:relation>
  <dc:relation>info:eu-repo/semantics/altIdentifier/ark/12658/srd1321041</dc:relation>
  <dc:rights>info:eu-repo/semantics/openAccess</dc:rights>
  <dc:rights>CC BY</dc:rights>
  <dc:source>Applied sciences. - 2021, vol. 11, no. 21, p. 10227</dc:source>
  <dc:subject xmlns:ns1="xml" ns1:lang="en">Reinforcement learning</dc:subject>
  <dc:subject xmlns:ns2="xml" ns2:lang="en">Decentralized control</dc:subject>
  <dc:subject xmlns:ns3="xml" ns3:lang="en">Multi-agent</dc:subject>
  <dc:subject xmlns:ns4="xml" ns4:lang="en">Continuous control</dc:subject>
  <dc:subject xmlns:ns5="xml" ns5:lang="en">Robotic grasping</dc:subject>
  <dc:subject xmlns:ns6="xml" ns6:lang="en">Policy optimization</dc:subject>
  <dc:subject>info:eu-repo/classification/udc/004</dc:subject>
  <dc:title xmlns:ns7="xml" ns7:lang="en">Decentralized multi-agent control of a manipulator in continuous task learning</dc:title>
  <dc:type>http://purl.org/coar/resource_type/c_6501</dc:type>
</oai_dc:dc>
