Robotic Manipulation for Nuclear Sort and Segregation

Informazioni relative al progetto

RoMaNS

ID dell’accordo di sovvenzione: 645582

DOI

10.3030/645582

Progetto chiuso

Data della firma CE 8 Dicembre 2014

Data di avvio 1 Maggio 2015

Data di completamento 31 Ottobre 2018

Finanziato da

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Costo totale

€ 6 377 521,25

Contributo UE

€ 6 377 521,00

Coordinato da

THE UNIVERSITY OF BIRMINGHAM
United Kingdom

CORDIS fornisce collegamenti ai risultati finali pubblici e alle pubblicazioni dei progetti ORIZZONTE.

I link ai risultati e alle pubblicazioni dei progetti del 7° PQ, così come i link ad alcuni tipi di risultati specifici come dataset e software, sono recuperati dinamicamente da .OpenAIRE .

Risultati finali

Websites, patent fillings, videos etc. (1)

Project website. Report.

Project website

Documents, reports (13)

Force cues based on integral error signals
Project interfaces and data types
Multi-modal, multi-category object modelling
Learning with the different types of instructions
Learning Active segmentation from human instructions
Real-time visual localisation and control
semi-autonomous learning for reactive grasping and disentangling objects
performance evaluation of the RoMaNS robotic manipulation system

Performance evaluation of the RoMaNS robotic manipulation system

Semi-autonomous learning for trajectory and grasp planning
measuring expert MSM operator population
Adaptive visual tracking for arbitrary objects without training
Mapping between human and robot hands
bench-mark performance measurement on standardised tasks

Bench-mark performance measurement on standardised tasks

Pubblicazioni

Conference proceedings (44)

A Visual-Based Shared Control Architecture for Remote Telemanipulation

Autori: Robuffo Giordano, Paolo; Abi-Farraj, Firas; Pedemonte, Nicolò
Pubblicato in: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS'16, Oct 2016, Daejeon, South Korea, Numero 1, 2016
Editore: IEEE

Towards Categorization and Pose Estimation of Sets of Occluded Objects in Cluttered Scenes from Depth Data and Generic Object Models Using Joint Parsing

Autori: H. Basevi, A. Leonardis.
Pubblicato in: ECCV Workshop on 6DOF Pose Estimation, 2016
Editore: Springer

Projected Inverse Dynamics Control and Optimal Control for Robots in Contact with the Environment: A Comparison

Autori: V. Ortenzi, R. Stolkin, J. Kuo, M. Mistry
Pubblicato in: IROS, 2015
Editore: IEEE

Towards advanced robotic manipulation for nuclear decommissioning: a pilot study on tele-operation and autonomy

Autori: N. Marturi, A. Rastegarpanah, C. Takahashi, M. Kopicki, M. Talha, S. Zurek, M. Adjigble, J.A. Kuo, R. Stolkin, Y. Bekiroglu
Pubblicato in: IEEE Robotics and Automation for Humanitarian Applications (RAHA), 2016
Editore: IEEE

Regularized Covariance Estimation for Weighted Maximum Likelihood Policy Search Methods

Autori: A. Abdolmaleki, Lau, N., Reis, L. & Neumann, G.
Pubblicato in: IEEE Humanoids, 2015
Editore: IEEE

Kinematics-Based Estimation of Contact Constraints Using Only Proprioception

Autori: V. Ortenzi, H. Lin, M. Azad, R. Stolkin, Kuo Jeffrey, M. Mistry
Pubblicato in: IEEE Humanoids, 2016
Editore: IEEE

Autonomous vision-guided bi-manual grasping and manipulation

Autori: A. Rastegarpanah, R. Stolkin
Pubblicato in: IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO), 2017
Editore: IEEE

A real-time tracking and optimised gaze control for a redundant humanoid robot head

Autori: Marturi, N., Ortenzi, V., Xiao, J., Adjigble, M., Stolkin, R. and Leonardis, A.
Pubblicato in: IEEE-RAS Int. Conf. Humanoid Robots (Humanoids), 2015
Editore: IEEE

Task-relevant grasp selection: a joint solution to planning grasps and manipulative motion trajectories

Autori: A. M.Ghalamzan E., N. Mavrakis, M. Kopicki, A. Leonardis, R. Stolkin
Pubblicato in: IROS, 2016
Editore: IEEE

The Kernel Kalman Rule - Efficient Nonparametric Inference with Recursive Least Squares

Autori: Gebhardt, G. H. W, Kupcsik, A. and Neumann, G.
Pubblicato in: National Conference on Artificial Intelligence (AAAI), 2017
Editore: AAAI

Towards robotic decommissioning of legacy nuclear plant: results of human-factors experiments with tele-robotic manipulation, and a discussion of challenges and approaches for decommissioning

Autori: M. Talha, C. Takahashi, A. Ghalamzan, J. Kuo, W. Ingamells, R. Stolkin
Pubblicato in: IEEE International Symposium on Safety, Security and Rescue Robotics, 2016
Editore: IEEE

Single Target Tracking Using Adaptive Clustered Decision Trees and Dynamic Multi-Level Appearance Models

Autori: J. Xiao, R. Stolkin and A. Leonardis
Pubblicato in: CVPR, 2015
Editore: IEEE

Optimal Control and Inverse Optimal Control by Distribution Matching

Autori: O. Arenz, Abdulsamad, H. and Neumann, G.
Pubblicato in: IROS, 2016
Editore: IEEE

Distractor-supported single target tracking in extremely cluttered scenes

Autori: J. Xiao, L. Qiao, R. Stolkin and A. Leonardis
Pubblicato in: ECCV, 2016
Editore: Springer

Experiments with Hierarchical Reinforcement Learning of Multiple Grasping Policies

Autori: T. Osa, Peters, J. and Neumann, G.
Pubblicato in: International Symposium on Experimental Robotics (ISER), 2016
Editore: ISER

Vision-guided state estimation and control of robotic manipulators which lack proprioceptive sensors

Autori: V. Ortenzi, N. Marturi, R. Stolkin, J. Kuo, M. Mistry
Pubblicato in: IROS, 2016
Editore: IEEE

Analysis of the inertia and dynamics of grasped objects, for choosing optimal grasps to enable torque-efficient post-grasp manipulations

Autori: N. Mavrakis, A. Ghalamzan, L. Baronti, R. Stolkin, M. Castellani
Pubblicato in: IEEE Humanoids, 2016
Editore: IEEE

Evaluating Deep Convolutional Neural Networks for Material Classification'

Autori: G. Kalliatakis, G. Stamatiadis, S. Ehsan, A. Leonardis, J. Gall, A. Sticlaru and K. McDonald-Maier
Pubblicato in: VISAPP, 2017
Editore: VISAPP

Visual-Based Shared Control Architecture for Remote Telemanipulation

Autori: Abi-Farraj, F., Pedemonte N., and Robuffo Giordano, P. A
Pubblicato in: IEEE Int. Conf. on Intelligent Robots and Systems (IROS), 2016
Editore: IEEE

Humanoid Teleoperation using Task-Relevant Haptic Feedback

Autori: Abi-Farraj , Firas; Henze , Bernd; Werner , Alexander; Panzirsch , Michael; Ott , Christian; Roa , Máximo ,
Pubblicato in: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS'18, Oct 2018, Madrid, Spain. 2018, Numero 1, 2017
Editore: IEEE/RSJ

A real-time tracking and optimised gaze control for a redundant humanoid robot head

Autori: Naresh Marturi, Valerio Ortenzi, Jingjing Xiao, Maxime Adjigble, Rustam Stolkin, Ales Leonardis
Pubblicato in: 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), 2015, Pagina/e 467-474, ISBN 978-1-4799-6885-5
Editore: IEEE
DOI: 10.1109/humanoids.2015.7363591

Grasp that optimises objectives along post-grasp trajectories

Autori: E, Amir M Ghalamzan; Mavrakis, Nikos; Stolkin, Rustam
Pubblicato in: Numero 5, 2017
Editore: RSI

Optimal control and inverse optimal control by distribution matching

Autori: Oleg Arenz, Hany Abdulsamad, Gerhard Neumann
Pubblicato in: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016, Pagina/e 4046-4053, ISBN 978-1-5090-3762-9
Editore: IEEE
DOI: 10.1109/iros.2016.7759596

Hybrid control trajectory optimization under uncertainty

Autori: Joni Pajarinen, Ville Kyrki, Michael Koval, Siddhartha Srinivasa, Jan Peters, Gerhard Neumann
Pubblicato in: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017, Pagina/e 5694-5701, ISBN 978-1-5386-2682-5
Editore: IEEE
DOI: 10.1109/IROS.2017.8206460

Model-Based Relative Entropy Stochastic Search

Autori: Abbas Abdolmaleki, Rodulf Lioutikov, Nuno Lua, Luis Paulo Reis, Jan Peters, Gerhard Neumann
Pubblicato in: Proceedings of the 2016 on Genetic and Evolutionary Computation Conference Companion - GECCO '16 Companion, 2016, Pagina/e 153-154, ISBN 9781-450343237
Editore: ACM Press
DOI: 10.1145/2908961.2930952

A fully end-to-end deep learning approach for real-time simultaneous 3D reconstruction and material recognition

Autori: Cheng Zhao, Li Sun, Rustam Stolkin
Pubblicato in: 2017 18th International Conference on Advanced Robotics (ICAR), 2017, Pagina/e 75-82, ISBN 978-1-5386-3157-7
Editore: IEEE
DOI: 10.1109/ICAR.2017.8023499

Vision-guided state estimation and control of robotic manipulators which lack proprioceptive sensors

Autori: Valerio Ortenzi, Naresh Marturi, Rustam Stolkin, Jeffrey A. Kuo, Michael Mistry
Pubblicato in: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016, Pagina/e 3567-3574, ISBN 978-1-5090-3762-9
Editore: IEEE
DOI: 10.1109/iros.2016.7759525

Regularized covariance estimation for weighted maximum likelihood policy search methods

Autori: Abbas Abdolmaleki, Nuno Lau, Luis Paulo Reis, Gerhard Neumann
Pubblicato in: 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), 2015, Pagina/e 154-159, ISBN 978-1-4799-6885-5
Editore: IEEE
DOI: 10.1109/humanoids.2015.7363529

Single-Shot Clothing Category Recognition in Free-Configurations with Application to Autonomous Clothes Sorting

Autori: Sun, Li; Aragon-Camarasa, Gerardo; Rogers, Simon; Stolkin, Rustam; Siebert, J. Paul
Pubblicato in: Numero 12, 2017
Editore: IEEE

Safe Robotic Grasping: Minimum Impact-Force Grasp Selection

Autori: Mavrakis, Nikos; E., Amir M. Ghalamzan; Stolkin, Rustam
Pubblicato in: Numero 10, 2017
Editore: IEEE

Towards advanced robotic manipulation for nuclear decommissioning: A pilot study on tele-operation and autonomy

Autori: Naresh Marturi, Alireza Rastegarpanah, Chie Takahashi, Maxime Adjigble, Rustam Stolkin, Sebastian Zurek, Marek Kopicki, Mohammed Talha, Jeffrey A. Kuo, Yasemin Bekiroglu
Pubblicato in: 2016 International Conference on Robotics and Automation for Humanitarian Applications (RAHA), 2016, Pagina/e 1-8, ISBN 978-1-5090-5203-5
Editore: IEEE
DOI: 10.1109/raha.2016.7931866

User evaluation of a haptic-enabled shared-control approach for robotic telemanipulation

Autori: Abi-Farraj , Firas; Pacchierotti , Claudio; Robuffo Giordano , Paolo
Pubblicato in: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Numero 4, 2018
Editore: IEEE

A Learning-based Shared Control Architecture for Interactive Task Execution

Autori: Abi-Farraj , Firas; Osa , Takayuki; Pedemonte , Nicolò; Peters , Jan; Neumann , Gerhard; Robuffo Giordano , Paolo
Pubblicato in: https://hal.inria.fr/hal-01482137, Numero 8, 2017
Editore: IEEE

Human-in-the-loop optimisation: mixed initiative grasping for optimally facilitating post-grasp manipulative actions

Autori: Ghalamzan , Amir ,; Abi-Farraj , Firas; Robuffo Giordano , Paolo; Stolkin , Rustam
Pubblicato in: IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS'17, Numero 6, 2017
Editore: IEEE

Utilizing Human Feedback in POMDP Execution and Specification

Autori: Hoelscher, J.; Koert, D.; Peters, J.; Pajarinen, J.
Pubblicato in: 2018
Editore: IEEE

Learning monocular visual odometry with dense 3D mapping from dense 3D flow

Autori: C Zhao, L Sun, P Purkait, T Duckett, R Stolkin
Pubblicato in: IEEE Int. Conf. Intelligent Robots and Systems (IROS), 2018
Editore: IEEE

Model-Free Preference-Based Reinforcement Learning

Autori: Wirth, C.; Fürnkranz, J.; Neumann G
Pubblicato in: Twenty-Ninth AAAI Conference on Artificial Intelligence (AAAI-15), 2015
Editore: AAAI

Sample and Feedback Efficient Hierarchical Reinforcement Learning from Human Preferences

Autori: Pinsler, R.; Akrour, R.; Osa, T.; Peters, J.; Neumann, G
Pubblicato in: 2018
Editore: IEEE

Single target tracking using adaptive clustered decision trees and dynamic multi-level appearance models

Autori: Jingjing Xiao, Rustam Stolkin, Ales Leonardis
Pubblicato in: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, Pagina/e 4978-4987, ISBN 978-1-4673-6964-0
Editore: IEEE
DOI: 10.1109/cvpr.2015.7299132

State-Regularized Policy Search for Linearized Dynamical Systems

Autori: Abdulsamad, H.; Arenz, O.; Peters, J.; Neumann, G
Pubblicato in: International Conference on Automated Planning and Scheduling (ICAPS), 2017
Editore: AAAI

Learning Robust Policies for Object Manipulation with Robot Swarms

Autori: Gebhardt, G.H.W.; Daun, K.; Schnaubelt, M.; Neumann, G
Pubblicato in: IEEE International Conference on Robotics and Automation, 2018
Editore: IEEE

Efficient Gradient-Free Variational Inference using Policy Search

Autori: Arenz, O.; Zhong, M.; Neumann, G
Pubblicato in: 35th International Conference on Machine Learning, 2018
Editore: IMLS

Iterative Cost Learning from Different Types of Human Feedback

Autori: Arenz, O.; Neumann, G
Pubblicato in: IROS 2016 Workshop on Human-Robot Collaboration, 2016
Editore: IEEE

Model-free and learning-free grasping by Local Contact Moment matching

Autori: M Adjigble, N Marturi, V Ortenzi, V Rajasekaran, P Corke, R Stolkin
Pubblicato in: 2018
Editore: IEEE

Peer reviewed articles (21)

Continuously Adaptive Data Fusion and Model Relearning for Particle Filter Tracking With Multiple Features

Autori: Xiao J, Stolkin R, Oussalah M, Leonardis A.
Pubblicato in: IEEE Sensors, 2016, ISSN 1530-437X
Editore: Institute of Electrical and Electronics Engineers

Guiding Trajectory Optimization by Demonstrated Distributions

Autori: Takayuki Osa, Amir M. Ghalamzan Esfahani, Rustam Stolkin, Rudolf Lioutikov, Jan Peters, and Gerhard Neumann
Pubblicato in: IEEE ROBOTICS AND AUTOMATION LETTERS, Numero 2, 2, April 2017, 2017, Pagina/e 819, ISSN 2377-3766
Editore: IEEE

Assisting Movement Training and Execution With Visual and Haptic Feedback

Autori: Marco Ewerton, David Rother, Jakob Weimar, Gerrit Kollegger, Josef Wiemeyer, Jan Peters, Guilherme Maeda
Pubblicato in: Frontiers in Neurorobotics, Numero 12, 2018, ISSN 1662-5218
Editore: Frontiers Research Foundation
DOI: 10.3389/fnbot.2018.00024

Weakly-supervised DCNN for RGB-D Object Recognition in Real-World Applications Which Lack Large-scale Annotated Training Data

Autori: Sun, Li; Zhao, Cheng; Stolkin, Rustam
Pubblicato in: IEEE Sensors, Numero 16, 2018, Pagina/e 3099, ISSN 1530-437X
Editore: Institute of Electrical and Electronics Engineers

Hierarchical Relative Entropy Policy Search

Autori: C. Daniel, Neumann, G., Kroemer, O. and Peters, J
Pubblicato in: Journal of Machine Learning, 2016, ISSN 1532-4435
Editore: MIT Press

Dynamic grasp and trajectory planning for moving objects

Autori: Naresh Marturi, Marek Kopicki, Alireza Rastegarpanah, Vijaykumar Rajasekaran, Maxime Adjigble, Rustam Stolkin, Aleš Leonardis, Yasemin Bekiroglu
Pubblicato in: Autonomous Robots, 2018, ISSN 0929-5593
Editore: Kluwer Academic Publishers
DOI: 10.1007/s10514-018-9799-1

Haptic-based shared-control methods for a dual-arm system

Autori: Selvaggio , Mario; Abi-Farraj , Firas; Pacchierotti , Claudio; Robuffo Giordano , Paolo; Siciliano , Bruno
Pubblicato in: IEEE Robotics and Automation Letters, IEEE 2018, 3 (4), pp.4249-4256, Numero 1, 2018, ISSN 2377-3766
Editore: IEEE

Design and Evaluation of a Wearable Haptic Device for Skin Stretch, Pressure, and Vibrotactile Stimuli

Autori: Marco Aggravi, Florent Pause, Paolo Robuffo Giordano, Claudio Pacchierotti
Pubblicato in: IEEE Robotics and Automation Letters, Numero 3/3, 2018, Pagina/e 2166-2173, ISSN 2377-3766
Editore: IEEE
DOI: 10.1109/LRA.2018.2810887

Passive Task-Prioritized Shared-Control with Haptic Guidance

Autori: M. Selvaggio, P. Robuffo Giordano, F. Ficuciello, and B. Siciliano
Pubblicato in: Robotics and Automation Letters, 2018, ISSN 2377-3766
Editore: IEEE

Dynamic multi-level appearance models and adaptive clustered decision trees for single target tracking

Autori: J Xiao, R Stolkin, A Leonardis
Pubblicato in: Pattern Recognition, 2017, ISSN 0031-3203
Editore: Pergamon Press

An Algorithmic Perspective on Imitation Learning

Autori: Osa, T.; Pajarinen, J.; Neumann, G.; Bagnell, J.A.; Abbeel, P.; Peters, J
Pubblicato in: Foundations and Trends in Robotics, 2018, ISSN 1935-8253
Editore: Now Publishers

Dense RGB-D semantic mapping with pixel-voxel neural network

Autori: C Zhao, L Sun, P Purkait, T Duckett, R Stolkin
Pubblicato in: Sensors, 2018, ISSN 1424-8220
Editore: Multidisciplinary Digital Publishing Institute (MDPI)

A Survey of Preference-Based Reinforcement Learning Methods

Autori: Wirth, C.; Akrour, R.; Fürnkranz, J.; Neumann G
Pubblicato in: Journal of Machine Learning Research (JMLR), 2017, ISSN 1532-4435
Editore: MIT Press

A local-global coupled-layer puppet model for robust online human pose tracking

Autori: Ma, M., Marturi, N., Li, Y., Stolkin, R., Leonardis, A
Pubblicato in: Computer Vision and Image Understanding, 2016, ISSN 1077-3142
Editore: Academic Press

Torque-Based Balancing for a Humanoid Robot Performing High-Force Interaction Tasks

Autori: F. Abi-Farraj, B. Henze, C. Ott, P. Robuffo Giordano, and M. Roa
Pubblicato in: IEEE Robotics and Automation Letters, 2018, ISSN 2377-3766
Editore: IEEE

A Haptic Shared-Control Architecture for Guided Robotic Grasping in Unknown Environments

Autori: F. Abi-Farraj, C. Pacchierotti, O. Arenz, G. Neumann, and P. Robuffo Giordano
Pubblicato in: IEEE Transactions on Haptics, 2018, ISSN 1939-1412
Editore: Institute of Electrical and Electronics Engineers

Hierarchical Reinforcement Learning of Multiple Grasping Strategies with Human Instructions

Autori: Osa, T.; Peters, J.; Neumann, G
Pubblicato in: Advanced Robotics, 2018, ISSN 1568-5535
Editore: Taylor and Francis

Region-sequence based six-stream CNN features for general and fine-grained human action recognition in videos

Autori: M Ma, N Marturi, Y Li, A Leonardis, R Stolkin
Pubblicato in: Pattern Recognition, 2018, ISSN 0031-3203
Editore: Pergamon Press

Robust Fusion of Color and Depth Data for RGB-D Target Tracking Using Adaptive Range-Invariant Depth Models and Spatio-Temporal Consistency Constraints

Autori: J Xiao, R Stolkin, Y Gao, A Leonardis
Pubblicato in: IEEE Transactions on Cybernetics, 2018, ISSN 2168-2275
Editore: IEEE

Vision-based framework to estimate robot configuration and kinematic constraints.

Autori: N. Marturi, A. Rastegarpanah, C. Takahashi, M. Kopicki, M. Talha, S. Zurek, M. Adjigble, J.A. Kuo, R. Stolkin, Y. Bekiroglu
Pubblicato in: IEEE/ASME Transactions on Mechatronics, 2018, ISSN 1083-4435
Editore: Institute of Electrical and Electronics Engineers

Hybrid motion/force control: a review

Autori: V Ortenzi, R Stolkin, J Kuo, M Mistry
Pubblicato in: Advanced Robotics, 2017, ISSN 0169-1864
Editore: Taylor & Francis

Book chapters (1)

Experiments with Hierarchical Reinforcement Learning of Multiple Grasping Policies

Autori: Takayuki Osa, Jan Peters, Gerhard Neumann
Pubblicato in: 2016 International Symposium on Experimental Robotics, Numero 1, 2017, Pagina/e 160-172, ISBN 978-3-319-50114-7
Editore: Springer International Publishing
DOI: 10.1007/978-3-319-50115-4_15