Persistent Autonomy means going beyond what has been done before. PANDORA is creating a new class of AUVs that keep going under extreme uncertainty. AUVs that respond to system faults by doing what they can. AUVs that generate their own missions when idle. AUVs that act appropriately under unexpected environmental challenges.
Humankind needs a new class of underwater vehicle to address the new challenges that deep sea exploration and mechanization create. A PANDORA AUV constantly replans, continuously questions its assumptions, and adjusts its skills to fit its immediate environment.
Leading academics are collaborating to integrate the very best in underwater vehicle design, real time planning, robust control, mapping and online skill adaptation.
Five Universities are coordinating as part of the EU FP7 program, with industrial oversight provided by BP, SubSea7 and SeaByte. Pandora will be innovating by using an agile distributed integration model. Systems will incrementally developed, tested and deployed across Europe continuously.
Pandora is a three year project with major technology demonstrations scheduled. The three tasks are:
1. Hull inspection
2. Anchor chain cleaning
3. Valve operation
These demonstrations will occur at facilities in Scotland or Spain. A critical performance metric is the infrequency of engineer intervention. These difficult tasks are currently carried out by skilled ROV operators at great expense, and are not always successful.
The month of September has seen the FP7 Pandora project, coordinated by HWU featuring in very high profile events across Europe: Brussels, Belgium : MoU (Memorandum of Understanding) Signing Event for the Robotics Public-Private Partnership,…Read more
Scientists from a leading university in Scotland are heading up a pan-European project to create the most advanced, autonomous, cognitive robot which could help to dramatically reduce the cost of underwater monitoring operations and maintenance…Read more
The AUV has been designed und build at the University of Girona (Spain) by the research group ViCOROB. The GIRONA 500 is a compact and lightweight AUV with hoovering capabilities which can fulfill the particular…Read more
Great success of the Pandora project in San Diego, California, USA for the Oceans’13 conference, 23-26 September 2013, the biggest conference in oceanic engineering.
The conference was very well attended with two exhibition halls, and several parallel technical tracks, and in-water demos at the harbour, being a unique possibility to showcase the Pandora project and its results.
Alongside the hard work, some time for an Hawaiian-style dinner at USS Midway was well deserved for the Pandora team:
From the 14th to the 21st of June, researchers from NTUA came to the University of Girona to do some tests with the Girona500 equipped with the manipulator.
Arnau Carrera (UdG), Narcís Palomeras (UdG), George Karras (NTUA) and Charalampos (Babis) Bechlioulis (NTUA) during the experiments in the UdG water tank
During this period of time, the NTUA and UdG teams worked together and redesigned the control of the manipulator, obtaining a new, more precise and smooth controller. Additionally, the water jet was installed on top of the manipulator, and the control algorithm to keep the robot stable in front of the panel was improved, so as to be used while the water jet is working and being moved using the arm.
From the 3rd to the 7th of June, members of the team at IIT came to the University of Girona to do some tests with the Girona500 equipped with a manipulator.
Arnau Carrera (UdG), Matte Leonetti (IIT) and Nawid Jamali (IIT) during the experiments in the UdG water tank
In this short space of time, the two teams worked on integrating a haptic device to teleoperate the Girona500 AUV and the manipulator. Once the integration was completed, several trials were performed to demonstrate the task. These experiments have highlighted some weak points in the first theoretical approach and provides the opportunity to improve on this work.
There was also discussion relating to the integration of the force torque sensor, and a decision was made to add a camera to the hand on the manipulator. Furthermore, some experiments involving thruster failures in the Girona500 AUV were performed.
The Department of Advanced Robotics at the Italian Institute of Technology (an English-language research institute) is seeking to appoint a well-motivated full-time postdoctoral researcher in the area of machine learning applied to robotics in general, and in particular to Autonomous Underwater Vehicles (AUV).
The successful candidate will join an ongoing research project funded by the European Commission under FP7 in the category Cognitive Systems and Robotics called “PANDORA” (Persistent Autonomy through learNing, aDaptation, Observation and ReplAnning) which started in January 2012. The project is a collaboration of five leading universities and institutes in Europe: Heriot Watt University (UK), Italian Institute of Technology (Italy), University of Girona (Spain), King’s College London (UK), and National Technical University of Athens (Greece). Details about the project can be found at: http://persistentautonomy.com/
The accepted candidate will contribute to the development and experimental validation of novel reinforcement learning and imitation learning algorithms for robot control, as well as their specific application to autonomous underwater vehicles. The research will be conducted at the Department of Advanced Robotics within the “Learning and Interaction Group” with project leader Dr. Petar Kormushev.
The research work will include conducting experiments with two different AUVs (Girona 500 and Nessie V) in water tanks in Spain and UK in collaboration with the other project partners. The developed machine learning algorithms can also be applied to other robots available at IIT, such as the compliant humanoid robot COMAN, the hydraulic quadruped robot HyQ, the humanoid robot iCub, two Barrett WAM manipulator arms, and a KUKA LWR arm robot.
International applications are encouraged. The successful candidate will be offered a fixed-term project collaboration contract for the remaining duration of the project due to end in December 2014 with a highly-competitive salary which will be commensurate with qualifications and experience. Expected starting date is as soon as possible, preferably before September 1st, 2013.
To apply please send a detailed CV, a list of publications, a statement of research interests and plans, degree certificates, grade of transcripts, the names of at least two referees, and other supporting materials such as reference letters to: Dr. Petar Kormushev (petar.kormushev(at)iit.it), quoting [PANDORA-PostDoc] in the email subject. For consideration, please apply by June 21th, 2013.
For latest updates please check here.
After the first successful tests with the ARIS sonar, the UdG team worked towards reproduction of the chain scenario of PANDORA project. A chain of 13 links and a total length of about 7 meters has been built simulating a real mooring chain.
Before the first year review of the project, we conducted some experiments inside the UdG water tank to simulate inspection of the chain by means of sonar.
Girona-500, equipped with ARIS, was manually teleoperated along the chain gathering images at a short range to generate afterwards an acoustic mosaic of high resolution.
The following video summarizes the mosaicing process of the sonar images:
The figure below shows the obtained full chain mosaic:
One of the demonstrations shown during the first year review was a visual servo control performed by Girona 500 AUV in front of a valve panel. This work has been carried out by the NTUA CSL group together with UdG. Three main algorithms work together to achieve this task: A visual detector identifies the valve panel and computes relative positions to it; an EKF-SLAM algorithm combines these updates with navigation sensor measurements to localize the vehicle while mapping the panel in the world. Finally, a control scheme navigates and stabilizes the vehicle in front of the detected target. The control scheme algorithm has been reported in a paper submitted at IROS 2013.
Pandora partners from NTUA visited HW Januarty 2013 to try their robust model based control system on Nessie VI. In addition to testing and tuning the algorithm which provides 5DOF waypoint control to the vehicle, HW took the opportunity to test newly developed sonar analysis software. The overall trial objective was to integrate independently developed systems into a coherent whole. The new sonar wall pose estimator was connected to the new NTUA control system to create a wall following behaviour.
HW has a large 20x20x7m wave tank which was used for the experiment. This facility has the nice capability of generating waves. We had hoped these waves could test the robustness of the controller under current disturbances. However, the waves energy is largely on the surface of the tank, so it is questionable as to whether this was a good test or not. Nevertheless, control and integration testing was a success, with both the NTUA and HW team managing to achieve all their goals for the 5 day period of wave tank testing.
You can see the final day of results for yourself in the video. The AUV is extremely steady when performing a wall following routine. The AUV is also able to perform rapid movements between set waypoints. In the video some ringing is observed, particularly when the AUV is commanded to do extreme pitches. Pitch is the most unstable DOF on the AUV. We hope with further tuning we might improve the control, but the aim of the experiment was about getting the software working talking within the larger system correctly rather than absolute performance.
Last month the UdG team received a new piece of equipment for the PANDORA project: the ARIS Forward-Looking Sonar (FLS). This sonar generates high-resolution acoustic images at a near-video rate, and can play a key role on those underwater inspections where the water visibility does not allow the use of optical cameras. In the chain scenario of the PANDORA project, the process of cleaning the chain is prone to generate turbidity in the water which can difficult the algorithms taking control of the cleaning process itself as well as the subsequent inspection. By using a forward-looking sonar we plan to work with acoustic images and overcome this lack of visibility.
We have worked towards the development of an algorithm for the generation of acoustic mosaics and we have done some preliminar tests with the ARIS sonar in the water tank of the UdG. Although the sonar is still not integrated to Girona-500, it has been attached to the vehicle and we have used the ARIS commercial software to gather images of several small objects placed on the bottom of the water tank. The robot was driven in a zig-zag trajectory along three different tracklines gathering around 1500 different sonar frames. The developed mosaicing algorithm was able to register successfully a high number of frames, including many loop closures, achieving the consistent mosaic shown in the figure below.
One of the problems to be addressed in the project is the detection and localisation of an underwater panel. The aim is to have the vehicle perform a valve-turning task autonomously once the location of the panel is known. Detection of the panel is performed by comparing images from the camera with a pre-defined template. A series of images of the panel are taken and the “best” image is selected for use as the template.
Valve detection is performed by first detecting the panel and making known of the rigid geometry to localise the valves with respect to the centre of the panel. To detect the orientation of the valves, a Hough transform is applied first to detect lines within a bounding box around each valve. The orientation of each valve is then obtained by searching for lines of specified minimum length within the bounding box.
The figures show the detected panel and valves highlighted with white lines at approximate distances 2m and 1m. The detection of valve orientation at large distances can be inaccurate and is only considered at short distances.
The NTUA-CSL team in collaboration with the IIT team have integrated a general identification scheme in ROS, based on AI learning techniques recently developed in IIT. Three nodes have been designed:
• /excitationG500 (implemented in Python): This node provides the appropriate system inputs that will excite the system in order to learn the unknown parameters.
• /learningMetricCalcG500 (implemented in Python): This node evaluates an estimated parameter set based on the measurements it collects from the /navigatorG500 node and the /excitationG500 node.
• /learningG500 (implemented in C++): This node implements the learning process and produces estimates of the unknown parameters based on the evaluation its gets from the /learningMetricCalcG500 node.
The whole process has been synchronized such that the /learningG500 node produces a new estimation of the unknown parameters only after it gets a feedback from the /learningMetricCalcG500 node with the metric of its previous parameter estimate. The aforementioned procedure is repeated until the learning algorithm has converged, based on certain predefined cretiria. The whole scheme is general in the sence that it can be applied to all kind of dynamical systems possessing parametric uncertainties no matter if the unknown parameters appear linearly or not, as long as we have state and input measurements.