Results & Publications - SPRING: Socially Pertinent Robots in Gerontological Healthcare

Journal & conference papers

Access and browse the list of 115 published papers (as of May 2024) through a spreadsheet here
List also available as a pdf here

Data & software

More than 50 modules released: full list as a spreadsheet here
All of our currently released modules are available here: https://gitlab.inria.fr/spring
Check Deliverables if you are looking for one specific module and interested in reusing our results

Workshops & Seminars (selection)

2020 online seminars:
1. SPRING technical seminar #1, Audio Visual Machine Perception for Human-Robot Interaction
2. SPRING Technical Seminar #2: Multi-Microphone Speech Enhancement
3. SPRING Technical Seminar #3: Conversational AI for Human-Robot Interaction: an introduction
4. SPRING Technical Seminar #4: Synchronisation and Cycle-Consistency in Computer Vision
HRI workshop, 9-10 March 2022 by PAL Robotics: https://www.hrimeetup.eu/
Workshop “AI and robotics applied to sustainable care” at HRI 2023, by PAL Robotics.
Workshop at HRI 2024 by HWU: Human – Large Language Model Interaction: The dawn of a new era or the end of it all?
Demo of SPRING to CEO of NHS Scotland by HWU, March 2024
SoRAIM Winter School, 19-23 February 2024, Grenoble, France — details on dedicated page

Public deliverables (also available as a bundle: part1, part2)

Work Package 1: Experimental Validation
D1.2 – Privacy and Ethics guidelines for experimental validation and data collection
D1.4 – User feedback from the preliminary validation (realistic environments)
D1.5 – User feedback from the intermediate validation (realistic, relevant environments)
D1.6 – User feedback from the final validation (relevant environments)
Work Package 2: Environment Mapping, Self-localisation and Simulation
D2.1 – Visual Based Localisation in Realistic Environments
D2.2 – Semantics-based localisation in realistic environments
D2.3 – Audio-visual data simulator
D2.4 – Visual-based localisation in relevant environments
D2.5 – Learning scene representations in realistic environments
D2.6 – Semantics-based localisation in relevant environments
D2.7 – Learning scene representations in relevant environments
Work Package 3: Robust Audio-visual Perception of Humans
D3.1 – Audio-visual speaker tracking in realistic environments
D3.2 – Audio Visual Speaker Detection and Tracking
D3.3 – Audio speaker diarisation and extraction with a static robot
D3.4 – Audio speaker diarisation and extraction with a moving robot
D3.5 – Audio-visual speaker separation/tracking with a static robot
D3.6 – Audio-visual speaker separation/tracking with a moving robot
Work Package 4: Multi-Modal Human Behaviour Understanding
D4.1 – Human description in realistic environments
D4.2 – Human description in relevant environments
D4.3 – Multi-modal behaviour recognition in realistic environments
D4.4 – Multi-modal behaviour recognition in relevant environments
D4.5 – Emotional and robot acceptance analysis in relevant environments
Work Package 5: Multi-User Spoken Conversations with Robots
D5.1 – Initial High-level Task Planner and Conversational System Prototype for Realistic Environments
D5.2 – Multi party ASR and conversational system
D5.3 – High-Level task planner in relevant environments
D5.4 – Multi-party conversational system in target environments
D5.5 – Report on design and evaluation of the multiuser social conversational and planning system
Work Package 6: Learning Robot Behaviour
D6.1 – Neural network architecture specification and design
D6.2 – Specifications of the generator of situated interactions
D6.3 – Robot non-verbal behaviour system in realistic environments
D6.4 – Software for generating multi-party situated interactions
D6.5 – Final neural network architectures
D6.6 – Robot non-verbal behaviour system in target environments
Work Package 7: Robot Customization and Software Integration
D7.3 – Initial software architecture for SPRING-ARI
D7.4 – Mature software architecture for SPRING-ARI
D7.5 – Complete software architecture for SPRING-ARI
Work Package 8: Dissemination, Communication and Exploitation
D8.1 – Dissemination and communication strategy
D8.3 – Mid-point report on organised scientific events & future plans
D8.5 – End-project workshop report
Work Package 9: Project Management
D9.5 – Initial Advisory Board recommendations
D9.6 – Intermediate Advisory Board Recommendations
D9.7 – Final Advisory Board recommendations for the future platform