JAMES
PAPERS
PAPERS
This page lists the main scientific papers published by the project.
Note that some of the publication links on this page may be broken as we move content over from our old website.
Tuning accessibility of referring expressions in situated dialogue
Ellen Gurman Bard, Robin Hill, Mary Ellen Foster, and Manabu Arai
Language, Cognition, and Neuroscience, 29(8):928-949, doi:10.1080/23273798.2014.895845, 2014.
A Framework for 3D Object Identification and Tracking
Georgios Chliveros, Rui P. Figueiredo, Plinio Moreno, Maria Pateraki, Alexandre Bernardino, Jose Santos-Victor, and Panos Trahanias
Proceedings of the 9th International Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP2014), doi:10.5220/0004751506720677, Lisbon, Portugal, 2014.
Validating Attention Classifiers for Multi-Party Human-Robot Interaction
Mary Ellen Foster
Proceedings of the HRI 2014 Workshop on Attention Models in Robotics, Bielefeld, Germany, 2014.
Representing Uncertainty for Dynamic Multi-Party Social Human-Robot Interaction
Mary Ellen Foster
Proceedings of the Workshop of the UK Planning and Scheduling Special Interest Group (PlanSIG 2013), Edinburgh, Scotland, UK, 2014.
Task-Based Evaluation of Context-Sensitive Referring Expressions in Human-Robot Dialogue
Mary Ellen Foster, Manuel Giuliani, and Amy Isard
Language, Cognition, and Neuroscience, 29(8):1018-1034, doi:10.1080/01690965.2013.855802, 2014.
Towards Action Selection Under Uncertainty for a Socially Aware Robot Bartender
Mary Ellen Foster, Simon Keizer, and Oliver Lemon
Proceedings of the 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2014), Late-Breaking Reports, doi:10.1145/2559636.2559805, Bielefeld, Germany, 2014.
Planning for Social Interaction with Sensor Uncertainty
Mary Ellen Foster and Ronald P. A. Petrick
Proceedings of the ICAPS 2014 Scheduling and Planning Applications woRKshop (SPARK), pages 19-20, 2014.
Planning Perception and Action for Cognitive Mobile Manipulators
Andre Gaschler, Svetlana Nogina, Ronald P. A. Petrick, and Alois Knoll
Proceedings of SPIE Volume 9025 - Intelligent Robots and Computer Vision XXXI: Algorithms and Techniques, 2014.
Intuitive Robot Tasks with Augmented Reality and Virtual Obstacles
Andre Gaschler, Maximilian Springer, Markus Rickert, and Alois Knoll
IEEE International Conference on Robotics and Automation (ICRA), 2014.
Using Ellipsis Detection and Word Similarity for Transformation of Spoken Language into Grammatically Valid Sentences
Manuel Giuliani, Thomas Marschall, and Amy Isard
Proceedings of the 15th Annual SIGdial Meeting on Discourse and Dialogue (SIGDIAL 2014), Philadelphia, USA, 2014.
Handling uncertain input in multi-user human-robot interaction
Simon Keizer, Mary Ellen Foster, Andre Gaschler, Manuel Giuliani, Amy Isard, and Oliver Lemon
Proceedings of the 23rd IEEE International Symposium on Robot and Human Interactive Communication (IEEE RO-MAN 2014), Edinburgh, Scotland, UK, 2014.
Machine Learning for Social Multi-Party Human-Robot Interaction
Simon Keizer, Mary Ellen Foster, and Zhuoran Wang
ACM Transactions on Intelligent Interactive Systems, 4(3), in press.
Evaluating a social multi-user interaction model using a Nao robot
Simon Keizer, Pantelis Kastoris, Mary Ellen Foster, Amol Deshmukh, and Oliver Lemon
Proceedings of the 23rd IEEE International Symposium on Robot and Human Interactive Communication (IEEE RO-MAN 2014), Edinburgh, Scotland, UK, 2014.
Ghost-in-the-Machine: Initial Results
Sebastian Loth, Manuel Giuliani, and Jan P. de Ruiter
Proceedings of the 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2014), doi:10.1145/2559636.2563696, Bielefeld, Germany, 2014.
Application of Dynamic Distributional Clauses for Multi-hypothesis Initialization in Model-based Object Tracking
D. Nitti, G. Chliveros, M. Pateraki, L. De Raedt, E. Hourdakis, and P. Trahanias
Proceedings of the 9th International Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP2014), doi:10.5220/0004654002560261, Lisbon, Portugal, 2014.
Visual estimation of pointed targets for robot guidance via fusion of face pose and hand orientation
Maria Pateraki, Haris Baltzakis, and Panos Trahanias
Computer Vision and Image Understanding, 120:1-13, doi:10.1016/j.cviu.2013.12.006, 2014.
Extending the Knowledge-Level Approach to Planning for Social Interaction
Ronald P. A. Petrick
Proceedings of the Workshop of the UK Planning and Scheduling Special Interest Group (PlanSIG 2013), Edinburgh, Scotland, UK, 2014.
Extending Knowledge-Level Contingent Planning for Robot Task Planning
Ronald P. A. Petrick and Andre Gaschler
Proceedings of the ICAPS 2014 Workshop on Planning and Robotics (PlanRob), pages 157-165, 2014.
Robust Articulated Upper Body Pose Tracking under Severe Occlusions
Markos Sigalas, Maria Pateraki, and Panos Trahanias
Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Chicago, USA, 2014.
Designing and Evaluating a Social Gaze-Control System for a Humanoid Robot
Abolfazl Zaraki, Daniele Mazzei, Manuel Giuliani, and Danilo De Rossi
IEEE Transactions on Human-Machine Systems, 2(44):157-168, doi:10.1109/THMS.2014.2303083, 2014.
Demand Characteristics as a Tool for Evaluating the Design of Collaborative Tasks
Ed Baggs
Proceedings of the SemDial 2013 Workshop on the Semantics and Pragmatics of Dialogue (DialDam), Amsterdam, Netherlands, 2013.
A task for collaborative detection of structure in letter strings
Ed Baggs
Poster presented at the 5th Joint Action Meeting, Berlin, 2013.
Unsupervised Learning Spatio-temporal Features for Human Activity Recognition from RGB-D Video Data
Guang Chen, Feihu Zhang, Manuel Giuliani, Christian Buckl, and Alois Knoll
Proceedings of the International Conference on Social Robotics 2013 (ICSR 2013), Bristol, UK, 2013.
Robust multi-hypothesis 3D object pose tracking
Georgios Chliveros, Maria Pateraki, and Panos Trahanias
Proceedings of the 9th International Conference on Computer Vision Systems (ICVS) in Lecture Notes in Computer Science, Volume 7963, St. Petersburg, Russia, doi:10.1007/978-3-642-39402-7_24, pages 234-243, 2013.
How Can I Help You? Comparing Engagement Classification Strategies for a Robot Bartender
Mary Ellen Foster, Andre Gaschler, and Manuel Giuliani
Proceedings of the ACM International Conference on Multimodal Interaction (ICMI 2013), doi:10.1145/2522848.2522879, Sydney, Australia, 2013.
Robot Task and Motion Planning with Sets of Convex Polyhedra
Andre Gaschler, Ronald P. A. Petrick, Torsten Kröger, Oussama Khatib, and Alois Knoll
RSS 2013 Workshop on Combined Robot Motion Planning and AI Planning for Practical Applications, Berlin, Germany, 2013.
Robot Task Planning with Contingencies for Run-time Sensing
Andre Gaschler, Ronald P. A. Petrick, Torsten Kröger, Alois Knoll, and Oussama Khatib
ICRA 2013 Workshop on Combining Task and Motion Planning, Karlsruhe, Germany, 2013.
KVP: A Knowledge of Volumes Approach to Robot Task Planning
Andre Gaschler, Ronald Petrick, Manuel Giuliani, Markus Rickert, and Alois Knoll
Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2013), doi:10.1109/IROS.2013.6696354, pages 202-208, Tokyo, Japan, 2013.
Using Embodied Multimodal Fusion to Perform Supportive and Instructive Robot Roles in Human-Robot Interaction
Manuel Giuliani and Alois Knoll
In International Journal of Social Robotics, 5(3):345-356, doi:10.1007/s12369-013-0194-y, 2013.
Comparing Task-Based and Socially Intelligent Behaviour in a Robot Bartender
Manuel Giuliani, Ronald P. A. Petrick, Mary Ellen Foster, Andre Gaschler, Amy Isard, Maria Pateraki, and Markos Sigalas
Proceedings of the ACM International Conference on Multimodal Interaction (ICMI 2013), doi:10.1145/2522848.2522869, Sydney, Australia, 2013.
Evaluating a socially intelligent interactive bartender robot system
Pantelis Kastoris
MSc Thesis, School of Mathematical and Computer Sciences, Heriot-Watt University, Edinburgh, Scotland, UK, 2013.
Training and evaluation of an MDP model for social multi-user human-robot interaction
Simon Keizer, Mary Ellen Foster, Oliver Lemon, Andre Gaschler, and Manuel Giuliani
Proceedings of the 14th Annual SIGdial Meeting on Discourse and Dialogue, Metz, France, 2013.
User evaluation of a multi-user social interaction model implemented on a Nao robot
Simon Keizer, Pantelis Kastoris, Mary Ellen Foster, Amol Deshmukh, and Oliver Lemon
Proceedings of the ICSR 2013 Workshop on Robots in Public Spaces, Bristol, UK, 2013.
Automatic detection of service initiation signals used in bars
Sebastian Loth, Kerstin Huth, and Jan de Ruiter
Frontiers in Cognitive Science, 4(557), doi:10.3389/fpsyg.2013.00557, 2013.
Seeking attention: Testing a model of initiating service interactions
Sebastian Loth, Kerstin Huth, and Jan de Ruiter
Service Encounters and Cross Cultural Symposium, Seville, Spain, 2013.
Learning Knowledge-Level Domain Dynamics
Kira Mourão and Ronald P. A. Petrick
ICAPS 2013 Workshop on Planning and Learning (PAL), pages 23-31, Rome, Italy, 2013.
Visual human-robot communication in social settings
Maria Pateraki, Markos Sigalas, Georgios Chliveros, and Panos Trahanias
ICRA 2013 Workshop on Semantics, Identification and Control of Robot-Human-Environment Interaction, Karlsruhe, Germany, 2013.
Planning for Social Interaction in a Robot Bartender Domain
Ronald P. A. Petrick and Mary Ellen Foster
Proceedings of the International Conference on Automated Planning and Scheduling (ICAPS 2013), Special Track on Novel Applications, pages 389-397, Rome, Italy, 2013.
Plan-Based Social Interaction with a Robot Bartender
Ronald P. A. Petrick and Mary Ellen Foster
Proceedings of the ICAPS 2013 Application Showcase, pages 10-13, Rome, Italy, 2013.
Robust Model-based 3D Torso Pose Estimation in RGB-D sequences
Markos Sigalas, Maria Pateraki, Iason Oikonomidis, and Panos Trahanias
Proceedings of the 2nd IEEE Workshop on Dynamic Shape Capture and Analysis, held as part of ICCV 2013, doi:10.1109/ICCVW.2013.49, Sydney, Australia, 2013.
Upper body pose estimation and tracking
Markos Sigalas, Maria Pateraki, and Panos Trahanias
Demonstration Session at ICCV 2013, Sydney, Australia, 2013.
Model-based 3D Torso Pose Estimation from RGB-D data
Markos Sigalas, Maria Pateraki, and Panos Trahanias
Demonstration Session at Computer Vision Pattern Recognition (CVPR) 2013, Portland, Oregon, USA, 2013.
A Simple and Generic Belief Tracking Mechanism for the Dialog State Tracking Challenge: On the believability of observed information
Zhuoran Wang and Oliver Lemon
Proceedings of the 14th Annual SIGdial Meeting on Discourse and Dialogue, pages 423-432, Metz, France, 2013.
Social Robotics using NAO and Kinect
Arash Akbarinia, Corina Barbalata, Raquel Gil, and Eduardo Tusa
MSc project, European Masters in Computer Vision and Robotics (VIBOT), Heriot-Watt University, 2012.
Multimodal Grammar Implementation
Katya Alahverdzhieva, Dan Flickinger, and Alex Lascarides
Proceedings of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), pages 582-586, Montreal, QC, Canada, 2012.
Translation of Natural Language to Robot Commands using Combinatory Categorial Grammar
Stjepan Bakrac
Bachelor Thesis, Technische Universität München, Munich, Germany, 2012.
Visual tracking of hands, faces and facial features of multiple persons
Haris Baltzakis, Maria Pateraki, and Panos Trahanias
Machine Vision and Applications, 23(6):1141-1157, doi:10.1007/s00138-012-0409-5, 2012.
A statistical spoken dialogue system using complex user goals and value directed compression
Paul A. Crook, Zhuoran Wang, Xingkun Liu, and Oliver Lemon
13th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2012), Avignon, France, 2012.
Two People Walk Into a Bar: Dynamic Multi-Party Social Interaction with a Robot Agent
Mary Ellen Foster, Andre Gaschler, Manuel Giuliani, Amy Isard, Maria Pateraki, and Ronald P. A. Petrick
14th ACM International Conference on Multimodal Interaction (ICMI 2012), doi:10.1145/2388676.2388680, Santa Monica, USA, 2012.
Machine Learning of Social States and Skills for Multi-Party Human-Robot Interaction
Mary Ellen Foster, Simon Keizer, Zhuoran Wang and Oliver Lemon
Proceedings of the ECAI 2012 Workshop on Machine Learning for Interactive Systems (MLIS2012), Montpellier, France, 2012.
Modelling state of interaction from head poses for social human-robot interaction
Andre Gaschler, Kerstin Huth, Manuel Giuliani, Ingmar Kessler, Jan de Ruiter, and Alois Knoll
Proceedings of the Gaze in Human-Robot Interaction Workshop held at the 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2012), Boston, USA, 2012.
Social Behavior Recognition Using Body Posture and Head Pose for Human-Robot Interaction
Andre Gaschler, Sören Jentzsch, Manuel Giuliani, Kerstin Huth, Jan de Ruiter, and Alois Knoll
International Conference on Intelligent Robots and Systems (IROS 2012), 2012.
Combining Classical and Embodied Multimodal Fusion for Human-Robot Interaction
Manuel Giuliani and Jan de Ruiter
Proceedings of Embodied and Situated Language Processing (ESLP 2012), Newcastle Upon Tyne, United Kingdom, 2012.
Insights from the bar: A model of interaction
Kerstin Huth, Sebastian Loth, and Jan de Ruiter
Proceedings of Formal and Computational Approaches to Multimodal Communication, Opole, Poland, 2012.
Ordering a beer without your hands; the meaning of not gesturing
Kerstin Huth and Jan de Ruiter
Proceedings of the 5th Conference of the International Society for Gesture Studies (ISGS 5), Lund, Sweden, 2012.
Rhetorical Structure for Natural Language Generation in Dialogue
Amy Isard and Colin Matheson
Proceedings of SemDial 2012 (SeineDial): The 16th Workshop on the Semantics and Pragmatics of Dialogue, pages 161-162, 2012.
User Simulation in the Development of Statistical Spoken Dialogue Systems
Simon Keizer, Stéphane Rossignol, Senthilkumar Chandramohan, and Olivier Pietquin
In Oliver Lemon and Olivier Pietquin, editors, Data-Driven Methods for Adaptive Spoken Dialogue Systems, doi:10.1007/978-1-4614-4803-7_4, pages 39-73. Springer New York, 2012.
Intuitive Robot Programming by Trajectory Recording and Editing
Kai Klinker
Bachelor Thesis, Technische Universität München, Munich, Germany, 2012.
Analysis of Spoken Language for Human-Robot-Interaction Based on Combinatory Categorial Grammar and WordNet
Thomas Marschall
Bachelor Thesis, Technische Universität München, Munich, Germany, 2012.
Designing a restaurant assistance Robot - Involving Engagement of Multiple parties in conversation
Pratheep Paranthaman
MSc in Artificial Intelligence, School of Mathematical and Computer Science, Heriot-Watt University, Edinburgh, Scotland, United Kingdom, 2012.
Using Dempster's rule of combination to robustly estimate pointed targets
Maria Pateraki, Haris Baltzakis, and Panos Trahanias
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), St. Paul, MN, USA, 2012.
What Would You Like to Drink? Recognising and Planning with Social States in a Robot Bartender Domain
Ronald P. A. Petrick and Mary Ellen Foster
Proceedings of the International Cognitive Robotics Workshop (CogRob 2012) at AAAI 2012, pages 69-76, Toronto, ON, Canada, 2012.
Knowledge-Level Planning for Task-Based Social Interaction
Ronald P. A. Petrick and Mary Ellen Foster
Workshop of the UK Planning and Scheduling Special Interest Group (PlanSIG 2012), Middlesbrough, United Kingdom, 2012.
Social State Recognition and Knowledge-Level Planning for Human-Robot Interaction in a Bartender Domain
Ronald P. A. Petrick, Mary Ellen Foster, and Amy Isard
Proceedings of the AAAI 2012 Workshop on Grounding Language for Physical Systems, pages 32-38, Toronto, ON, Canada, 2012.
A model of intentional communication: AIRBUS (Asymmetric Intention Recognition with Bayesian Updating of Signals)
J.P. de Ruiter and Chris Cummins
Proceedings of SemDial 2012 (SeineDial): The 16th Workshop on the Semantics and Pragmatics of Dialogue, pages 149-150, 2012.
Augmented Reality-supported Robot Visualization and Development
Daniel Seidl
Master's Thesis, Technische Universität München, Munich, Germany, 2012.
Automated Planning for Natural Language Robot Dialogue
Vidya Sharma
MSc Project, School of Informatics, University of Edinburgh, Edinburgh, Scotland, United Kingdom, 2012.
Depth-based Object Recognition for Robot Grasp Planning
Sabine Thürauf
Bachelor Thesis, Technische Universität München, Munich, Germany, 2012.
A nonparametric Bayesian approach to learning multimodal interaction management
Zhuoran Wang and Oliver Lemon
Spoken Language Technology Workshop (SLT), doi:10.1109/SLT.2012.6424162, pages 1-6, 2012.
Time-Dependent Infinite POMDPs for Planning Real-World Multimodal Interactions
Zhuoran Wang and Oliver Lemon
ESSLLI Workshop on Formal and Computational Approaches to Multimodal Communication, Opole, Poland, 2012.
Calibration of a physics-based model of an anthropomimetic robot using evolution strategies
Steffen Wittmeier, Andre Gaschler, Michael Jäntsch, Konstantinos Dalamagkidis, and Alois Knoll
Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference on, pages 445-450, 2012.
An HPSG approach to synchronous speech and deixis
Katya Alahverdzhieva and Alex Lascarides
Proceedings of the 18th International Conference on Head-Driven Phase Structure Grammar (HPSG 2011), Seattle, USA, 2011.
Integration of speech and deictic gesture in a multimodal grammar
Katya Alahverdzhieva and Alex Lascarides
Proceedings of Traitement Automatique de Langues Naturelles (TALN 2011), Montpellier, France, 2011.
Lossless value directed compression of complex user goal states for statistical spoken dialogue systems
Paul A. Crook and Oliver Lemon
Proceedings of the 12th Annual Conference of the International Speech Communication Association (Interspeech 2011), Florence, Italy, 2011.
Don't look now: The relationship between mutual gaze, task performance and staring in Second Life
Sara Dalzel-Job, Jon Oberlander, and Tim J. Smith
Proceedings of the 33rd Annual Conference of the Cognitive Science Society, pages 832-837, Boston, 2011.
Visual motion capturing for kinematic model estimation of a humanoid robot
Andre Gaschler
In Rudolf Mester and Michael Felsberg, editors, Pattern Recognition, 33rd DAGM Symposium, volume 6835 of Lecture Notes in Computer Science, pages 438-443, Frankfurt, Germany, 2011.
Evaluating supportive and instructive robot roles in human-robot interaction
Manuel Giuliani and Alois Knoll
Proceedings of the International Conference on Social Robotics 2011 (ICSR 2011), Amsterdam, Netherlands, 2011.
Wie man ein bier bestellt
Kerstin Huth
MA thesis, Fakultaet fuer Linguistik und Literaturwissenschaft, Universitaet Bielefeld, Bielefeld, Germany, 2011.
"The day after the day after tomorrow?" A machine learning approach to adaptive temporal expression generation: training and evaluation with real users
Srinivasan Janarthanam, Helen Hastie, Oliver Lemon, and Xingkun Liu
Proceedings of the SIGDIAL 2011 Conference, pages 142-151, Portland, Oregon, 2011.
Kinect-enabled activity recognition of multiple human actors for a service robot
Soeren Jentzsch
Bachelor thesis, Technische Universitaet Muenchen, Germany, 2011.
Visuelle erkennung von gesicht und gesichtsorientierung fuer ein szenario der mensch-roboterinteraktion
Ingmar Kessler
Bachelor thesis, Technische Universitaet Muenchen, Germany, 2011.
An integrated approach for visual tracking of hands, faces and facial features
Maria Pateraki, Haris Baltzakis, and Panos Trahanias
Proceedings of the Workshop on Measuring and Understanding Human Movements and Emotions, held within the IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, 2011.
Visual estimation of pointed targets for robot guidance via fusion of face pose and hand orientation
Maria Pateraki, Haris Baltzakis, and Panos Trahanias
Proceedings of the IEEE Workshop on Challenges and Opportunities in Robot Perception at ICCV 2011, 2011.
Visual tracking of hands, faces and facial features as a basis for human-robot communication
Maria Pateraki, Haris Baltzakis, and Panos Trahanias
Proceedings of the Workshop on Visual Tracking and Omnidirectional Vision, held within the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), San Fransisco, USA, 2011.
An extension of knowledge-level planning to interval-valued functions
Ronald P. A. Petrick
Proceedings of the AAAI 2011 Workshop on Generalized Planning, San Francisco, USA, 2011.
Knowledge, action, and Cartesian situations in the situation calculus
Ronald P. A. Petrick
In Gerhard Lakemeyer and Sheila A. McIlraith, editors, Knowing, Reasoning, and Acting: Essays in Honour of Hector J. Levesque. College Publications, 2011.
Integrating the horizontal and vertical cultural transmission of novel communication systems
Carrie Theisen-White, Simon Kirby, and Jon Oberlander
Proceedings of the 33rd Annual Conference of the Cognitive Science Society, pages 956-961, Boston, USA, 2011.