POETICON Multisensory and Multimedia Recordings of Everyday Interaction

7 Last view: 2021-05-30

POETICON Multisensory and Multimedia Recordings of Everyday Interaction

View resource name in all available languages

Σώμα Πολυαισθητηριακών και Πολυμεσικών Καταγραφών Καθημερινής Διάδρασης POETICON

POETICON Recordings

http://poeticoncorpus.kyb.mpg.de/

A corpus of language use and sensorimotor experience recordings in everyday human:human interaction, in which spontaneous language communication has been recorded along with corresponding multiview video recordings, recordings of 3D full body kinematics, and 3D tracking of objects in focus. It is a twelve-hour corpus which comprises six everyday human:human interaction scenes, each one performed 3 times by 4 different English-speaking couples (interaction between a male and a female actor), each couple acting each scene in two settings: a fully naturalistic setting in which 5-camera multi-view video recordings take place, and a high-tech setting, with full body motion capture for both individuals, a 2-camera multiview video recording, and 3D tracking of focus objects. Video animations of the motoric data supplement the corpus.

View resource description in all available languages

Πρόκειται για καταγραφές διάδρασης ζευγαριών για την επίτευξη μιας καθημερινής δουλειάς στο σπίτι (π.χ. καθαρίσματος, μαγειρέματος κτλ.). Οι καταγραφές έχουν γίνει σε δύο διαφορετικά σκηνικά, που εξυπηρετούν διαφορετικές ερευνητικές ανάγκες:
(α) φυσικό σκηνικό: πρόκειται για οπτικο-ακουστικές καταγραφές με 5 κάμερες (multiview recordings) σε σκηνικό απόλυτα φυσικό
(β) σκηνικό υψηλής τεχνολογίας: πρόκειται για καταγραφή της διάδρασης με βίντεο (3 κάμερες - multiview), και παράλληλα, πλήρης καταγραφή των κινήσεων του ζευγαριού με χρήση motion suits καθώς και καταγραφή της μετακίνησης στο χώρο συγκεκριμένων αντικειμένων (object tracking).
Βίντεο και δεδομένα κίνησης είναι πλήρως συγχρονισμένα. Επίσης, έχουν παραχθεί 3D animation videos που απεικονίζουν όλες τις μετρήσεις κίνησης.
Ο πόρος αναπτύχθηκε σε συνεργασία με το Max Planck Institute of Biological Cybernetics, Tuebingen, Germany όπου έγιναν όλες οι καταγραφές.

You don’t have the permission to edit this resource.

DistributionAvailability

Available - Restricted Use

Licence

CC - BY - NC - SA

Restrictions: Academic - Non Commercial Use, Attribution, Share Alike

Download location: hidden

Distribution Access/Medium: Downloadable

Attribution Details: The creation of this resource has been funded by the European Union, Framework Programme 7, within the framework of the POETICON project (http://www.poeticon.eu).

Licensors:

Max Planck Institute for Biological Cybernetics

Distribution rights holders:

Max Planck Institute for Biological Cybernetics

Contact Person

Christian Wallraven

textnumerical corpusSize

148 Files

Modalities

Body Gesture

NGram

Type of text numerical content: motion capture data

Capture

Capturing device type details: 2 Moven motion capture suits (Xsens technologies) and 2 helmets with tracking markers (Vicon motion capture system)

Capturing device type: Other

Link to Other Media

Other media: Video

Synchronized with video: True

Media details: high tech video; synchronization between the camera videos and the kinematic recordings of both Moven and Vicon data was achieved by cutting the data according to the audio track and the start of the actions for the kinematic recordings

Link to Other Media

Other media: Video

Synchronized with video: True

Media details: animated version; synchronization between the camera videos and the kinematic recordings of both Moven and Vicon data was achieved by cutting the data according to the audio track and the start of the actions for the kinematic recordings

Link to Other Media

Other media: Video

Synchronized with video: True

Media details: low tech video; synchronization between the camera videos and the kinematic recordings of both Moven and Vicon data was achieved by cutting the data according to the audio track and the start of the actions for the kinematic recordings

Monolingual text corpusLanguages

English

Linguality

Linguality type: Monolingual

Text Format

application/pdf

Size

6 Files

Domains

everyday scenes

Classification

Text type: script

Link to Other Media

Other media: Video

Synchronized with video: False

Link to Other Media

Other media: Text Numerical

Synchronized with text: False

Monolingual audio corpusLanguages

English

Linguality

Linguality type: Monolingual

Size

12 Hours

Modalities

Spoken Language

Setting

Naturality: Semi Planned

Conversational type: Dialogue

Scenario: Role Play

Audience: No

Interactivity: Interactive

Interaction: human-human

CapturePerson SourceSet

Origin of persons: Non Native

Sex of persons: Mixed

Number of persons: 8

Age of persons: Adult

Link to Other Media

Other media: Video

Synchronized with video: True

Media details: dialogues of the video

Monolingual video corpusLanguages

English

Linguality

Linguality type: Monolingual

Size

12 Hours

Domains

everyday scenes

Modalities

Body Gesture, Combination Of Modalities, Facial Expression, Spoken Language

Classification

everydayScenes

Video genre: animatedVideo

Setting

Naturality: Semi Planned

Conversational type: Dialogue

Scenario: Role Play

Audience: No

Interactivity: Interactive

Interaction: human-human

Content

Text included: None

Content Type: animatedVideo

video/mp4

Visual modelling: 3D

CapturePerson SourceSet

Sex of persons: Mixed

Number of persons: 8

Age of persons: Adult

Creation

Creation mode details: computer animated versions of selected POETICON motion capture data (TextNumerical corpus)

Creation mode: Mixed

Link to Other Media

Other media: Video

Synchronized with video: True

Media details: original high-quality video

Link to Other Media

Other media: Text Numerical

Synchronized with text numerical: True

Media details: computer animated versions of selected POETICON motion capture data (TextNumerical corpus)

Monolingual video corpusLanguages

English

Linguality

Linguality type: Monolingual

Size

12 Hours

Domains

everyday scenes

Modalities

Body Gesture, Facial Expression, Spoken Language

Classification

everydayScenes

Video genre: videotapedEvent

Setting

Naturality: Semi Planned

Conversational type: Dialogue

Scenario: Role Play

Audience: No

Interactivity: Interactive

Interaction: human-human

Content

Text included: None

Content Type: videotapedEvent

video/mp4 Recording

Source channel: Camcorder

Capture

Capturing device type details: 2 synchronized wide-angle HD camcorders

Capturing device type: Camera, Other

Person SourceSet

Origin of persons: Non Native

Sex of persons: Mixed

Number of persons: 8

Age of persons: Adult

Link to Other Media

Other media: Video

Synchronized with video: True

Media details: synchronised with the naturalistic video (high tech version)

Link to Other Media

Other media: Text Numerical

Synchronized with text numerical: True

Media details: computer animated versions of selected POETICON motion capture data

Monolingual video corpusLanguages

English

Linguality

Linguality type: Monolingual

Size

12 Hours

Domains

everyday scenes

Modalities

Body Gesture, Facial Expression, Spoken Language

Classification

human human interaction

Video genre: videotapedEvent

Setting

Naturality: Semi Planned

Conversational type: Dialogue

Scenario: Role Play

Audience: No

Interactivity: Interactive

Content

Text included: None

Content Type: enacting of everyday scenes

video/mp4 Resolution

Size width: 1960

Size height: 1400

Recording

Recording environment: Studio

Source channel: Camcorder

Capture

Scene illumination: Fix

Capturing device type details: 5 HD camcorders (Canon HF100)

Capturing device type: Camera

Capturing details: 5-camera multi-view video recording

Person SourceSet

Origin of persons: Non Native

Sex of persons: Mixed

Number of persons: 8

Age of persons: Adult

Resource Creation

Resource Creator

Max Planck Institute for Biological Cybernetics

Institute for Language and Speech Processing

Creation lasted: 01/01/2008 - 12/31/2010

Funding Project

POETICON: The Poetics of Everyday Life: Grounding Resources and Mechanisms for Artificial Agents (POETICON - ICT-215843)

URL: http://www.poeticon.eu/

Funding Type: Eu Funds

Project duration: 01/01/2008 - 12/31/2010

Metadata

Created: 09/20/2012

Last Updated: 03/24/2014

Source: METASHARE/ILSP

Metadata Language: English, Greek, Modern (1453-) (en, el)

Metadata Creator

Penny Labropoulou

Version

Version: 1.0

Usage

Foreseen UseNlp Applications

Documentation

Samples Location: http://www.csri.gr/P...

Document Type: In Proceedings

Katerina Pastra and Christian Wallraven and Michael Schultze and Argiro Vatakis and Kathrin Kaulard, The POETICON corpus: Capturing language use and sensorimotor experience in everyday interaction, http://poeticoncorpu... , Seventh conference on International Language Resources and Evaluation" (LREC'10) , 2010

Book Title: Proceedings of the Seventh conference on International Language Resources and Evaluation" (LREC'10)

Document Language: English

Document Type: In Proceedings

Christian Wallraven and Michael Schultze and Betty Mohler and Argiro Vatakis and Katerina Pastra, The POETICON enacted scenario corpus - a tool for human and computational experiments on action understanding, http://poeticoncorpu... , The 9th IEEE Conference on Automatic Face and Gesture Recognition (FG '11) , 2011

Document Language: English

People who looked at this resource also viewed the following:

Resources from the same project

Resources from the same creators