AVFGR – Audio Visual Feedback Gesture Recognition

The aim of the task is to classify the interlocutor’s gestures into those that are related to feedback giving in conversational interactions, and those that are other type of gestures (e.g. scratching an itchy arm). The data used is collected within the NOMCO project [1] and concerns first encounter dialogues in Finnish and Swedish languages.

Evaluation metric

In order to evaluate the performance of the methods targetting this task, the confusion matrix and the f1-score should be provided.

[1] The NOMCO project. http://sskkii.gu.se/nomco/.