EURASIP Journal on Audio, Speech, and Music Processing

Table 1 Table of possible associations between utterances and gestures (examples are excerpted)

From: Improvement of multimodal gesture and speech recognition performance using time intervals between gestures and accompanying speech

Keyword/phrase in utterance	Example utterance(s)	Possible gesture
General	‘Here’	Pointing at an angle,
demonstratives		a segment, or a vertex
Demonstratives	‘This angle’	Pointing at/tracing
for angles		an angle
Demonstratives	‘This segment’	Tracing
for segments		a segment
Demonstratives	‘This point’	Pointing at
for points		a vertex
Expressions for	’Angle ADB’	Pointing at/tracing
angles/segment		a specific angle
	‘70 degrees’

Back to article page