Comparison of ALBAYZIN query-by-example spoken term detection 2012 and 2014 evaluations

EURASIP Journal on Audio, Speech, and Music Processing

Table 6 QbE STD evaluation characteristics and languages: Albanian (‘ALB’), Basque (‘BAS’), Czech (’CZE’), non-native English (‘NN-ENG’), Isixhosa (‘ISIX’), Isizulu (‘ISIZ’), Romanian (‘ROM’), Sepedi (‘SEP’), Setswana (‘SET’), and Slovak (‘SLO’)

Evaluation	Language/s	Type of	# queries	Metric
		speech	dev./test
MediaEval	English, Hindi,	Tel.	64/36	ATWV
2011	Gujarati, and Telugu
MediaEval	2011 + isiNdebele,	Tel.	164/136	ATWV
2012	Siswati, Tshivenda,
	and Xitsonga
MediaEval	ALB, BAS, CZE,	Tel. and mic.	>600/ >600	ATWV
2013	NN-ENG, ISIX,
	ISIZ, ROM,
	SEP, and SET
MediaEval	ALB, BAS,	Tel. and mic.	560/555	C _nxe
2014	CZE, NN-ENG,
	ROM, and SLO
NTCIR-11	Japanese	mic.	63/203	F-measure
2014		workshop
ALBAYZIN	Spanish	mic.	60/60	ATWV
2012		workshop
ALBAYZIN	Spanish	mic.	94/99	ATWV
2014		workshop

Tel. telephone, mic. microphone, dev. development, C _nxe normalized cross entropy cost