Skip to main content

Table 6 QbE STD evaluation characteristics and languages: Albanian (‘ALB’), Basque (‘BAS’), Czech (’CZE’), non-native English (‘NN-ENG’), Isixhosa (‘ISIX’), Isizulu (‘ISIZ’), Romanian (‘ROM’), Sepedi (‘SEP’), Setswana (‘SET’), and Slovak (‘SLO’)

From: Comparison of ALBAYZIN query-by-example spoken term detection 2012 and 2014 evaluations

Evaluation Language/s Type of # queries Metric
   speech dev./test  
MediaEval English, Hindi, Tel. 64/36 ATWV
2011 Gujarati, and Telugu    
MediaEval 2011 + isiNdebele, Tel. 164/136 ATWV
2012 Siswati, Tshivenda,    
  and Xitsonga    
MediaEval ALB, BAS, CZE, Tel. and mic. >600/ >600 ATWV
2013 NN-ENG, ISIX,    
  ISIZ, ROM,    
  SEP, and SET    
MediaEval ALB, BAS, Tel. and mic. 560/555 C nxe
2014 CZE, NN-ENG,    
  ROM, and SLO    
NTCIR-11 Japanese mic. 63/203 F-measure
2014   workshop   
ALBAYZIN Spanish mic. 60/60 ATWV
2012   workshop   
ALBAYZIN Spanish mic. 94/99 ATWV
2014   workshop   
  1. Tel. telephone, mic. microphone, dev. development, C nxe normalized cross entropy cost