Table 6 QbE STD evaluation characteristics and languages: Albanian (‘ALB’), Basque (‘BAS’), Czech (’CZE’), non-native English (‘NN-ENG’), Isixhosa (‘ISIX’), Isizulu (‘ISIZ’), Romanian (‘ROM’), Sepedi (‘SEP’), Setswana (‘SET’), and Slovak (‘SLO’)
From: Comparison of ALBAYZIN query-by-example spoken term detection 2012 and 2014 evaluations
| Evaluation | Language/s | Type of | # queries | Metric |
|---|---|---|---|---|
| speech | dev./test | |||
| MediaEval | English, Hindi, | Tel. | 64/36 | ATWV |
| 2011 | Gujarati, and Telugu | |||
| MediaEval | 2011 + isiNdebele, | Tel. | 164/136 | ATWV |
| 2012 | Siswati, Tshivenda, | |||
| and Xitsonga | ||||
| MediaEval | ALB, BAS, CZE, | Tel. and mic. | >600/ >600 | ATWV |
| 2013 | NN-ENG, ISIX, | |||
| ISIZ, ROM, | ||||
| SEP, and SET | ||||
| MediaEval | ALB, BAS, | Tel. and mic. | 560/555 | C nxe |
| 2014 | CZE, NN-ENG, | |||
| ROM, and SLO | ||||
| NTCIR-11 | Japanese | mic. | 63/203 | F-measure |
| 2014 | workshop | |||
| ALBAYZIN | Spanish | mic. | 60/60 | ATWV |
| 2012 | workshop | |||
| ALBAYZIN | Spanish | mic. | 94/99 | ATWV |
| 2014 | workshop |