Skip to main content

Advertisement

Table 22 System results of the ALBAYZIN 2018 QbE STD evaluation on COREMAH test data for in-vocabulary (INV) and out-of-vocabulary (OOV) queries

From: Search on speech from spoken queries: the Multi-domain International ALBAYZIN 2018 Query-by-Example Spoken Term Detection Evaluation

  INV OOV
System ID MTWV ATWV p(FA) p(Miss) MTWV ATWV p(FA) p(Miss)
A-Hybrid DTW+LVCSR 0.1265 − 0.0821 0.00006 0.810 0.2215 0.0383 0.00004 0.742
B-Fusion DTW 0.1953 − 1.8954 0.00000 0.805 0.2580 − 2.1382 0.00000 0.742
C-PhonePost DTW 0.1994 − 1.9037 0.00000 0.801 0.2580 − 1.9260 0.00000 0.742
D-LVCSR 0.0071 − 0.1616 0.00002 0.975 0.0000 − 0.1096 0.00000 1.000
E-DTW 0.1458 0.1458 0.00002 0.832 0.1256 0.1256 0.00007 0.801
F-Combined DTW 0.0461 − 0.0139 0.00000 0.954 0.1333 0.1333 0.00000 0.867
G-Super-BNF DTW 0.0301 − 0.4915 0.00000 0.970 0.0885 − 0.3533 0.00004 0.875
H-Multilingual-BNF DTW 0.0454 − 0.9151 0.00000 0.955 0.1000 − 0.6821 0.00000 0.900
I-Monoph.-BNF DTW 0.0440 − 0.3012 0.00002 0.938 0.1333 − 0.0897 0.00000 0.867
J-Triph.-BNF DTW 0.0519 − 0.4771 0.00000 0.944 0.1833 − 0.1205 0.00000 0.817
K-Text STD 0.1085 − 0.3436 0.00008 0.814 0.0000 − 2.5204 0.00000 1.000