Skip to main content

Advertisement

Table 20 System results of the ALBAYZIN 2018 QbE STD evaluation on MAVIR test data for in-vocabulary (INV) and out-of-vocabulary (OOV) queries

From: Search on speech from spoken queries: the Multi-domain International ALBAYZIN 2018 Query-by-Example Spoken Term Detection Evaluation

  INV OOV
System ID MTWV ATWV p(FA) p(Miss) MTWV ATWV p(FA) p(Miss)
A-Hybrid DTW+LVCSR 0.2529 0.1586 0.00017 0.580 0.0709 − 0.1441 0.00007 0.860
B-Fusion DTW 0.3057 0.3011 0.00006 0.636 0.2063 0.1239 0.00000 0.794
C-PhonePost DTW 0.2531 0.2439 0.00003 0.719 0.1811 0.1749 0.00003 0.784
D-LVCSR 0.1716 0.1335 0.00007 0.757 0.0680 − 0.0728 0.00002 0.909
E-DTW 0.1673 0.1673 0.00000 0.830 0.0583 0.0583 0.00002 0.918
F-Combined DTW 0.1323 0.1261 0.00004 0.827 0.0735 0.0337 0.00006 0.869
G-Super-BNF DTW 0.1122 0.0367 0.00002 0.866 0.0749 − 0.0257 0.00001 0.914
H-Multilingual-BNF DTW 0.1352 0.0074 0.00006 0.800 0.0688 − 0.0807 0.00001 0.920
I-Monoph.-BNF DTW 0.1417 0.0941 0.00002 0.835 0.0459 − 0.0228 0.00001 0.943
J-Triph.-BNF DTW 0.1308 0.0694 0.00004 0.825 0.0451 0.0094 0.00001 0.943
K-Text STD 0.5639 0.5542 0.00010 0.338 0.3582 0.2327 0.00022 0.424