Skip to main content

Advertisement

Table 14 System results of the ALBAYZIN 2018 QbE STD evaluation on MAVIR test data for in-language (INL) and out-of-language (foreign) (OOL) queries

From: Search on speech from spoken queries: the Multi-domain International ALBAYZIN 2018 Query-by-Example Spoken Term Detection Evaluation

  INL OOL
System ID MTWV ATWV p(FA) p(Miss) MTWV ATWV p(FA) p(Miss)
A-Hybrid DTW+LVCSR 0.2099 0.0997 0.00009 0.704 0.4918 0.4722 0.00008 0.430
B-Fusion DTW 0.2758 0.2714 0.00006 0.663 0.4836 0.4176 0.00016 0.359
C-PhonePost DTW 0.2322 0.2239 0.00003 0.740 0.4079 0.4079 0.00002 0.572
D-LVCSR 0.1454 0.1019 0.00008 0.778 0.2464 0.2268 0.00004 0.714
E-DTW 0.1458 0.1458 0.00001 0.849 0.2847 0.2847 0.00000 0.715
F-Combined DTW 0.1227 0.1165 0.00002 0.861 0.1643 0.1036 0.00016 0.679
G-Super-BNF DTW 0.1035 0.0324 0.00003 0.863 0.1554 − 0.0089 0.00006 0.786
H-Multilingual-BNF DTW 0.1298 − 0.0063 0.00005 0.817 0.2071 0.0500 0.00008 0.714
I-Monoph.-BNF DTW 0.1307 0.0848 0.00002 0.846 0.1429 0.0250 0.00000 0.857
J-Triph.-BNF DTW 0.1193 0.0658 0.00004 0.836 0.1429 0.0179 0.00000 0.857
K-Text STD 0.5647 0.5469 0.00011 0.327 0.1911 0.1071 0.00006 0.750