Skip to main content

Advertisement

Table 15 System results of the ALBAYZIN 2018 QbE STD evaluation on RTVE test data for in-language (INL) and out-of-language (foreign) (OOL) queries

From: Search on speech from spoken queries: the Multi-domain International ALBAYZIN 2018 Query-by-Example Spoken Term Detection Evaluation

  INL OOL
System ID MTWV ATWV p(FA) p(Miss) MTWV ATWV p(FA) p(Miss)
A-Hybrid DTW+LVCSR 0.6502 0.5887 0.00008 0.268 0.5017 0.4821 0.00013 0.368
B-Fusion DTW 0.4126 0.3603 0.00004 0.549 0.5765 0.5043 0.00002 0.406
C-PhonePost DTW 0.3972 0.3175 0.00002 0.586 0.5319 0.4447 0.00000 0.464
D-LVCSR 0.5289 0.4560 0.00008 0.391 0.2155 0.1236 0.00007 0.719
E-DTW 0.0000 − 0.0126 0.00000 1.000 0.0000 − 0.0207 0.00000 1.000
F-Combined DTW 0.3193 0.3059 0.00002 0.658 0.3484 0.3058 0.00002 0.629
G-Super-BNF DTW 0.3026 0.3012 0.00003 0.665 0.3077 0.2946 0.00004 0.655
H-Multilingual-BNF DTW 0.2909 0.2841 0.00005 0.664 0.3104 0.2996 0.00013 0.555
I-Monoph.-BNF DTW 0.3179 0.3176 0.00005 0.629 0.3593 0.3519 0.00003 0.607
J-Triph.-BNF DTW 0.3123 0.2959 0.00003 0.654 0.3252 0.2968 0.00001 0.669
K-Text STD 0.7341 0.7189 0.00004 0.221 0.5924 0.4324 0.00008 0.326