Skip to main content

Table 14 System results of the ALBAYZIN 2018 QbE STD evaluation on MAVIR test data for in-language (INL) and out-of-language (foreign) (OOL) queries

From: Search on speech from spoken queries: the Multi-domain International ALBAYZIN 2018 Query-by-Example Spoken Term Detection Evaluation

 

INL

OOL

System ID

MTWV

ATWV

p(FA)

p(Miss)

MTWV

ATWV

p(FA)

p(Miss)

A-Hybrid DTW+LVCSR

0.2099

0.0997

0.00009

0.704

0.4918

0.4722

0.00008

0.430

B-Fusion DTW

0.2758

0.2714

0.00006

0.663

0.4836

0.4176

0.00016

0.359

C-PhonePost DTW

0.2322

0.2239

0.00003

0.740

0.4079

0.4079

0.00002

0.572

D-LVCSR

0.1454

0.1019

0.00008

0.778

0.2464

0.2268

0.00004

0.714

E-DTW

0.1458

0.1458

0.00001

0.849

0.2847

0.2847

0.00000

0.715

F-Combined DTW

0.1227

0.1165

0.00002

0.861

0.1643

0.1036

0.00016

0.679

G-Super-BNF DTW

0.1035

0.0324

0.00003

0.863

0.1554

− 0.0089

0.00006

0.786

H-Multilingual-BNF DTW

0.1298

− 0.0063

0.00005

0.817

0.2071

0.0500

0.00008

0.714

I-Monoph.-BNF DTW

0.1307

0.0848

0.00002

0.846

0.1429

0.0250

0.00000

0.857

J-Triph.-BNF DTW

0.1193

0.0658

0.00004

0.836

0.1429

0.0179

0.00000

0.857

K-Text STD

0.5647

0.5469

0.00011

0.327

0.1911

0.1071

0.00006

0.750