Skip to main content

Table 18 Results of the STD ALBAYZIN 2014 evaluation on test data based on term length for specific search terms. “Term 1” is short-length, “Term 2” is medium-length, and “Term 3” is long-length. All are single-word, in-vocabulary, and in-language terms. ‘OCC’ stands for the OCC value for each given term computed with the NIST STD evaluation tool

From: Spoken term detection ALBAYZIN 2014 evaluation: overview, systems, results, and discussion

System ID

Term 1 (short)

Term 2 (medium)

Term 3 (long)

 

OCC

Precision

Recall

OCC

Precision

Recall

OCC

Precision

Recall

Fusion

0.665

0.9730

0.6667

0.738

0.8571

0.7500

0.843

0.8571

0.8571

WL-Kaldi

0.735

0.9302

0.7407

0.850

0.7778

0.8750

0.986

0.8750

1

W1B-HTK

0.480

0.9630

0.4815

0.738

0.8571

0.7500

0.843

0.8571

0.8571

WL-ATWV-Kaldi

0.331

0.9474

0.3333

0.613

0.8333

0.6250

0.843

0.8571

0.8571

WL-WER-Kaldi

0.348

0.9048

0.3519

0.487

0.8000

0.5000

0.557

0.8000

0.5714

P1B-HTK

0.165

0.9000

0.1667

0.113

0.5000

0.1250

0.000

0

0