Skip to main content

Table 18 Results of the STD ALBAYZIN 2014 evaluation on test data based on term length for specific search terms. “Term 1” is short-length, “Term 2” is medium-length, and “Term 3” is long-length. All are single-word, in-vocabulary, and in-language terms. ‘OCC’ stands for the OCC value for each given term computed with the NIST STD evaluation tool

From: Spoken term detection ALBAYZIN 2014 evaluation: overview, systems, results, and discussion

System ID Term 1 (short) Term 2 (medium) Term 3 (long)
  OCC Precision Recall OCC Precision Recall OCC Precision Recall
Fusion 0.665 0.9730 0.6667 0.738 0.8571 0.7500 0.843 0.8571 0.8571
WL-Kaldi 0.735 0.9302 0.7407 0.850 0.7778 0.8750 0.986 0.8750 1
W1B-HTK 0.480 0.9630 0.4815 0.738 0.8571 0.7500 0.843 0.8571 0.8571
WL-ATWV-Kaldi 0.331 0.9474 0.3333 0.613 0.8333 0.6250 0.843 0.8571 0.8571
WL-WER-Kaldi 0.348 0.9048 0.3519 0.487 0.8000 0.5000 0.557 0.8000 0.5714
P1B-HTK 0.165 0.9000 0.1667 0.113 0.5000 0.1250 0.000 0 0