Skip to main content

Table 8 Rank of hidden layer weight matrices for networks trained with soft vs. hard targets using 110 h of data

From: Wise teachers train better DNN acoustic models

Hidden layer 6 ×2048 5 ×512
  Soft Hard Soft Hard
1 2043 943 511 511
2 2040 731 511 510
3 2040 562 512 499
4 2039 483 512 498
5 2042 487