From: Wise teachers train better DNN acoustic models
Hidden layer
6 ×2048
5 ×512
Soft
Hard
1
2043
943
511
2
2040
731
510
3
562
512
499
4
2039
483
498
5
2042
487
–