Speech:Exps 0251

From Openitware
Jump to: navigation, search

Contents

Mini/train(Senone:500-3000 LM:arpa)

  • test on train

SENONE: 500

TOTAL Words: 9699 Correct: 6878 Errors: 3497
TOTAL Percent correct = 70.91% Error = 36.06% Accuracy = 63.94%
TOTAL Insertions: 676 Deletions: 995 Substitutions: 1826

SENONE: 1000

TOTAL Words: 9699 Correct: 7767 Errors: 2510
TOTAL Percent correct = 80.08% Error = 25.88% Accuracy = 74.12%
TOTAL Insertions: 578 Deletions: 804 Substitutions: 1128

SENONE: 1500

TOTAL Words: 9699 Correct: 8157 Errors: 2065
TOTAL Percent correct = 84.10% Error = 21.29% Accuracy = 78.71%
TOTAL Insertions: 523 Deletions: 703 Substitutions: 839

SENONE: 2000

TOTAL Words: 9699 Correct: 8284 Errors: 1912
TOTAL Percent correct = 85.41% Error = 19.71% Accuracy = 80.29%
TOTAL Insertions: 497 Deletions: 660 Substitutions: 755

SENONE: 2500

TOTAL Words: 9699 Correct: 8221 Errors: 1927
TOTAL Percent correct = 84.76% Error = 19.87% Accuracy = 80.13%
TOTAL Insertions: 449 Deletions: 682 Substitutions: 796

SENONE: 3000

TOTAL Words: 9699 Correct: 8119 Errors: 2037
TOTAL Percent correct = 83.71% Error = 21.00% Accuracy = 79.00%
TOTAL Insertions: 457 Deletions: 782 Substitutions: 798

Mini/Train(Senone:500-300 LM:DMP)

SENONE: 500

TOTAL Words: 9699 Correct: 6859 Errors: 3546
TOTAL Percent correct = 70.72% Error = 36.56% Accuracy = 63.44%
TOTAL Insertions: 706 Deletions: 945 Substitutions: 1895

SENONE: 1000

TOTAL Words: 9699 Correct: 7797 Errors: 2500
TOTAL Percent correct = 80.39% Error = 25.78% Accuracy = 74.22%
TOTAL Insertions: 598 Deletions: 774 Substitutions: 1128

SENONE: 1500

TOTAL Words: 9699 Correct: 8154 Errors: 2049
TOTAL Percent correct = 84.07% Error = 21.13% Accuracy = 78.87%
TOTAL Insertions: 504 Deletions: 695 Substitutions: 850

SENONE: 2000

TOTAL Words: 9699 Correct: 8250 Errors: 1913
TOTAL Percent correct = 85.06% Error = 19.72% Accuracy = 80.28%
TOTAL Insertions: 464 Deletions: 702 Substitutions: 747

SENONE: 2500

TOTAL Words: 9699 Correct: 8141 Errors: 2003
TOTAL Percent correct = 83.94% Error = 20.65% Accuracy = 79.35%
TOTAL Insertions: 445 Deletions: 747 Substitutions: 811

SENONE: 3000

TOTAL Words: 9699 Correct: 7960 Errors: 2211
TOTAL Percent correct = 82.07% Error = 22.80% Accuracy = 77.20%
TOTAL Insertions: 472 Deletions: 830 Substitutions: 909

Mini/Train(Senone:1500-2500)

  • LM:arpa

SENONE: 1500

TOTAL Words: 9699 Correct: 8188 Errors: 2022
TOTAL Percent correct = 84.42% Error = 20.85% Accuracy = 79.15%
TOTAL Insertions: 511 Deletions: 689 Substitutions: 822

SENONE: 1700

TOTAL Words: 9699 Correct: 8273 Errors: 1924
TOTAL Percent correct = 85.30% Error = 19.84% Accuracy = 80.16%
TOTAL Insertions: 498 Deletions: 699 Substitutions: 727

SENONE: 1900

TOTAL Words: 9699 Correct: 8300 Errors: 1879
TOTAL Percent correct = 85.58% Error = 19.37% Accuracy = 80.63%
TOTAL Insertions: 480 Deletions: 670 Substitutions: 729

SENONE: 2100

TOTAL Words: 9699 Correct: 8307 Errors: 1866
TOTAL Percent correct = 85.65% Error = 19.24% Accuracy = 80.76%
TOTAL Insertions: 474 Deletions: 685 Substitutions: 707

SENONE: 2300

TOTAL Words: 9699 Correct: 8274 Errors: 1889
TOTAL Percent correct = 85.31% Error = 19.48% Accuracy = 80.52%
TOTAL Insertions: 464 Deletions: 700 Substitutions: 725

SENONE: 2500

TOTAL Words: 9699 Correct: 8212 Errors: 1947
TOTAL Percent correct = 84.67% Error = 20.07% Accuracy = 79.93%
TOTAL Insertions: 460 Deletions: 721 Substitutions: 766

John Kelley Experiment

Description: John Kelley
Date: 4/4/2014
Purpose: Attempting a test on mini/train using mllt
Details: Running a quick experiment, training with mllt

Results: in progress...

Description:
SENONE: 2000
Density: 8
Author: Mitchell Dezak
Date: 4/7/2014

Results in progress...


Colby Johnson

  • Test On Train
    • 100+ hrs of training data
    • 1 hour of testing data

Density 8

  • Log1:
INFO: stat.c(206): SUMMARY:  212252 fr;  6373 cdsen/fr, 120 cisen/fr, 50986 cdgau/fr, 960 cigau/fr, 1.75 xCPU 1.76 xClk [Ovhrd 0.03 xCPU  0 xClk];  6724 hmm/fr, 56 wd/fr, 0.77 xCPU 0.77 xClk;  tot: 2.54 xCPU, 2.55 xClk
  • Log2:
INFO: stat.c(206): SUMMARY:  206418 fr;  6308 cdsen/fr, 120 cisen/fr, 50468 cdgau/fr, 960 cigau/fr, 1.74 xCPU 1.74 xClk [Ovhrd 0.03 xCPU  0 xClk];  6656 hmm/fr, 58 wd/fr, 0.78 xCPU 0.78 xClk;  tot: 2.54 xCPU, 2.54 xClk
  • Results:
TOTAL Words: 10951 Correct: 8107 Errors: 4665
TOTAL Percent correct = 74.03% Error = 42.60% Accuracy = 57.40%
TOTAL Insertions: 1821 Deletions: 589 Substitutions: 2255


Denstiy 16

  • Log1:
INFO: stat.c(206): SUMMARY:  212252 fr;  6368 cdsen/fr, 120 cisen/fr, 101898 cdgau/fr, 1920 cigau/fr, 3.05 xCPU 3.05 xClk [Ovhrd 0.06 xCPU  0 xClk];  6747 hmm/fr, 53 wd/fr, 0.79 xCPU 0.79 xClk;  tot: 3.85 xCPU, 3.86 xClk
  • Log2:
INFO: stat.c(206): SUMMARY:  206418 fr;  6313 cdsen/fr, 120 cisen/fr, 101018 cdgau/fr, 1920 cigau/fr, 3.02 xCPU 3.02 xClk [Ovhrd 0.06 xCPU  0 xClk];  6684 hmm/fr, 55 wd/fr, 0.79 xCPU 0.79 xClk;  tot: 3.82 xCPU, 3.83 xClk
  • Results:
TOTAL Words: 10951 Correct: 8482 Errors: 4231
TOTAL Percent correct = 77.45% Error = 38.64% Accuracy = 61.36%
TOTAL Insertions: 1762 Deletions: 534 Substitutions: 1935


Density 32

  • Log1:
INFO: stat.c(206): SUMMARY:  212252 fr;  6202 cdsen/fr, 120 cisen/fr, 198360 cdgau/fr, 3840 cigau/fr, 5.38 xCPU 5.39 xClk [Ovhrd 0.10 xCPU  0 xClk];  6435 hmm/fr, 48 wd/fr, 0.73 xCPU 0.73 xClk;  tot: 6.13 xCPU, 6.13 xClk
  • Log2:
INFO: stat.c(206): SUMMARY:  206418 fr;  6167 cdsen/fr, 120 cisen/fr, 197240 cdgau/fr, 3840 cigau/fr, 5.40 xCPU 5.40 xClk [Ovhrd 0.10 xCPU  0 xClk];  6422 hmm/fr, 50 wd/fr, 0.75 xCPU 0.75 xClk;  tot: 6.17 xCPU, 6.17 xClk
  • Results:
TOTAL Words: 10951 Correct: 9072 Errors: 3567
TOTAL Percent correct = 82.84% Error = 32.57% Accuracy = 67.43%
TOTAL Insertions: 1688 Deletions: 453 Substitutions: 1426


Current Results

WER.PNG

Density WER-Untuned WER-Tuned
8 42.6 46.86
16 38.64 41.9
32 32.57 35.35
64 N/A 30.63

XRT.PNG

Density xRT-Untuned xRT-Tuned
8 2.54 0.93
16 3.86 1.44
32 6.13 2.34
64 N/A 4