Speech:Exps 0014

From Openitware
Jump to: navigation, search


Title: Mini Eval Decode


Description

Author: Cedric Woodbury

Date: August 21, 2012

Purpose: Test Decode with 5 minutes of dialog using the Acoustic Model built under Experiment 0012

Details: Like Experiment 0013 this experiment uses the Acoustic Model created under Experiment 0012. The transcript used is the next 5 minutes after the 5 minutes used for Experiment 0013.

This experiment establishes a starting point for evaluating the effectiveness of the Acoustic Model.

The corpus directory used for this experiment is /mnt/main/corpus/switchboard/mini/eval/

Results

This experiment was set up in the same fashion that Experiment 0013 was and I ran into no issues. Decoding and scoring were both successful.

Summary

sclite produced the following results:

                     SYSTEM SUMMARY PERCENTAGES by SPEAKER

      ,-----------------------------------------------------------------.
      |                            hyp.trans                            |
      |-----------------------------------------------------------------|
      | SPKR    | # Snt # Wrd | Corr    Sub    Del    Ins    Err  S.Err |
      |=================================================================|
      | Sum/Avg |   40    863 | 45.5   44.5   10.0   10.1   64.5  100.0 |
      |=================================================================|
      |  Mean   |  2.7   57.5 | 46.1   44.4    9.5   14.2   68.0  100.0 |
      |  S.D.   |  1.6   34.3 | 11.7   11.7    5.5   16.4   13.9    0.0 |
      | Median  |  2.0   56.0 | 47.4   40.8    9.1   11.8   63.6  100.0 |
      `-----------------------------------------------------------------'