Speech:Exps 0303 002

Description
Author: Daniel Beitel

Date: 1-28-2018

Purpose: Build a Train, Build a Language Model, Run a Decode and Scoring

Details: The steps/commands:

Building a Train [ https://foss.unh.edu/projects/index.php/Speech:Run_Train_Setup_Script]

- SSH into Caesar, SSH into one of the drone servers (Asterix as an example), cd into class directory /mnt/main/Exp/0303, create subdirectory within class directory, and cd into it

- run makeTrain.pl switchboard 5hr/train

- run genFeats.pl -t

-run top to make sure no one else is running a train

-run nohup scripts_pl/RunAll.pl &

(Will run until module 99 and while it says it cannot create models but ignore that)

-Create a Language Model [ https://foss.unh.edu/projects/index.php/Speech:Create_LM ) ]

-In your /mnt/main/Exp/0303/yoursubdirectory, "mkdir LM" which creates the language model directory

- cd into the newly created LM directory

- run cp -i /mnt/main/corpus/switchboard/5hr/train/trans/train.trans trans_unedited

- run parseLMTrans.pl trans_unedited trans_parsed (replaced---/mnt/main/corpus/switchboard/dist/transcripts/ICSI_Transcriptions/trans/icsi/ParseTranscript.perl trans_unedited trans_parsed)

-run cp -i /mnt/main/scripts/user/lm_create.pl .

- run ./lm_create.pl trans_parsed

-cd .. back into the main experiment folder

-cd into the "etc" folder

decode [ https://foss.unh.edu/projects/index.php/Speech:Run_Decode_Trained_Data]

- run awk '{print $1}' /mnt/main/corpus/switchboard/5hr/test/trans/train.trans >>/mnt/main/Exp/0303/your_sub-experiment_folder#/etc/002_decode.fileids

-run nohup run_decode.pl 0303/your_sub-experiment_folder# 0303/your_sub-experiment# 1000 & (1000 is the default value) - the above command is what creates the decode.log in your etc folder

-run parseDecode.pl decode.log hyp.trans- (this makes the hpy.trans file) -this often results an error "rm: cannot remove '../etc         /hyp.trans' this is ok it still worked -run sclite -r experiment_folder#_train.trans -h hyp.trans -i swb >> scoring.log  this will score and the results will be in your scoring.log which is located in your etc folder

Results:

SYSTEM SUMMARY PERCENTAGES by SPEAKER

,-.     |                            hyp.trans                            | |-|     | SPKR    | # Snt # Wrd | Corr    Sub    Del    Ins    Err  S.Err | |-+-+-|     | sw2001b |    1      3 |100.0    0.0    0.0   66.7   66.7  100.0 | |-+-+-|     | sw2005a |    2     42 | 76.2   11.9   11.9    7.1   31.0  100.0 | |-+-+-|     | sw2006b |    1     29 | 69.0   20.7   10.3    3.4   34.5  100.0 | |-+-+-|     | sw2007b |    2     39 | 89.7   10.3    0.0    2.6   12.8  100.0 | |-+-+-|     | sw2007a |    1      7 | 57.1   28.6   14.3    0.0   42.9  100.0 | |-+-+-|     | sw2008b |    1      3 |100.0    0.0    0.0    0.0    0.0    0.0 | |-+-+-|     | sw2009a |    1     32 | 65.6   28.1    6.3    3.1   37.5  100.0 | |-+-+-|     | sw2009b |    1      3 |100.0    0.0    0.0    0.0    0.0    0.0 | |-+-+-|     | sw2010a |    1      5 | 40.0   60.0    0.0   20.0   80.0  100.0 | |-+-+-|     | sw2012b |    2     90 | 86.7   11.1    2.2    0.0   13.3  100.0 | |-+-+-|     | sw2013b |    1      5 | 40.0   60.0    0.0    0.0   60.0  100.0 | |-+-+-|     | sw2013a |    1     17 | 47.1   52.9    0.0   17.6   70.6  100.0 | |-+-+-|     | sw2014a |    1     21 | 76.2   19.0    4.8    9.5   33.3  100.0 | |-+-+-|     | sw2015b |    1     43 | 74.4   16.3    9.3    2.3   27.9  100.0 | |-+-+-|     | sw2017a |    1      3 |100.0    0.0    0.0   66.7   66.7  100.0 | |-+-+-|     | sw2018b |    1      3 | 66.7   33.3    0.0    0.0   33.3  100.0 | |-+-+-|     | sw2018a |    1     12 | 58.3   41.7    0.0   25.0   66.7  100.0 | |-+-+-|     | sw2019b |    1     38 | 78.9   13.2    7.9    0.0   21.1  100.0 | |-+-+-|     | sw2019a |    1      8 |100.0    0.0    0.0   12.5   12.5  100.0 | |-+-+-|     | sw2020a |    1     42 | 71.4   19.0    9.5    0.0   28.6  100.0 | |=================================================================|     | Sum/Avg |   23    445 | 76.2   18.2    5.6    4.7   28.5   91.3 | |=================================================================|     |  Mean   |  1.1   22.3 | 74.9   21.3    3.8   11.8   37.0   90.0 | | S.D.   |  0.4   22.3 | 19.9   19.7    5.0   20.2   24.2   30.8 | | Median |  1.0   14.5 | 75.3   17.7    0.0    2.8   33.3  100.0 | `-'

Successful Completion