Speech:Exps 0303 004

Description
Author: lamia

Date: 1-29-2018

Purpose: To create my first successful experiment This is my first experiment I did on seen data for 5hours. It took me a couple of tries to fully run a successful experiment. Below are the steps I took that created a successful experiment.

Details: Started on Idefix (tried a couple of times) but at the end successfully ran an experiment on Asterix.

First create a train:
 * 1. /mnt/main/Exp/(your class folder)/(your folder), ex. mine is /mnt/main/Exp/0303/004
 * 2. makeTrain.pl switchboard 5hr/train ** you can pick from 145hr 300hr  30hr  5hr (I suggest 5hrs for the first time, until your experiment is successful)
 * 3. genFeats.pl -t
 * 4. nohup scripts_pl/RunAll.pl &

Then create a Language Model (LM)
 * 5. /mnt/main/Exp/0303/004 /LM Note** create the LM in your Exp folder
 * 6. cp -i /mnt/main/corpus/switchboard/5hr/train/trans/train.trans trans_unedited
 * 7. parseLMTrans.pl trans_unedited trans_parsed
 * 8. cp -i /mnt/main/scripts/user/lm_create.pl.
 * 9. lm_create.pl trans_parsed

Lastly run the decode- be careful executing these lines
 * 10. awk '{print $1}' /mnt/main/corpus/switchboard/5hr/test/trans/train.trans >> /mnt/main/Exp/0303/004/etc/014_decode.fileids replace 0303/004 with your own experiment directory
 * 11. nohup run_decode.pl 0303/004 0303/004 1000 &       replace 0303/004 with your own experiment directory
 * 12. parseDecode.pl decode.log hyp.trans
 * 13. sclite -r 014_train.trans -h hyp.trans -i swb >> scoring.log Note** you MUST change the < >

This may take a couple of tries, but it will work. Every time I had a problem with my train,LM or decode I would start all over again. Starting over is not ideal but it clears your experiment folder to allow you to start from the beginning. To delete/clear my experiment folder I would either do it through FileZilla.
 * 1. If FileZilla go to the top directory (mine would be 004), right click and hit delete.
 * 2. Through command line, you need to be in the folder you want to delete the contents in (navigate to your experiment folder, mine is 004). This command will delete the contents in the folder but it will not delete the folder itself.
 * rm -rf *

In order to see that you have run this correctly you will have a scoring.c file in your /mnt/main/Exp/(class exp folder)/(your experiment folder)/etc (mine would be /mnt/main/Exp/0303/004/etc/mnt/main/Exp/0303/004/etc) directory

Results: Alignment# 1 for speaker sw2006b

Alignment# 1 for speaker sw2007b

Alignment# 1 for speaker sw2007a

Alignment# 2 for speaker sw2007b

Alignment# 1 for speaker sw2008b

Alignment# 1 for speaker sw2009a

Alignment# 1 for speaker sw2009b

Alignment# 1 for speaker sw2010a

Alignment# 1 for speaker sw2012b Alignment# 2 for speaker sw2012b

Alignment# 1 for speaker sw2013b

Alignment# 1 for speaker sw2013a

Alignment# 1 for speaker sw2014a

Alignment# 1 for speaker sw2015b

Alignment# 1 for speaker sw2017a

Alignment# 1 for speaker sw2018b

Alignment# 1 for speaker sw2018a

SYSTEM SUMMARY PERCENTAGES by SPEAKER

,-.     |                            hyp.trans                            | |-|     | SPKR    | # Snt # Wrd | Corr    Sub    Del    Ins    Err  S.Err | |-+-+-|     | sw2001b |    1      3 |100.0    0.0    0.0   66.7   66.7  100.0 | |-+-+-|     | sw2005a |    2     42 | 76.2   11.9   11.9    7.1   31.0  100.0 | |-+-+-|     | sw2006b |    1     29 | 69.0   20.7   10.3    3.4   34.5  100.0 | |-+-+-|     | sw2007b |    2     39 | 89.7   10.3    0.0    2.6   12.8  100.0 | |-+-+-|     | sw2007a |    1      7 | 57.1   28.6   14.3    0.0   42.9  100.0 | |-+-+-|     | sw2008b |    1      3 |100.0    0.0    0.0    0.0    0.0    0.0 | |-+-+-|     | sw2009a |    1     32 | 65.6   28.1    6.3    3.1   37.5  100.0 | |-+-+-|     | sw2009b |    1      3 |100.0    0.0    0.0    0.0    0.0    0.0 | |-+-+-|     | sw2010a |    1      5 | 40.0   60.0    0.0   20.0   80.0  100.0 | |-+-+-|     | sw2012b |    2     90 | 86.7   11.1    2.2    0.0   13.3  100.0 | |-+-+-|     | sw2013b |    1      5 | 40.0   60.0    0.0    0.0   60.0  100.0 | |-+-+-|     | sw2013a |    1     17 | 47.1   52.9    0.0   17.6   70.6  100.0 | |-+-+-|     | sw2014a |    1     21 | 76.2   19.0    4.8    9.5   33.3  100.0 | |-+-+-|     | sw2015b |    1     43 | 74.4   16.3    9.3    2.3   27.9  100.0 | |-+-+-|     | sw2017a |    1      3 |100.0    0.0    0.0   66.7   66.7  100.0 | |-+-+-|     | sw2018b |    1      3 | 66.7   33.3    0.0    0.0   33.3  100.0 | |-+-+-|     | sw2018a |    1     12 | 58.3   41.7    0.0   25.0   66.7  100.0 | |=================================================================|     | Sum/Avg |   20    357 | 75.9   19.0    5.0    5.6   29.7   90.0 | |=================================================================|     |  Mean   |  1.2   21.0 | 73.4   23.2    3.5   13.2   39.8   88.2 | | S.D.   |  0.4   23.2 | 20.7   20.5    5.0   21.6   25.1   33.2 | | Median |  1.0   12.0 | 74.4   19.0    0.0    3.1   34.5  100.0 | `-'

Successful Completion