Speech:Exps 0303 010

Description
Author: Rose Salemi

Date: 1-30-2018

Purpose: Testing for first sub-experiment/decode

Details: After several revision by the class, I followed the guide posted on the class discussion page.


 * 1) Author: Camden Marble #####
 * 2) 15 Feb 2018           #####


 * 1) The following are the individual commands necessary to complete a Train, Language Model and Decode.
 * 2) If this is your first time looking at any of these, please use the Wiki first at foss.unh.edu


 * 1) --- Reminder commands ---#
 * 2) the 'pwd' command gives you your present working directory, basically 'where are you' in the folder structure
 * 3) the 'cd' command changes directories. 'cd foldername' goes into the folder, 'cd ..' goes backward to the parent folder


 * 1) ***** STEP ONE IF YOU ARE HAVING PROBLEMS *****#
 * 2) ***** Delete your experiment folder and remake it *****#


 * 1) --- Start a Train ---#
 * 2) Change directory to /mnt/main/Exp// [ current group number is 0303 | /mnt/main/Exp/0303 ]
 * 3) Change directory to your specific experiment number, i.e. 014  [ /mnt/main/Exp/0303/014 ]

makeTrain.pl switchboard 30hr/train
 * 1) Command 1


 * 1) Note, you will want to run a 5hr train until it works correctly

genFeats.pl -t
 * 1) Command 2

nohup scripts_pl/RunAll.pl &
 * 1) Command 3


 * 1) Note, the ampersand (&) keeps the command-line open so you can walk away and the script will keep running. If you see the command-line 'stop moving' and give you the option to type, just input a junk character and hit return; the script will say 'done' and let you go about your business.


 * 1) --- Start a Language Model ---#
 * 2) Run 'pwd' to ensure you are at your respective experiment, i.e.: [ /mnt/main/Exp/0303/014 ]
 * 3) Create a new folder under your respective experiment folder, i.e.: mkdir LM
 * 4) Change directories to the new folder, i.e.: cd LM     [ /mnt/main/Exp/0303/014/LM ]

cp -i /mnt/main/corpus/switchboard/5hr/train/trans/train.trans trans_unedited
 * 1) Command 1


 * 1) Note, change the [30hr] to whatever you ran as a Train

parseLMTrans.pl trans_unedited trans_parsed
 * 1) Command 2

cp -i /mnt/main/scripts/user/lm_create.pl.
 * 1) Command 3


 * 1) Note, include the period above, this typically means 'to open' whatever it is; but don't quote me on that.

lm_create.pl trans_parsed
 * 1) Command 4


 * 1) --- Start a Decode --- #
 * 2) Change directory, up a level to /mnt/main/Exp/0303/014 (respective to your experiment)
 * 3) Then change directory to 'etc' - Note, this is 'etc' within your experiment and not the system /etc folder.
 * 4) I.e., [ /mnt/main/Exp/0303/014/etc ]

awk '{print $1}' /mnt/main/corpus/switchboard/5hr/test/trans/train.trans >> /mnt/main/Exp/0303/010/etc/010_decode.fileids
 * 1) Command 1


 * 1) Note, be sure to change the [30hr] to your Train hours and the experiment numbers to your respective experiment.

nohup run_decode.pl 0303/010 0303/010 1000 &
 * 1) Command 2

parseDecode.pl decode.log hyp.trans  (You wil get an error saying No such file or dir, this is expected) sclite -r 010_train.trans -h hyp.trans -i swb >> scoring.log
 * 1) Command 3
 * 1) Command 4


 * 1) Note, be sure to update the 014_train.trans to your respective experiment number

Then do cat scoring.log to show the table on the screen!!!!

Results:

SYSTEM SUMMARY PERCENTAGES by SPEAKER

,-.     |                            hyp.trans                            | |-|     | SPKR    | # Snt # Wrd | Corr    Sub    Del    Ins    Err  S.Err | |-+-+-|     | sw2001b |    1      3 |100.0    0.0    0.0   66.7   66.7  100.0 | |-+-+-|     | sw2005a |    2     42 | 76.2   11.9   11.9    7.1   31.0  100.0 | |-+-+-|     | sw2006b |    1     29 | 69.0   20.7   10.3    3.4   34.5  100.0 | |-+-+-|     | sw2007b |    2     39 | 89.7   10.3    0.0    2.6   12.8  100.0 | |-+-+-|     | sw2007a |    1      7 | 57.1   28.6   14.3    0.0   42.9  100.0 | |-+-+-|     | sw2008b |    1      3 |100.0    0.0    0.0    0.0    0.0    0.0 | |-+-+-|     | sw2009a |    1     32 | 65.6   28.1    6.3    3.1   37.5  100.0 | |-+-+-|     | sw2009b |    1      3 |100.0    0.0    0.0    0.0    0.0    0.0 | |-+-+-|     | sw2010a |    1      5 | 40.0   60.0    0.0   20.0   80.0  100.0 | |-+-+-|     | sw2012b |    2     90 | 86.7   11.1    2.2    0.0   13.3  100.0 | |-+-+-|     | sw2013b |    1      5 | 40.0   60.0    0.0    0.0   60.0  100.0 | |-+-+-|     | sw2013a |    1     17 | 47.1   52.9    0.0   17.6   70.6  100.0 | |-+-+-|     | sw2014a |    1     21 | 76.2   19.0    4.8    9.5   33.3  100.0 | |-+-+-|     | sw2015b |    1     43 | 74.4   16.3    9.3    2.3   27.9  100.0 | |-+-+-|     | sw2017a |    1      3 |100.0    0.0    0.0   66.7   66.7  100.0 | |-+-+-|     | sw2018b |    1      3 | 66.7   33.3    0.0    0.0   33.3  100.0 | |-+-+-|     | sw2018a |    1     12 | 58.3   41.7    0.0   25.0   66.7  100.0 | |-+-+-|     | sw2019b |    1     38 | 78.9   13.2    7.9    0.0   21.1  100.0 | |-+-+-|     | sw2019a |    1      8 |100.0    0.0    0.0   12.5   12.5  100.0 | |-+-+-|     | sw2020a |    2     53 | 66.0   20.8   13.2   11.3   45.3  100.0 | |-+-+-|     | sw2020b |    1     45 | 55.6   37.8    6.7    6.7   51.1  100.0 | |-+-+-|     | sw2022b |    1      3 |100.0    0.0    0.0  100.0  100.0  100.0 | |-+-+-|     | sw2023a |    2     47 | 63.8   29.8    6.4   12.8   48.9  100.0 | |-+-+-|     | sw2024b |    1      7 |100.0    0.0    0.0    0.0    0.0    0.0 | |-+-+-|     | sw2024a |    1     25 | 44.0   52.0    4.0    4.0   60.0  100.0 | |-+-+-|     | sw2025b |    1      3 |100.0    0.0    0.0   33.3   33.3  100.0 | |-+-+-|     | sw2027a |    2     69 | 73.9   20.3    5.8    2.9   29.0  100.0 | |-+-+-|     | sw2028b |    1     15 | 60.0   20.0   20.0    0.0   40.0  100.0 | |-+-+-|     | sw2028a |    2     33 | 21.2   30.3   48.5    0.0   78.8  100.0 | |-+-+-|     | sw2032b |    2     30 | 96.7    3.3    0.0    0.0    3.3   50.0 | |-+-+-|     | sw2035b |    2     39 | 53.8   33.3   12.8    0.0   46.2  100.0 | |-+-+-|     | sw2036a |    1      5 | 60.0    0.0   40.0    0.0   40.0  100.0 | |-+-+-|     | sw2036b |    1     29 | 62.1   27.6   10.3    3.4   41.4  100.0 | |-+-+-|     | sw2038a |    1      8 | 87.5    0.0   12.5   12.5   25.0  100.0 | |-+-+-|     | sw2038b |    1     11 | 45.5   36.4   18.2    0.0   54.5  100.0 | |-+-+-|     | sw2039b |    1      9 | 77.8   22.2    0.0   66.7   88.9  100.0 | |-+-+-|     | sw2039a |    1     16 |100.0    0.0    0.0    0.0    0.0    0.0 | |-+-+-|     | sw2040b |    1      3 |100.0    0.0    0.0    0.0    0.0    0.0 | |-+-+-|     | sw2040a |    1      7 |100.0    0.0    0.0    0.0    0.0    0.0 | |-+-+-|     | sw2041b |    2     35 | 68.6   20.0   11.4    5.7   37.1  100.0 | |-+-+-|     | sw2044b |    2     16 | 87.5   12.5    0.0   12.5   25.0  100.0 | |-+-+-|     | sw2045b |    1      3 |100.0    0.0    0.0   33.3   33.3  100.0 | |-+-+-|     | sw2045a |    1      5 | 80.0   20.0    0.0   20.0   40.0  100.0 | |-+-+-|     | sw2050a |    2     20 | 90.0    5.0    5.0    5.0   15.0  100.0 | |-+-+-|     | sw2050b |    1     13 | 61.5   38.5    0.0   46.2   84.6  100.0 | |-+-+-|     | sw2051a |    2     40 | 65.0   30.0    5.0    0.0   35.0  100.0 | |-+-+-|     | sw2051b |    1      7 | 42.9   42.9   14.3    0.0   57.1  100.0 | |-+-+-|     | sw2053b |    2     30 | 30.0   66.7    3.3   10.0   80.0  100.0 | |-+-+-|     | sw2054b |    3     31 | 64.5   32.3    3.2   19.4   54.8  100.0 | |-+-+-|     | sw2054a |    1      4 | 50.0   50.0    0.0   25.0   75.0  100.0 | |-+-+-|     | sw2055a |    1     16 | 62.5   18.8   18.8   31.3   68.8  100.0 | |-+-+-|     | sw2056b |    1     15 | 86.7   13.3    0.0    6.7   20.0  100.0 | |-+-+-|     | sw2057a |    2     25 | 88.0   12.0    0.0   20.0   32.0  100.0 | |-+-+-|     | sw2060b |    2     16 | 75.0   25.0    0.0    6.3   31.3   50.0 | |-+-+-|     | sw2061a |    3     37 | 78.4   18.9    2.7    5.4   27.0   66.7 | |-+-+-|     | sw2061b |    1      8 | 37.5   50.0   12.5   12.5   75.0  100.0 | |-+-+-|     | sw2062b |    1     57 | 77.2   21.1    1.8    1.8   24.6  100.0 | |-+-+-|     | sw2064a |    2      6 |100.0    0.0    0.0  100.0  100.0  100.0 | |-+-+-|     | sw2064b |    1     38 | 63.2   23.7   13.2    5.3   42.1  100.0 | |-+-+-|     | sw2065a |    2     43 | 67.4   18.6   14.0    4.7   37.2  100.0 | |-+-+-|     | sw2067b |    1     15 | 73.3   20.0    6.7    6.7   33.3  100.0 | |-+-+-|     | sw2071b |    2     19 | 94.7    5.3    0.0    5.3   10.5  100.0 | |-+-+-|     | sw2072a |    1      7 | 85.7    0.0   14.3    0.0   14.3  100.0 | |-+-+-|     | sw2073b |    2      6 | 83.3   16.7    0.0    0.0   16.7   50.0 | |-+-+-|     | sw2078b |    2     12 | 75.0   25.0    0.0   41.7   66.7  100.0 | |-+-+-|     | sw2078a |    2     24 | 45.8   33.3   20.8    0.0   54.2  100.0 | |-+-+-|     | sw2079b |    1     19 | 78.9   10.5   10.5    0.0   21.1  100.0 | |-+-+-|     | sw2080a |    1      6 |100.0    0.0    0.0    0.0    0.0    0.0 | |-+-+-|     | sw2080b |    1     15 | 60.0   26.7   13.3    6.7   46.7  100.0 | |-+-+-|     | sw2082a |    1     13 | 84.6    0.0   15.4    7.7   23.1  100.0 | |-+-+-|     | sw2082b |    1     14 | 35.7   57.1    7.1    0.0   64.3  100.0 | |-+-+-|     | sw2083a |    2     25 | 60.0   16.0   24.0    4.0   44.0  100.0 | |-+-+-|     | sw2085b |    2     30 | 70.0    6.7   23.3    6.7   36.7  100.0 | |=================================================================|     | Sum/Avg |  101   1530 | 70.0   21.8    8.2    7.3   37.3   89.1 | |=================================================================|     |  Mean   |  1.4   21.0 | 72.8   20.2    6.9   12.9   40.0   87.9 | | S.D.   |  0.5   17.5 | 20.4   17.7    9.3   21.5   25.4   30.7 | | Median |  1.0   16.0 | 74.4   19.0    3.3    5.3   37.1  100.0 | `-'