Speech:Spring 2013 Michael Tormos Log


 * Home
 * Semesters
 * Spring 2013
 * Proposal
 * Report

Week Ending February 5th, 2013

 * Task:

Make contact with Caesar from home.

Review class logs/semester logs.


 * Results:

1/30

Assisted with moving Caesar into the server rack along with removing two burnt out fans from the server.

Produced student account (wildcat) information to be passed along to project manager for account creations.

2/1

Read logs

2/3

Made sure I was able to connect to Caesar from home.

Reviewed semester post from previous classes.

2/4 Read logs


 * Plan:

Touch base with everyone within the systems team during class this week and any other team as needed.


 * Concerns:

No concerns at this point.

Week Ending February 12, 2013

 * Task:

Develop a plan of relocating memory on severs.

Read logs during the week.


 * Results:

2/6

Looked into memory status of servers. Being formulating a plan to relocate memory on the servers. The goal is to bring all servers up to par with each other at 4Gb each. Caesar has the lowest priority during the relocation of memory is conducted since the other servers will be the work horses.

2/8

Read Logs

Worked on memory re-location plan

2/9

Read Logs

Worked on memory re-location plan

2/12

My fist attempt of re-locating the memory throughout the servers was not capable of happening due to the dual channel memory (memory sticks working in pairs). After a little research and digging I have a plan that might have a chance at working.


 * Plan:

Pitch plan to systems team members in class on 2/13. Gather feedback concerning the plan and proceed accordingly.
 * Concerns:

My proposed plan will cost a little money (around $50), so without funds the plan will not work.

Week Ending February 19, 2013

 * Task:

Draft a proposal for memory upgrade.

Continue working with team concerning the servers.


 * Results:

2/13

Worked with team in class concerning Caesar's death.

2/15

Read logs

2/16

Read logs

2/18

work on proposal for memory upgrade


 * Plan:

Touch base with team and continue on with project.
 * Concerns:

Week Ending February 26, 2013

 * Task:

Check old servers not being used for potential memory sticks.

Complete proposal for memory upgrades.
 * Results:

2/20/13

Checked old servers for memory sticks but was not able to find anything that will upgrade the servers being used currently.

2/23/13

Completed memory proposal.

As of right now the memory configurations for each server looks like this:

Our proposed upgrade will look like this:

Our plan is to purchase 6x2Gb memory sticks to be distributed throughout the servers. This upgrade will balance out all of the servers except for Caesar. Caesar is still getting an upgrade in memory but was not the priority since the other servers will be carrying the work load. Altogether this proposed upgrade will cost $48. Funding for this upgrade has already been approved and awaiting funds. Memory should be in-hand no later than 3/13/13.

Memory upgrades will be carried out on 3/13/13. Estimated downtime time for servers is expected to last for 1 - 2 hours during hardware upgrades. Upgrade process will start at 12pm. Last minute approval may be required (from project team/management) prior to server shutdowns to avoid any potential loss of data that might occur during this process if individuals are working on any servers during this time.

2/25/13

Read logs

2/26/13

Read logs


 * Plan:

Meet with class/team tomorrow. Proceed accordingly.
 * Concerns:

Week Ending March 5, 2013
Purchase server memory
 * Task:


 * Results:

2/28

Read logs

3/2

Purchased memory. Delievery of memory will be between 3/6 - 3/9.

3/4

Read logs

3/5

Restructure plan for memory install, take in consideration of spring break.


 * Plan:

Touch base with Tyler or anyone else that I need to to get approval to come in during break if need be to come in and upgrade the memory on the servers over school break.
 * Concerns:

School vacation

Week Ending March 12, 2013

 * Task:

3/6

Touch base with class and receive updates.

Testing Fedora on hot swapable hard drives on Caesar.

3/7

Received memory for servers. Correlated with team and setup a 2hr window (2pm - 4pm) to perform hardware updates on servers. Tyler and I replaced the memory to the servers bringing all servers to 4Gbs or RAM, however, Caesar was unable to boot up properly after the 1Gb upgrade that was planed so Caesar is still at 2Gbs of RAM. All servers report 3.9Gbs of memory instead of 4Gbs, this is due to the 32-bit OS on the servers. Current Memory setup:

We also changed out the old Capstone KVM switches and replaced it with the Belkin rack-mountable KVM that was not being used in the server room. This cleared up the back up the servers allowing easier access to the back of the servers. The setup of the servers to buttons on the KVM switch are as follows:

After spring break there will be labels displayed on the switch like it was on the old KVM switch.

3/9

Read logs

3/11

Read logs


 * Results:

Due to defective memory Caesar was unable to receive the planed memory upgrades, however, the rest of the system upgrades went well. We also took advantage of the time we had for the servers to be down and cleaned up the wiring in the back on the servers by swapping out KVMs.


 * Plan:

Try to find more memory for Caesar keeping in mind the bottle neck of a 32-bit OS.
 * Concerns:

None

Week Ending March 26, 2013

 * Task:

Re-asigned to new group.


 * Results:

3/22

Touched base with new group leader for further instructions after group re-asignment. Started to read up on group notes and will post more later.

3/23

Still reading through the Speech training and other notes before atempting a train. My 1st atempt at running a train will take place Sunday evening or Monday afternoon.

3/25

Finished reading through the steps and I'm just about ready to run my first train later tonight. I logged onto Miraculix to do my work. I'm currently following all the steps to run the train properly. I will post more later tonight or I will pick it up tomorrow.

Ok I'm going to stop now cause I think I erased something thinking it was a copy of a file that I created during one of the steps. I'm starting to get a couple of errors during the process which spawned me trying different methods of trying to figure out what I was doing wrong. If I can't resolve the issue by tomorrow afternoon I will erase my Exp file and start it all over. If I get the same errors tomorrow I will post error and seek additional help from my fellow students.

3/26

I am getting an error when trying to run the code below. (I am currtently trying to work through this problem. I will update later on my progress)

Sever: Verleihnix

CODE TO BE RAN

Exp/0036> /mnt/main/scripts/train/scripts_pl/make_feats.pl -ctl /mnt/main/Exp/0036/etc/0036_train.fileids

ERROR GENERATED FROM ABOVE CODE -cfg not specified, using the default ./etc/sphinx_train.cfg -param not specified, using the default ./etc/feat.params mkdir /root/speechtools: Permission denied at /mnt/main/scripts/train/scripts_pl/make_feats.pl line 103

This is Line 103 in the "make_feats.pl"

mkpath(catdir($ST::CFG_FEATFILES_DIR, $dir));

I'm not sure what is going on. It looks like I have 3 problems going on here. The 1st 2 look like theres a problem in the within the code of those files thats not correct. The last one is kindda obvious with being a permissions issue. I used Vi to get into the files to to see if I can make sense of the error and potential leads to correct the problem, however, with all my efforts and the efforts of another colleague (Nick Regan), we were not able to resolve any of these 3 issues.


 * Plan:

Touch base with group leader and seek knowledge to resolve this issue so I may proceed with running a train.
 * Concerns:

No major concers at the moment besides the everday learning curve.

Week Ending April 2, 2013
Continue following the steps to run a train.
 * Task:


 * Results:

3/27

Found out that the /mnt/main/corpus/switchboard/tiny/train is not complete/working properly. Restarted from the 1st step according to the wiki and changed my code to be /mnt/main/corpus/switchboard/mini/train. Completed all the steps up to the step before starting the train. I received a different error at the same spot I've been having the past couple of days.

Code

/mnt/main/scripts/train/scripts_pl/make_feats.pl -ctl /mnt/main/Exp/0036/etc/0036_train.fileids

ERROR

Configuration (e.g. etc/sphinx_train.cfg) not defined Compilation failed in require at /mnt/main/scripts/train/scripts_pl/make_feats.pl line 43. BEGIN failed--compilation aborted at /mnt/main/scripts/train/scripts_pl/make_feats.pl line 43.

I will reach out for additional help before the end of class to push through this step that seems to be holding me up. UPDATE: the above code was generating this error due to the code being ran in the wrong directory.

After talking to fellow colleagues I am scraping Exp 0036 as a fail and moving on and starting a new Exp (0049) to try it all over again with hopes that the error I was receiving before will not occur again.

Started the new Exp 0049 everything was going well until I reached the same spot with 0036 and the same errors.I have touched base with several people and this situation will be worked on over the weekend. I will continue trouble shooting this problem as well and will post more later on on my findings.

3/30

I read up on some logs and I'm getting ready to run thorugh the steps and try to run a /mini/eval. I was told my problem that was occuring before was fixed.

3/31

After getting help from Eirc (Beikman) on the previous problems I was having, I made the appropreate changes and startd the process of running a mini/eval.

I ran through the steps and after everything ran its course received a lot of of information the last couple lines stated the following:

Phase 7: TRANSCRIPT - Checking that all the phones in the transcript are in the phonelist, and all phones in the phonelist appear at least once Something failed: (/mnt/main/Exp/0036/scripts_pl/00.verify/verify_all.pl)

I started to read on that most trains fail their 1st time so Im not to worried about it at this point. I will pick up where I left off later. On another note, at least the error I was receiving before is no longer.

4/1

Working on Exp 0064. Stopped working on Exp 0036, 0049 and moved on.

I ran the Train and completed the all steps up to Scoring. Concerning step 2 when trying to impliment the following:

sclite -r 0064_train.trans -h hyp.trans -i swb >> scoring.log

I receive the following response: Segmentation fault


 * Plan:


 * Concerns:

Week Ending April 9, 2013

 * Task:

Meet with team members and seek help for the error that I was receiving.


 * Results:

4/3

Completed Exp 0064 with the aid and help from my fellow students. Here is the following score to Exp 0064:

'-'     | Sum/Avg |  518  11051 | 82.0   10.5    7.5    7.5   25.5   91.5 | |=================================================================|     |  Mean   |  2.7   58.2 | 81.4   11.7    6.9   11.7   30.4   93.0 | | S.D.   |  1.7   43.0 | 12.6    9.3    8.0   16.3   19.9   17.8 | | Median |  2.0   52.5 | 82.7   10.3    5.7    6.9   26.6  100.0 | '-'

The Segmentation Fault I was receiving was due to an empty file. This occurred because I missed a step when setting up the language model.

4/5

Updated The Exp folder with words that I had to add within my .dic file. Luckly I was able to retrive the words for the dictionary fairly simple since I was able to get them from someone else through the Wiki.

4/8

Worked on the words for the dictionary that the class is going to use. THe 10 words I was working on are:

FIDONET'S

GABLERS

GEOS

GLUING

GM

HM

HMOS

IBM

INDEPTH

IRS

Using the CMU dictionary I was not able to find the correct spelling for each word. I touched base with team leaders from both group B and C to help with this issue. After corlaberating with the team leaders its come to my attention that my OS on my computer has some issues and will most likely only be fixed through a fresh OS install. For some reason when I try to load my text file into the CMU website I was not getting redirected like I should have.

This is what I got from the using the CMU dictionary:

FIDONET'S F AY1 D OW0 N EH1 T H1 S EH1 S

GABLERS JH IY1 AE1 B L AH0 AA1 R EH1 S

GEOS JH IY1 IY1 AA0 S

GLUING JH IY1 L UW1 IH1 NG

GM JH IY1 EH1 M

HM EY1 CH EH1 M

HMOS EY1 CH M AO1 S

IBM AY1 B IY1 EH1 M

INDEPTH IH0 N D IY1 P IY1 T IY1 EY1 CH

IRS AY1 AA1 R EH1 S

4/9

Read up on logs.


 * Plan:


 * Concerns:

Week Ending April 16, 2013

 * Task:


 * Results:

4/12

Read up on info that Eric posted concerning this weekends assignments.

4/14

Helped out with this weekends assignments for the group. Collaborated with Eric with problems I ran into along the way. I picked up where my group members left off on Exp 0080 (step 7). I created the LM, ran the decoder, and scored the train. This is what I got when I looked at the scoring.log.

SYSTEM SUMMARY PERCENTAGES by SPEAKER

,-.     |                            hyp.trans                            | |-|     | SPKR    | # Snt # Wrd | Corr    Sub    Del    Ins    Err  S.Err | |-+-+-|     | sw4809a |    6     73 | 72.6   17.8    9.6    4.1   31.5   66.7 | |-+-+-|     | sw4809b |    2     10 | 40.0   50.0   10.0   10.0   70.0  100.0 | |=================================================================|     | Sum/Avg |    8     83 | 68.7   21.7    9.6    4.8   36.1   75.0 | |=================================================================|     |  Mean   |  4.0   41.5 | 56.3   33.9    9.8    7.1   50.8   83.3 | | S.D.   |  2.8   44.5 | 23.1   22.8    0.3    4.2   27.2   23.6 | | Median |  4.0   41.5 | 56.3   33.9    9.8    7.1   50.8   83.3 | `-'

I also step up Exp 0082 which was used with 0080. There was a problem with 0080 that I ran into and after working with Eric on the matter I followed his instructions and moved forward.

4/15

Read logs

4/16

Updated logs for the group folder on Exp 0082.


 * Plan:


 * Concerns:

Week Ending April 23, 2013

 * Task:


 * Results:


 * Plan:


 * Concerns:

Week Ending April 30, 2013

 * Task:


 * Results:

4/27

Read through the logs and catch up on the week that I missed.


 * Plan:


 * Concerns:

Week Ending May 7, 2013

 * Task:


 * Results:


 * Plan:


 * Concerns: