Speech:Unix


 * Home
 * Semesters - Project Work by Semester
 * [Information]
 * System Description
 * Experiments - List of speech experiments

Project Notes

 * [Unix Notes]
 * Speech Corpus Setup - Switchboard,  NOAA
 * Speech Recognition Related Readings
 * Experiment Setup
 * Scripts Page
 * Model Building - more info on data prep,  language models, &  building models
 * Step 1: Run a Train
 * Step 2: Create the Language Model
 * Step 3: Run a Decode

Useful Unix Commands

 * To find out which hosts are on use command cat /etc/hosts
 * To find out what release version you have use command cat /etc/*-release on the machine you are currently on.

Basic Unix Commands

 * ls or dir will show you the files in the directory you are in.
 * ls -al with show all of the files in directory(even hidden files)
 * cd changes the directory you are in. Example would be cd / which will take you to the root or top directory.
 * pwd is the command that tells you where you are in the hierarchy of the system
 * whoami will tell you what profile you are using
 * man and a command opens the Linux manual pages. Man pages are useful for learning which flags (options) you can use to modify or refine a command.
 * To exit a man page, type q.
 * If you get stuck Ctrl C might work.
 * q to quit
 * ssh and computer name or IP address will secure shell you into the machine.
 * exit will close the session you are on or exit you from a machine you ssh into.
 * top displays information about who is using the machine you are in, CPU % being used and much more

Detailed Unix Commands
Hardware and System

hwinfo - extended hardware informationar hwinfo --short --wlan - hardware info hwinfo --short --gfxcard lspci - pci information ethtool - Ethernet card settings free -m - available memory ps - process status top - list processes and their usage who - usernames of whoever is currently logged in   uname -r - check kernel version ls -l /dev/disk/by-id df -h - used disk space dmidecode -t memory - memory configuration to include type and bank location

Networking

arp - check host network netstat - networking info netstat | head - summary network information netstat -rn - show routes nslookup - query name servers ping - ICMP request ip - configure a network interface route - routing information ip route - find your gateway cat /etc/resolv.conf - find your DNS servers ethtool - configure ethernet settings

File System

ls -a - lists all files, including hidden files ls -t - lists files sorted by date and time ls -l - long listing of files, with files permissions and other info ls -alt - long list of all files by date and time << useful to find out when and by whom a file that is causing problems was changed dir - list directory contents vdir - verbose directory info fdisk -l - list all disk and partitions cfdisk - partition table manipulation fscheck - file system consistency check and repair <<< only run if you suspect problems with the drives format - format disks mount cat /proc/mounts - lists mounted file systems mount caesar:/mnt/main /mnt/main - to mount shared file system from caesar wc filename - will display the number of lines, words, and bytes in a file tr ' ' '\n' < filename | sort -u | wc -w displays the number of unique words in a file (assuming they are separated by a space) tail -f filename - displays output from whatever file is currently being written to ex. tail -f decode.log Note: You may want to run the above command in a second terminal window to make sure it doesn't interfere with the current process To open a second terminal window, right-click on the toolbar at the top and choose "duplicate session"

SSH Password Override
Using SSH, log in to your account created for you on Caesar. When you log in you should be directed to your home directory.

Now that you are at the home directory for your user you want to do the following command to make an SSH key for your user.

It will prompt the questions below:
 * Leave the file name the same.
 * Leave the passphrase empty by simply pressing "Enter".

Now we want to go into the SSH folder:

You should have the following files in your .ssh folder: id_rsa and id_rsa.pub. To get the key to work so that you do not need a password on the batch machines you need to copy the .pub file to a new file called authorized_keys.

Since all the machines share the same drive then when you try to SSH into another machine you will not need a password to log into the system.

Issue 1:

 * Fedora not allowing password-less log in.


 * Possible Solution:

Check if  parameter is turned on. Fedora comes with SELinux access control and by default the parameter is turned off which prevents a use of NFS home directory.

getsebool use_nfs_home_dirs setsebool -P use_nfs_home_dirs 1 setsebool -P use_nfs_home_dirs 0
 * To check if the use_nfs_home_dirs is enabled/disabled use this command
 * To enable use_nfs_home_dirs use this command
 * To disable use_nfs_home_dirs use this command