Difference between revisions of "Introduction to Linux in HPC/Shell scripting"

From HPC Wiki
Introduction to Linux in HPC/Shell scripting
Jump to navigation Jump to search
m (Tweak page sorting)
 
(22 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 +
[[Category:Tutorials|Shell Scripting]]<nowiki />
 +
{{DISPLAYTITLE:Shell Scripting}}<nowiki />
 +
{{Syllabus Introduction to Linux}}<nowiki />
 
__TOC__
 
__TOC__
  
{{Infobox table
+
In this video the concept of shell scripting is introduced. Commands entered into the console can also be written into a text file to create an executable script. The tutorial will describe how to create such a script, explain its basic structure and how to execute it in the console.
| REAL-NAME    = HPC.NRW
 
| image  =  Hpc.nrw_small.png ‎
 
| Feldnamehead1 = Other HPC Courses
 
| Feldname2 = GPU      | Daten3 = Introduction to GPU Programming
 
| Feldname3 = GPROF    | Daten4 = [https://hpc-wiki.info/hpc/GPROF_Tutorial Gprof Tutorial]
 
| Feldnamehead2 = Introduction to Linux in HPC
 
| Feldname5 = 1. | Daten6 = [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/Historical_Background Historical Background]
 
| Feldname6 = 2. | Daten7 = [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/The_Command_Line The Command Line]
 
| Feldname7 = 3. | Daten8 = [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/Directory_structure Directory structure]
 
| Feldname8 = 4. | Daten9 = [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/Files Files]
 
| Feldname9 = 5. | Daten10 = [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/Text_display_search Text display search]
 
| Feldname10 = 6. | Daten11 = [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/Processes_and_permissions Processes and permissions]
 
| Feldname11 = 7. | Daten12 = [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/The_vim_text_editor The vim text editor]
 
| Feldname12 = 8. | Daten13 = [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/Shell_scripting_environment_variables Shell scripting environment variables]
 
| Feldname13 = 9. | Daten14 = [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/System_configuration_files System configuration files]
 
| Feldname14 = 10. | Daten15 = [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/Various_tips Various tips]
 
| Feldname15= 11. | Daten16 = [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/Beyond_the_cluster Beyond the cluster]
 
| Feldname16= 12. | Daten17 = [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/Linux_in_HPC Linux in HPC]
 
| Feldname17= 13. | Daten18 = [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/SSH_Login SSH Login]
 
}}
 
  
 
=== Video === <!--T:5-->
 
=== Video === <!--T:5-->
  
<youtube width="600" height="400" right>IfD9IPixgpo</youtube>
+
<youtube width="600" height="340" right>aNybqywxt9Y</youtube>
  
 +
([[Media:HPC.NRW_Introduction_to_Linux_in_HPC_09_Shell_scripts.pdf | Slides as pdf]])
  
=== Quiz === <!--T:5--> 
+
=== Quiz ===  
  
 +
{{hidden begin
 +
|title = Which command rund the executable script "test.sh" located in your home folder?
 +
}}
 +
<quiz display=simple>
 +
{
 +
|type="[]"}
 +
-  <code>~$ test.sh</code>
 +
||
 +
+  <code>~$ ./test.sh</code>
 +
|| Explanation: The <code>./</code> refers to the current directory.
 +
+  <code>~$ ~/test.sh</code>
 +
|| Explanation: The <code>~/</code> refers to the path of your home directory. This is equivalent to the full path of <code>/home/<USERNAME>/</code>.
 +
</quiz>
 +
{{hidden end}}
  
{{hidden begin  
+
{{hidden begin
 
|title = Which bash command below assigns "value" to variable var?
 
|title = Which bash command below assigns "value" to variable var?
 
}}
 
}}
Line 42: Line 40:
 
||  
 
||  
 
-  <code>var=="value"</code>
 
-  <code>var=="value"</code>
 +
||
 +
</quiz>
 +
{{hidden end}}
 +
 +
{{hidden begin
 +
|title = What do you have to add to the header of a script to make it an '''executable''' bash script?
 +
}}
 +
<quiz display=simple>
 +
{
 +
|type="()"}
 +
- <code>#BASH</code>
 +
||
 +
- <code>/bin/bash</code>
 +
||
 +
+ <code>#!/bin/bash</code>
 +
|| Explanation: This is referred to as the ''shebang''.
 +
</quiz>
 +
{{hidden end}}
 +
 +
{{hidden begin
 +
|title = How can you de-reference the second command-line argument in a script when calling <code>~$ ./test.sh arg1 arg2 arg3</code>?
 +
}}
 +
<quiz display=simple>
 +
{
 +
|type="()"}
 +
- <code>$arg2</code>
 +
||
 +
- <code>$1</code>
 +
||
 +
- <code>$arg1</code>
 +
||
 +
+ <code>$2</code>
 +
|| Explanation: Command-line arguments start to count at 0, however the 0th element is the script-name itself therefore the second argument is arg2 in this case which can be accessed/de-referenced in the script with <code>$2</code>
 +
- <code>$0</code>
 
||  
 
||  
 +
 
</quiz>
 
</quiz>
 
{{hidden end}}
 
{{hidden end}}
  
=== Exercises in Terminal (slides 115 - 116) and solution (slide 117) === <!--T:5-->   
+
=== Exercises in Terminal === <!--T:5-->   
  
  
  1. a. Write a script that
+
  1. Write a script that:
     b. Prints an environment variable
+
     a. Prints an environment variable
     c. Saves the output of the date command to a variable
+
     b. Saves the output of the '''date''' command to a variable
     d. Sleeps briefly
+
     c. Sleeps for 2 seconds
     e. Prints the new and old date and time
+
     d. Prints the new and old date and time
 
   {| role="presentation" class="wikitable mw-collapsible mw-collapsed"
 
   {| role="presentation" class="wikitable mw-collapsible mw-collapsed"
 
     | <strong>Answer:</strong>
 
     | <strong>Answer:</strong>
Line 152: Line 185:
 
     |}
 
     |}
  
  6. create an shell variable MYIDENTITY and export it as below:  
+
  6. Create an shell variable MYIDENTITY and export it as below:  
 
     <code>$ export MYIDENTITY=whoami</code>
 
     <code>$ export MYIDENTITY=whoami</code>
 
     How will you list the shell variable MYIDENTITY?
 
     How will you list the shell variable MYIDENTITY?
Line 174: Line 207:
  
  
 
+
{{Tutorial Navigation
<div style='text-align: left;float:left;width:33%;'>{{Clickable button|[https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/The_vim_text_editor Previous Page]|color=white}}</div>
+
| previous = [[Introduction_to_Linux_in_HPC/The_vim_text_editor | The vim Text Editor ]]
<div style='text-align: center;float:left;width:33%;'>{{Clickable button|[https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC Main Menu Page]|color=white}}</div>
+
| main = [[Introduction_to_Linux_in_HPC | Overview ]]
<div style='text-align: right;float:left;width:33%;'>{{Clickable button|[https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/System_configuration_files Next Page]|color=white}}</div>
+
| next = [[Introduction_to_Linux_in_HPC/Environment_variables | Environment Variables ]]
 +
}}

Latest revision as of 17:24, 4 December 2020

Tutorial
Title: Introduction to Linux in HPC
Provider: HPC.NRW

Contact: tutorials@hpc.nrw
Type: Multi-part video
Topic Area: HPC Platforms
License: CC-BY-SA
Syllabus

1. Background and History
2. The Command Line
3. Linux Directory Structure
4. Files
5. Text display and search
6. Users and permissions
7. Processes
8. The vim text editor
9. Shell scripting
10. Environment variables
11. System configuration
12. SSH Connections
13. SSH: Graphics and File Transfer
14. Various tips

In this video the concept of shell scripting is introduced. Commands entered into the console can also be written into a text file to create an executable script. The tutorial will describe how to create such a script, explain its basic structure and how to execute it in the console.

Video

( Slides as pdf)

Quiz

Which command rund the executable script "test.sh" located in your home folder?

~$ test.sh
~$ ./test.sh
~$ ~/test.sh

Which bash command below assigns "value" to variable var?

var="value"
var = "value"
var=="value"

What do you have to add to the header of a script to make it an executable bash script?

#BASH
/bin/bash
#!/bin/bash

How can you de-reference the second command-line argument in a script when calling ~$ ./test.sh arg1 arg2 arg3?

$arg2
$1
$arg1
$2
$0

Exercises in Terminal

1. Write a script that:
   a. Prints an environment variable
   b. Saves the output of the date command to a variable
   c. Sleeps for 2 seconds
   d. Prints the new and old date and time
2. Find a way to execute a script without setting execute permissions.
3. Find out how to do other programming things in bash (e.g. functions, classes). How convenient do they look?
4. Look at different ways you can define if conditions.
5. Find out what different types of quotes (single ' vs. double ") do?
6. Create an shell variable MYIDENTITY and export it as below: 
   $ export MYIDENTITY=whoami
   How will you list the shell variable MYIDENTITY?
   Execute the shell variable MYIDENTITY, what is the output? 



<< The vim Text Editor

Overview

Environment Variables >>