Welcome to HPC Helper’s documentation!#
This documentation mainly summarises my experience with Sunbird and mainly Accelerate AI, a HPC node which is a part of Supercomputing Wales. One can follow this basic tutorial to understand the standard operations on any HPC cluster.
The tutorials are classified as basic, Intermediate and advanced. An official but super complicated guide is available here. So, if you consider yourself capable enough to compile LFS, then go for it.
Personal Tweaks#
By default, the .bashrc
is read-only for the $USER
and regenerates itself after the major updates. We are provided with ~/.myenv
to put all the personal tweaks such as the login directory, print a message, export environment variables etc.
Care should be taken that directly printing a message on STDOUT
will create problems with SFTP
connections, instead we can use STDERR
to print the message. Here is an example.
[s.1915438@sl1(sunbird) s.1915438]$ cat $HOME/.myenv
echo "MESSAGE : env variables loaded">&2
export VL_DIR=/scratch/s.1915438/vltesting/VirtualLab
export PATH=$PATH:/scratch/s.1915438/vltesting/VirtualLab/bin
cd /scratch/s.1915438
pwd>&2
This will echo the MESSAGE, the pwd
, create the environment variables and cd to the /scratch/s.1915438
partition each time a new TTY session is opened in a login or a compute node.
EDIT : 15th Feb 2023 : I found a disastrous thing with Python venv. So if you are using Python venv, read the life saving tutorial below.:
Life Saving Tutorials#
Basic Tutorials#
Intermediate Tutorials#
Advanced Tutorials#
Docker Tutorials#
- Docker containers
- What is a Container? What is Docker?
- Virtualisation
- Potential applications
- Docker command line
- Install using the repository
- Copy paste
- Docker is working correctly ?
- Getting help
- Docker Command Line Interface (CLI) syntax
- Running containers interactively
- Installing Ubuntu
- Summary
- Cleaning up containers
- Finding Containers on Docker Hub
- Exploring Container image versions
- Docker Hub is a repository
- Create a new Docker image
- Share your new container image on Docker hub