I am trying to run a demo example given in the tutorial for running codes on a cluster computer. Below is the example but I am unable to understand most of the statements -
#BSUB -L /bin/bash #BSUB -J "MNIST_DDL" #BSUB -o "MNIST_DDL.%J" #BSUB -n 12 #BSUB -R "span[ptile=4]" #BSUB -gpu "num=2" #BSUB -q "normal" #BSUB -W 00:10 ml wml_anaconda3 conda activate <your environment> # Workaround for GPU selection issue cat > launch.sh << EoF_l #! /bin/sh export CUDA_VISIBLE_DEVICES=0,1 exec \$* EoF_l chmod +x launch.sh # Run the program export PAMI_IBV_ADAPTER_AFFINITY=0 ddlrun ./launch.sh python /path/to/your_program.py # Clean up /bin/rm -f launch.sh
I can understand the initial
#BSUB tagged lines, they tells about the allocation of resources and the meta-data about the code.
But I am really not able to get the following lines-
# Workaround for GPU selection issue cat > launch.sh << EoF_l #! /bin/sh export CUDA_VISIBLE_DEVICES=0,1 exec \$* EoF_l chmod +x launch.sh