Cluster scripts

All of the robot accounts need to have access to the HPC cluster scripts used by the HEAppE Middleware. The scripts are automatically downloaded when HEAppE Managament REST API endpoint Management/InitializeClusterScriptDirectory is called.

Bellow is a list of the description of the directories and scripts that are required to be present in the HPC cluster´s scripts repository:

Directories

Must be created under Master robot account privileges. Recommended location: cluster project directory.

  • .key_scripts directory containing the HPC cluster´s scripts used by the HEAppE Middleware, which are located in HPC cluster scripts repository. It is required for each HPC cluster system that will be using through HEAppE Middleware. (recommended location: home directory)

  • HEAppE/Executions directory for job data (created automatically)

  • HEAppE/ExecutionsTemp directory for allowing copy of job data from/to a temporary directory (created automatically)

Scripts

The bash scripts have to be located in the .key_scripts directory with specific privileges (ACLs). Master functional account is the only account with read, write, and execute permissions. The other functional accounts have assigned only read, and execute permissions. The HPC cluster scripts repository contains the following scripts:

  • create_job_directory.sh - Create a job directory in HEAppE/Executions directory

  • add_key.sh - Adding temporary SSH key for job data transfer

  • remove_key.sh - Remove temporary SSH key for job data transfer

  • remote-cmd3.sh - Security check - allowing only access to data in HEAppE/Executions directory

  • run_command.sh - Decoding allocation from BASE64 and sending to the HPC scheduler

  • generic.sh - Allowing users to run customized generic scripts

  • test.sh - Testing execution script

  • test_generic.sh - Generic testing execution script

  • copy_data_from_temp.sh - Copy job data from HEAppE/ExecutionsTemp directory to HEAppE/Executions directory

  • copy_data_to_temp.sh - Copy job data from HEAppE/Executions directory to HEAppE/ExecutionsTemp directory