docs/user-documentation/admin-tutorials.md

Admin Dashboard Configurations

This page is dedicated to Gateway Admins!

Prior to starting your configurations

You have admin access to the PGA portal, Admin Dashboard
- How to check?
  - Log in to the gateway portal
  - You would land on Admin Dashboard with “Let's Get Started!”
  - Click ‘Browse Application Modules’
  - Do you see button ‘Create new Application Interface’ ? Then you are good.
Storage resource ID is added to the pga_config.php
- If not go to
  - Admin Dashboard → Storage Resources → Browse
  - Locate your resource and copy the ID
  - Paste it in pga_config.php file in pga/app/config directory.
Credentials generated, assigned and added to authorized_keys files of resources
- To generate key refer Credential Store
- Token Assignment Gateway Management
- Copy the public key for the assigned token frm credential store and add it to authorized_keys file in both compute and storage resources.

NOTE: If you are using a hosted gateway the 2 and 4 would be taken cared by the SciGaP team.

Select Your Quick Start Tutorial

Register your Compute & Storage Resources
Gaussian Job Submission to Comet (XSEDE resource)
Running Echo on Local Machine
Add Pre and Post Job Commands for an Application
Add Environment Variables for an Application Deployment
Using Credential Store
Gateway Preference Management
Managing User Accounts
Communication with Gateway Users
Monitor Gateway Traffic
PGA Portal Admin Tutorial

Register your Compute & Storage Resources

Register Local Resource

NOTE: Only Super gateway admins can add compute resources and storage resources.
Gateway need to be hsoted locally and have access to Compute Resources → Register

What is a compute resource?
A compute resource is an object that represents a host, host cluster, or pool in a virtualization platform, a virtual data center, or an Amazon region on which machines can be provisioned.
Compute resource could come as national resources, campus resources or even private cluster.
NOTE:For testing purposes users (mainly gateway developers) this could even be the local machine.

Navigate to Admin Dashboard → Compute Resource → Register
Provide
- Host Name: Local Resource
- Host Aliases:
- IP Addresses:
- Resource Description: My local resource for application execution ( Just a description)
- Create
In Queues tab
(A queue is not required ideally, but as per the gateway logic, queue is required)
- Click ‘Add a Queue’
- Queue Name: Normal ( Per resource this is a unique value. Once created cannot edit the name. If need to change, delete and create again)
- Queue Description: Local resource normal for job submission
- Queue Max Run Time (In Minutes): (Note required for the local resource)
- Queue Max Nodes: (Note required for the local resource)
- Queue Max Processors: (Note required for the local resource)
- Max Jobs in Queue: (Note required for the local resource)
- Max Memory For Queue( In MB ): (Note required for the local resource)
File System
- Nothing to add here, this is futuristic development.
Job Submission Interface
- Click on the tab
- Add a new Job Submission Interface
- Job Submission Protocol: Local
- Select resource manager type: FORK
- Job Commands (SUBMISSION): /bin/sh
- Add Job Submission Protocol
Data Movement Interface
- Add a new Data Submission Interface
- Data Movement Protocol: Local
- Add Job Submission Protocol
  Now the Local resource is ready for job submissions.

Register a XSEDE Resource

Navigate to Admin Dashboard → Compute Resource → Register
Provide
- Host Name: comet.sdsc.edu
- Host Aliases:
- IP Addresses:
- Resource Description: SDSC Comet Cluster ( Just a description)
- Create
In Queues tab
- Click ‘Add a Queue’
- Queue 1
  - Queue Name: compute ( Per resource this is a unique value. Once created cannot edit the name. If need to change, delete and create again)
  - Queue Description: Used for access to regular compute nodes
  - Queue Max Run Time (In Minutes): 280 (Note required for the local resource)
  - Queue Max Nodes: 72 (Note required for the local resource)
  - Queue Max Processors: 1728 (Note required for the local resource)
  - Max Jobs in Queue: 0 (Note required for the local resource)
  - Max Memory For Queue( In MB ): (Note required for the local resource)
- Queue 2
  - Queue Name: shared ( Per resource this is a unique value. Once created cannot edit the name. If need to change, delete and create again)
  - Queue Description: Single-node jobs using fewer than 24 cores
  - Queue Max Run Time (In Minutes): 2880 (Note required for the local resource)
  - Queue Max Nodes: 1 (Note required for the local resource)
  - Queue Max Processors: 24 (Note required for the local resource)
  - Max Jobs in Queue: 0 (Note required for the local resource)
  - Max Memory For Queue( In MB ): (Note required for the local resource)
File System
- Nothing to add here, this is futuristic development.
Job Submission Interface
- Click on the tab
- Add a new Job Submission Interface
- Job Submission Protocol: SSH
- Select Security Protocol: SSH_KEYS
- SSH Port: 22
- Select resource manager type: SLURM
- Job Manager Bin Path: /usr/bin/
- Job Commands (SUBMISSION): sbatch
- Job Commands (JOB_MONITORING): squeue
- Job Commands (DELETION): scancel
- Parallelism Prefixes (MPI): mpiexec
- Add Job Submission Protocol
Data Movement Interface
- Add a new Data Submission Interface
- Data Movement Protocol: SCP
- Select Security Protocol: SSH_KEYS
- SSH Port: 22
- Add Data Movement Protocol
  Now the Local resource is ready for job submissions.
  Comet is ready for job submissions.

Register a Campus Resource

NOTE: Adding a campus resource is similar to adding a XSEDE resource. Same steps to follow with similar information.

Register Storage Resource

Navigate to Admin Dashboard → Storage Resource → Register
Provide
- Host Name: sg03.iu.xsede.org
- Storage Resource Description: Storage for airavata gateway
- Create
In Data Movement Interfaces tab
- Click ‘Add a new Data Movement Interface’
- Select ‘SCP’ from the list
- Select Security Protocol: SSH_KEYS
- Alternate SSH Host Name: Leave empty
- SSH Port: 22
- Add Data Movement Interface
A single storage resource is sufficient for gateway which users PGA for all job submissions.

#####Gaussian Job Submission to Comet (XSEDE resource) This is a tutorial to configuring and running an application on XSEDE resource through PGA portal.

Create new application module: Gaussian
- Navigate to Admin Dashboard → App Catalog → Application Module
- Click Create a new Application Module
- Enter Application Module Name: Gaussian
- Enter Application Module Version: Gaussian 09 (Not mandatory)
- Enter Description: Gaussian provides capabilities for electronic structure modeling
- Create
- This create the Gaussian module
Create the application interface: Gaussian
- Navigate to Admin Dashboard → App Catalog → Application Interface
- Click ‘Create new Application Interface’
- Add Application Name: Gaussian
- Add Application Description: Gaussian provides capabilities for electronic structure modeling
- Select Application Module: Gaussian ( If multiple modules are using same interface here you can add multiple modules. Ex: Gaussian 03 and Gaussian 09 modules)
- Set ‘Enable Archiving Working Directory’ to True (Why? - This is set to true when you want to bring back all the files in working directory back to PGA. Caution: If there are very large files they may not be able to SCP)
- Set ‘Enable Optional File Inputs’ to False (Why? - Set to false because there won't be any additional optional inputs for Gaussian)
- Provide application inputs
  - Click Add Application Input
  - Name: Input-File
  - Value:
  - Type: URI (Why? - This is the type for file uploads)
  - Application Arguments:
  - Standard Input: False (Why? - Futuristic property and not in real use at the moment)
  - User Friendly Description: Gaussian input file specifying desired calculation type, model chemistry, molecular system and other parameters. (This is information to the user at creating job experiment. Not mandatory)
  - Input Order: 1
  - Data is Staged: False
  - Is the Input Required: True
  - Required in Commandline: True
  - Meta Data:
- Provide application outputs NOTE: 3 application outputs to define.
  - 1st Output
    - Click Add Application Output
    - Name: Gaussian-Application-Output
    - Value: Gaussian.log
    - Type: URI
    - Application Argument:
    - Data Movement: True
    - Is the Output required?: True
    - Required on command line?: True
    - Location:
    - Search Query:
  - 2nd output
    - Click Add Application Output
    - Name: Gaussian-Standard-Out
    - Value:
    - Type: STDOUT
    - Application Argument:
    - Data Movement: False
    - Is the Output required?: True
    - Required on command line?: True
    - Location:
    - Search Query:
  - 3rd output
    - Click Add Application Output
    - Name: Gaussian-Standard-Error
    - Value:
    - Type: STDERR
    - Application Argument:
    - Data Movement: False
    - Is the Output required?: True
    - Required on command line?: True
    - Location:
    - Search Query:
Create the application deployment: Gaussian on Comet
- Navigate to Admin Dashboard → App Catalog → Application Deployment
- Click ‘Create new Application Deployment’
  - Application Module: Gaussian
  - Application Compute Host: comet.sdsc.edu (Your comet specific gateway preferences need to be added in ‘Gateway Management’ prior to this)
  - Application Executable Path: g09
  - Application Parallelism Type: SERIAL
  - Application Deployment Description: Gaussian provides capabilities for electronic structure modeling.
  - Module Load Commands: module load gaussian
  - Post Job Commands: mkdir -p “$PWD”_restart; cp *.chk ${pwd}_restart; mv .rwf ${pwd}_restart; (Why? - any command you would want to execute after post job execution)