Admin Settings Configurations

This page is dedicated to Gateway Admins!

Prior to starting your configurations

  1. You need to have admin access to the Django portal, Settings. You need to be in ‘Admin’ role of the Admin Group.
    • How to check?
      • Log in to the gateway portal
      • You would land on Dashboard with all the applications you have access to launch jobs.
      • Click ‘Settings’ from top right drop down menu.
      • Do you see icon ‘Application Catalog’ ? In it can you create applications using ‘New Application +’?.
      • Then you are good !
  2. Credentials generated, assigned and added to authorized_keys files of resources
    • To generate key refer Credential Store
    • Token Assignment Gateway Management
    • Copy the public key for the assigned token frm credential store and add it to authorized_keys file in both compute and storage resources.

NOTE: If you are using a hosted gateway the 2 and 4 would be taken cared by the SciGaP team.

Select Your Quick Start Tutorial

  1. Register your Compute & Storage Resources
  2. Gaussian Job Submission to Comet (XSEDE resource)
  3. Running Echo on Local Machine
  4. Add Pre and Post Job Commands for an Application
  5. Add Environment Variables for an Application Deployment
  6. Using Credential Store
  7. Gateway Preference Management
  8. Managing User Accounts
  9. Communication with Gateway Users
  10. Monitor Gateway Traffic
  11. PGA Portal Admin Tutorial
Register your Compute & Storage Resources
Register Local Resource

NOTE: Only Super gateway admins can add compute resources and storage resources.
Gateway need to be hsoted locally and have access to Compute Resources → Register

What is a compute resource?
A compute resource is an object that represents a host, host cluster, or pool in a virtualization platform, a virtual data center, or an Amazon region on which machines can be provisioned.
Compute resource could come as national resources, campus resources or even private cluster.
NOTE:For testing purposes users (mainly gateway developers) this could even be the local machine.

  1. Navigate to Admin Dashboard → Compute Resource → Register
  2. Provide
    • Host Name: Local Resource
    • Host Aliases:
    • IP Addresses:
    • Resource Description: My local resource for application execution ( Just a description)
    • Create
  3. In Queues tab
    (A queue is not required ideally, but as per the gateway logic, queue is required)
    • Click ‘Add a Queue’
    • Queue Name: Normal ( Per resource this is a unique value. Once created cannot edit the name. If need to change, delete and create again)
    • Queue Description: Local resource normal for job submission
    • Queue Max Run Time (In Minutes): (Note required for the local resource)
    • Queue Max Nodes: (Note required for the local resource)
    • Queue Max Processors: (Note required for the local resource)
    • Max Jobs in Queue: (Note required for the local resource)
    • Max Memory For Queue( In MB ): (Note required for the local resource)
  4. File System
    • Nothing to add here, this is futuristic development.
  5. Job Submission Interface
    • Click on the tab
    • Add a new Job Submission Interface
    • Job Submission Protocol: Local
    • Select resource manager type: FORK
    • Job Commands (SUBMISSION): /bin/sh
    • Add Job Submission Protocol
  6. Data Movement Interface
    • Add a new Data Submission Interface
    • Data Movement Protocol: Local
    • Add Job Submission Protocol
      Now the Local resource is ready for job submissions.
Register a XSEDE Resource
  1. Navigate to Admin Dashboard → Compute Resource → Register
  2. Provide
    • Host Name: comet.sdsc.edu
    • Host Aliases:
    • IP Addresses:
    • Resource Description: SDSC Comet Cluster ( Just a description)
    • Create
  3. In Queues tab
    • Click ‘Add a Queue’
    • Queue 1
      • Queue Name: compute ( Per resource this is a unique value. Once created cannot edit the name. If need to change, delete and create again)
      • Queue Description: Used for access to regular compute nodes
      • Queue Max Run Time (In Minutes): 280 (Note required for the local resource)
      • Queue Max Nodes: 72 (Note required for the local resource)
      • Queue Max Processors: 1728 (Note required for the local resource)
      • Max Jobs in Queue: 0 (Note required for the local resource)
      • Max Memory For Queue( In MB ): (Note required for the local resource)
    • Queue 2
      • Queue Name: shared ( Per resource this is a unique value. Once created cannot edit the name. If need to change, delete and create again)
      • Queue Description: Single-node jobs using fewer than 24 cores
      • Queue Max Run Time (In Minutes): 2880 (Note required for the local resource)
      • Queue Max Nodes: 1 (Note required for the local resource)
      • Queue Max Processors: 24 (Note required for the local resource)
      • Max Jobs in Queue: 0 (Note required for the local resource)
      • Max Memory For Queue( In MB ): (Note required for the local resource)
  4. File System
    • Nothing to add here, this is futuristic development.
  5. Job Submission Interface
    • Click on the tab
    • Add a new Job Submission Interface
    • Job Submission Protocol: SSH
    • Select Security Protocol: SSH_KEYS
    • SSH Port: 22
    • Select resource manager type: SLURM
    • Job Manager Bin Path: /usr/bin/
    • Job Commands (SUBMISSION): sbatch
    • Job Commands (JOB_MONITORING): squeue
    • Job Commands (DELETION): scancel
    • Parallelism Prefixes (MPI): mpiexec
    • Add Job Submission Protocol
  6. Data Movement Interface
    • Add a new Data Submission Interface
    • Data Movement Protocol: SCP
    • Select Security Protocol: SSH_KEYS
    • SSH Port: 22
    • Add Data Movement Protocol
      Now the Local resource is ready for job submissions.
      Comet is ready for job submissions.
Register a Campus Resource

NOTE: Adding a campus resource is similar to adding a XSEDE resource. Same steps to follow with similar information.

Register Storage Resource
  1. Navigate to Admin Dashboard → Storage Resource → Register
  2. Provide
    • Host Name: sg03.iu.xsede.org
    • Storage Resource Description: Storage for airavata gateway
    • Create
  3. In Data Movement Interfaces tab
    • Click ‘Add a new Data Movement Interface’
    • Select ‘SCP’ from the list
    • Select Security Protocol: SSH_KEYS
    • Alternate SSH Host Name: Leave empty
    • SSH Port: 22
    • Add Data Movement Interface
  4. A single storage resource is sufficient for gateway which users PGA for all job submissions.

#####Gaussian Job Submission to Comet (XSEDE resource) This is a tutorial to configuring and running an application on XSEDE resource through PGA portal.

  1. Create new application module: Gaussian
    • Navigate to Admin Dashboard → App Catalog → Application Module
    • Click Create a new Application Module
    • Enter Application Module Name: Gaussian
    • Enter Application Module Version: Gaussian 09 (Not mandatory)
    • Enter Description: Gaussian provides capabilities for electronic structure modeling
    • Create
    • This create the Gaussian module Screenshot
  2. Create the application interface: Gaussian
    • Navigate to Admin Dashboard → App Catalog → Application Interface
    • Click ‘Create new Application Interface’
    • Add Application Name: Gaussian
    • Add Application Description: Gaussian provides capabilities for electronic structure modeling
    • Select Application Module: Gaussian ( If multiple modules are using same interface here you can add multiple modules. Ex: Gaussian 03 and Gaussian 09 modules)
    • Set ‘Enable Archiving Working Directory’ to True (Why? - This is set to true when you want to bring back all the files in working directory back to PGA. Caution: If there are very large files they may not be able to SCP)
    • Set ‘Enable Optional File Inputs’ to False (Why? - Set to false because there won't be any additional optional inputs for Gaussian)
    • Provide application inputs
      • Click Add Application Input
      • Name: Input-File
      • Value:
      • Type: URI (Why? - This is the type for file uploads)
      • Application Arguments:
      • Standard Input: False (Why? - Futuristic property and not in real use at the moment)
      • User Friendly Description: Gaussian input file specifying desired calculation type, model chemistry, molecular system and other parameters. (This is information to the user at creating job experiment. Not mandatory)
      • Input Order: 1
      • Data is Staged: False
      • Is the Input Required: True
      • Required in Commandline: True
      • Meta Data:
    • Provide application outputs NOTE: 3 application outputs to define.
      • 1st Output
        • Click Add Application Output
        • Name: Gaussian-Application-Output
        • Value: Gaussian.log
        • Type: URI
        • Application Argument:
        • Data Movement: True
        • Is the Output required?: True
        • Required on command line?: True
        • Location:
        • Search Query:
      • 2nd output
        • Click Add Application Output
        • Name: Gaussian-Standard-Out
        • Value:
        • Type: STDOUT
        • Application Argument:
        • Data Movement: False
        • Is the Output required?: True
        • Required on command line?: True
        • Location:
        • Search Query:
      • 3rd output
        • Click Add Application Output
        • Name: Gaussian-Standard-Error
        • Value:
        • Type: STDERR
        • Application Argument:
        • Data Movement: False
        • Is the Output required?: True
        • Required on command line?: True
        • Location:
        • Search Query: Screenshot Screenshot Screenshot
  3. Create the application deployment: Gaussian on Comet
    • Navigate to Admin Dashboard → App Catalog → Application Deployment
    • Click ‘Create new Application Deployment’
      • Application Module: Gaussian
      • Application Compute Host: comet.sdsc.edu (Your comet specific gateway preferences need to be added in ‘Gateway Management’ prior to this)
      • Application Executable Path: g09
      • Application Parallelism Type: SERIAL
      • Application Deployment Description: Gaussian provides capabilities for electronic structure modeling.
      • Module Load Commands: module load gaussian
      • Post Job Commands: mkdir -p “$PWD”_restart; cp *.chk ${pwd}_restart; mv .rwf ${pwd}_restart; (Why? - any command you would want to execute after post job execution)