modules/ide-integration - airavata

tree: 3591824b684d344980e83bf8ca62a030fdb33bcc [path history] [tgz]

modules/ide-integration/README.md

Introduction

Using this module, you can setup a full Airavata installation inside Intelij IDEA for development purposes

Docker installed with ‘docker-compose’ utility https://docs.docker.com/compose/
InteliJ IDEA with Java 8 installed https://www.jetbrains.com/idea/download/#section=mac
Maven
Git
python3
npm (install or update to latest version) https://www.npmjs.com/get-npm

Clone Airavata repository to a local directory

git clone https://github.com/apache/airavata

Add a host entry to /etc/hosts file in local machine
```
127.0.0.1 airavata.host
```
Go to src/main/resources directory and run
```
docker-compose up
```

Apply any database migrations. Go to src/main/resources directory and run

cat ./database_scripts/init/*-migrations.sql | docker exec -i resources_db_1 mysql -p123456

Wait until all the services come up. This will initialize all utilities required to start Airavata server

Go to org.apache.airavata.ide.integration.APIServerStarter class and right click on the editor and click Run option. This will start Airavata server

Go to org.apache.airavata.ide.integration.JobEngineStarter class and right click on the editor and click Run option. This will start all components of Job Execution Engine including Helix Controller, Helix Participant, Pre Workflow Manager and Post Workflow Manager

This will start the Email Based Job Monitoring agent. Before starting this, you have to create a new gmail account by going to https://accounts.google.com/signup
Once the account is created, turn on Less Security App access for that gmail account https://support.google.com/accounts/answer/6010255?hl=en
Update the email account credentials in src/main/resources/airavata-server.properties file
email.based.monitor.address=CHANGEME email.based.monitor.password=CHANGEME
Go to org.apache.airavata.ide.integration.JobMonitorStarter class and right click on the editor and click Run option.

You can create and launch experiments and manage credentials using this portal
This is a separate project so you need to clone this in to a new directory outside the Airavata code base
```
git clone https://github.com/apache/airavata-django-portal
```

Go to airavata-django-portal directory and run

python3 -m venv venv
source venv/bin/activate
pip install -r requirements.txt

Create a local settings file. Copy django_airavata/settings_local.py.ide to django_airavata/settings_local.py
Run Django migrations
```
python3 manage.py migrate
```
Build the JavaScript sources. There are a few JavaScript packages in the source tree, colocated with the Django apps in which they are used. The build_js.sh script will build them all.
```
./build_js.sh
```
Load the default Wagtail CMS pages.
```
python3 manage.py load_default_gateway
```
Run the server
```
python3 manage.py runserver  
```
Point your browser to http://localhost:8000/auth/login. Use user name : default-admin and password : 123456

This portal is required when you are going to register new compute resources or storage resources into the gateway
Go to src/main/resources/pga directory and run
```
docker-compose up -d
```
Run following command to get the ip address of host machine
This command is for docker containers deployed on Mac OSX
```
docker-compose exec pga getent hosts docker.for.mac.host.internal | awk '{ print $1 }'
```

Update the host entries of pga container with above ip address

docker-compose exec pga /bin/sh -c "echo '<host-machine ip> airavata.host' >> /etc/hosts"