Apache Cassandra ci-cassandra.apache.org Jenkins Resources

This document contains information on

  • how to set up servers to be added to the ci-cassandra.apache.org jenkins cluster, and
  • the list of servers currently donated and running at ci-cassandra.apache.org

Additional compute resource donations for the Apache Cassandra project are appreciated. If you have questions about compute resource donations, ask on the dev mailing list dev@cassandra.apache.org.

Server Requirements

Server Requirements:

  • Installed OS software is the stock online.net Ubuntu 18.04 LTS amd64 image.
  • Static IP address.
  • Root volume is 100GB+.
  • Data volume is 500GB+ and is mounted at /home/jenkins.

Ubuntu 18.04 Server Installation

  1. Sudoers need to sudo without password.

Edit sudoers to allow INFRA to sudo without password, or provide them with the password. For example, set: %sudo ALL=(ALL:ALL) NOPASSWD:ALL

$ sudo visudo

  1. The agent-install.sh must be run in preparation for ASF Infra to add it to the Jenkins cluster.

To run the script…

    a. scp agent-install.sh <server>:~/

    b. ssh <server>

    c. sudo bash agent-install.sh

AWS Server Installation

On AWS you are free to re-use the public AMI ami-02cd664c0e9899a91 cassandra-jenkins-host-v3. You will find this AMI in region us-west-2.

It is highly preferable to provision nodes in a such way that its reboot nor shutdown / start will change node's IP address. Use Elastic IPs for this. The default limit per region is 5. You may ask for more in console https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/elastic-ip-addresses-eip.html#using-instance-addressing-limit

Current Agents

  • All have label cassandra (or cassandra-arm for arm64 architecture).
  • Agents with 500GB+ data volumes have the label cassandra-dtest, enabling them to run the python dtests.
  • Agents with 32GB+ RAM have the label cassandra-dtest-large, enabling them to run the resource intensive python dtests.
Agent NameDonated ByDescriptionIP Address
cassandra8InstaclustrUbuntu 18.04 LTS amd64, 32G RAM, m4.2xlarge52.38.142.130
cassandra9InstaclustrUbuntu 18.04 LTS amd64, 32G RAM, m4.2xlarge34.223.128.131
cassandra10InstaclustrUbuntu 18.04 LTS amd64, 32G RAM, m4.2xlarge34.209.95.9
cassandra11InstaclustrUbuntu 18.04 LTS amd64, 32G RAM, m4.2xlarge52.13.31.44
cassandra12InstaclustrUbuntu 18.04 LTS amd64, 32G RAM, m4.2xlarge52.88.147.81
cassandra13InstaclustrUbuntu 18.04 LTS amd64, 32G RAM, m4.2xlarge34.213.143.168
cassandra14InstaclustrUbuntu 18.04 LTS amd64, 32G RAM, m4.2xlarge54.148.1.179
cassandra15InstaclustrUbuntu 18.04 LTS amd64, 32G RAM, m4.2xlarge54.189.131.27
cassandra16InstaclustrUbuntu 18.04 LTS amd64, 32G RAM, m4.2xlarge54.201.88.175
cassandra17AmazonUbuntu 18.04 LTS amd64, 32G RAM, m5.2xlarge44.230.121.32
cassandra18AmazonUbuntu 18.04 LTS amd64, 32G RAM, m5.2xlarge44.230.213.15
cassandra19AmazonUbuntu 18.04 LTS amd64, 32G RAM, m5.2xlarge44.231.106.18
cassandra20AmazonUbuntu 18.04 LTS amd64, 32G RAM, m5.2xlarge44.231.194.19
cassandra21AmazonUbuntu 18.04 LTS amd64, 32G RAM, m5.2xlarge44.233.81.188
cassandra22AmazonUbuntu 18.04 LTS amd64, 32G RAM, m5.2xlarge50.112.217.24
cassandra23AmazonUbuntu 18.04 LTS amd64, 32G RAM, m5.2xlarge50.112.240.23
cassandra24AmazonUbuntu 18.04 LTS amd64, 32G RAM, m5.2xlarge52.12.57.190
cassandra25AmazonUbuntu 18.04 LTS amd64, 32G RAM, m5.2xlarge52.27.28.244
cassandra26AmazonUbuntu 18.04 LTS amd64, 32G RAM, m5.2xlarge54.185.77.39
cassandra27AmazonUbuntu 18.04 LTS amd64, 32G RAM, m5.2xlarge54.188.214.16
cassandra28AmazonUbuntu 18.04 LTS amd64, 32G RAM, m5.2xlarge54.190.165.16
cassandra29AmazonUbuntu 18.04 LTS amd64, 32G RAM, m5.2xlarge54.212.144.24
cassandra30AmazonUbuntu 18.04 LTS amd64, 32G RAM, m5.2xlarge54.214.96.70
cassandra31AmazonUbuntu 18.04 LTS amd64, 32G RAM, m5.2xlarge54.71.239.65
cassandra32ilandUbuntu 18.04 LTS amd64, 32G RAM, 16 core64.18.213.245
cassandra33ilandUbuntu 18.04 LTS amd64, 32G RAM, 16 core64.18.213.246
cassandra34ilandUbuntu 18.04 LTS amd64, 32G RAM, 16 core64.18.213.247
cassandra35ilandUbuntu 18.04 LTS amd64, 32G RAM, 16 core64.18.213.248
cassandra36ilandUbuntu 18.04 LTS amd64, 32G RAM, 16 core64.18.213.249
cassandra37DataStaxUbuntu 18.04 LTS amd64, 32G RAM163.172.52.226
cassandra38DataStaxUbuntu 18.04 LTS amd64, 32G RAM163.172.52.231
cassandra39DataStaxUbuntu 18.04 LTS amd64, 32G RAM163.172.52.232
cassandra40DataStaxUbuntu 18.04 LTS amd64, 32G RAM163.172.52.237
cassandra41DataStaxUbuntu 18.04 LTS amd64, 32G RAM163.172.52.242
cassandra42DataStaxUbuntu 18.04 LTS amd64, 32G RAM163.172.52.245
cassandra43DataStaxUbuntu 18.04 LTS amd64, 32G RAM163.172.53.15
cassandra44DataStaxUbuntu 18.04 LTS amd64, 32G RAM163.172.53.17
cassandra45DataStaxUbuntu 18.04 LTS amd64, 32G RAM163.172.53.59
cassandra46DataStaxUbuntu 18.04 LTS amd64, 32G RAM163.172.55.25
cassandra47DataStaxUbuntu 18.04 LTS amd64, 32G RAM163.172.55.40
cassandra48DataStaxUbuntu 18.04 LTS amd64, 32G RAM163.172.55.49
cassandra49DataStaxUbuntu 18.04 LTS amd64, 32G RAM163.172.51.48
cassandra-arm1HuaweiUbuntu 18.04.3 LTS arm64, 32G RAM, 16 core114.119.184.236
cassandra-arm2HuaweiUbuntu 18.04.3 LTS arm64, 32G RAM, 16 core94.74.91.186

Contacts for system donators, when console hands may be needed by INFRA:

Datastax: Mick Semb Wever mck@apache.org

Instaclustr: Stefan Miklosovic stefan.miklosovic@instaclustr.com alternative group list: admin@instaclustr.com

Amazon: Steve Mayszak cassandra-hardware@amazon.com

iland: Julien Anguenot julien@anguenot.org

Huawei: Liu Sheng liusheng2048@gmail.com

For adding additional infrastructure see https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=127406622