tree 555556b6213a564b4cab109ae83cf8bb8475f41b
parent 690101840d4d8f9c656bb0ca114f6619af80e1cf
author Yifan Cai <52585731+yifan-c@users.noreply.github.com> 1713825968 -0700
committer GitHub <noreply@github.com> 1713825968 -0700
gpgsig -----BEGIN PGP SIGNATURE-----
 
 wsFcBAABCAAQBQJmJuiwCRC1aQ7uu5UhlAAAhW8QAIDPYVAoVNnw9Ead7bebdPG8
 ceob/bJrAWik9iqNOR4eAN6vrY57LD4EokrWvaXmTxWjl01+VOX+MXYfiiUnUkVO
 jRrz8F686xAuriujNZd5K+hiaFsdpUc3Ku+BXr7LNcjsvJJpdjGDPJolMK4KYRBg
 k3PWRFAQPwECf/71s9LoyXhNV2+0AHYytTdsK1kpCmx/5+92HWblXm4VBqh7QG8c
 pOmumR2mPFH0PKNv0mF68fCehHxN7XzDxE9d3kHdereCJ81K5nM9B2DIN/OM0TNP
 bT8/p+S9d0Zv0v6hSiSGPsqZn52HY4sHghTV+Eejrx1SRdJXh+e8MN2ve+9ODP5g
 BW/0EognBPWapplrii7ZJkRgW61IK/oImCBId+Z8ns3bDbb/9XQX/lfgHSL6iZNn
 2ft8VOoUUsAQgrSCQE+7jm+Cm/dZlHKaMj5pbkv+3p5A94W4DXooISZXjlP53VZK
 6oGRuyeMQKkyLD+OgEmfbv5nS5KuvEiGiXsfhocknQWRwgJiAKVls5q96oH42c45
 XAcqmMTmht/Ad81Fpcu16vH67TYcCpdjDuOZge4HqM1EuRuB9LGfypHG5YMIH5EK
 rVy0dnXjlm1qb+kbvrKS8lUSwWVwNupvnmrwPdAikQ4l81G7JHDZ/55IEUC/TRhv
 HiMUu/bP5sA+EavvfZnx
 =aRHK
 -----END PGP SIGNATURE-----
 

CASSANDRA-19563: Support bulk write via S3 (#53)

This commit adds a configuration (writer) option to pick a transport other than the previously-implemented "direct upload to all sidecars" (now known as the "Direct" transport).  The second transport, now being implemented, is the "S3_COMPAT" transport, which allows the job to upload the generated SSTables to an S3-compatible storage system, and then inform the Cassandra Sidecar that those files are available for download & commit.

Additionally, a plug-in system was added to allow communications between custom transport hooks and the job, so the custom hook can provide updated credentials and out-of-band status updates on S3-related issues.

Co-Authored-By: Yifan Cai <ycai@apache.org>
Co-Authored-By: Doug Rohrer <drohrer@apple.com>
Co-Authored-By: Francisco Guerrero <frankgh@apache.org>
Co-Authored-By: Saranya Krishnakumar <saranya_k@apple.com>

Patch by Yifan Cai, Doug Rohrer, Francisco Guerrero, Saranya Krishnakumar; Reviewed by Francisco Guerrero for CASSANDRA-19563