Currently, Hamilton scales by using Koalas on Spark. Koalas became part of Spark officially in Spark 3.2. The example in hello_world here assumes that.
hello_world