MINOR: [CI] Bump actions/setup-java from 5 to 6 (#1273) Bumps [actions/setup-java](https://github.com/actions/setup-java) from 5 to 6. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/actions/setup-java/releases">actions/setup-java's releases</a>.</em></p> <blockquote> <h2>v6.0.0</h2> <h2>What's Changed</h2> <ul> <li>dist: Migrate from Zulu Discovery API to Azul Metadata API by <a href="https://github.com/jameswald"><code>@jameswald</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1010">actions/setup-java#1010</a></li> <li>feat: add .mvn/extensions.xml to Maven cache key pattern by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> with <a href="https://github.com/Copilot"><code>@Copilot</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1041">actions/setup-java#1041</a></li> <li>Migrate to ESM and upgrade dependencies by <a href="https://github.com/priyagupta108"><code>@priyagupta108</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1078">actions/setup-java#1078</a></li> <li>Map Zulu x86 architecture to i686 for Azul Metadata API by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1079">actions/setup-java#1079</a></li> <li>Rename jdkFile input to jdk-file with deprecated alias by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1083">actions/setup-java#1083</a></li> <li>Infer distribution from asdf .tool-versions vendor prefix by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1084">actions/setup-java#1084</a></li> <li>Add Maven compiler problem matcher for javac diagnostics by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1086">actions/setup-java#1086</a></li> <li>feat: expose cache-primary-key output (<a href="https://redirect.github.com/actions/setup-java/issues/597">#597</a>) by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1088">actions/setup-java#1088</a></li> <li>docs: clarify V6 ESM migration is not a user-facing breaking change by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1090">actions/setup-java#1090</a></li> <li>Support multi-field Java versions like <code>18.0.1.1</code> by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1092">actions/setup-java#1092</a></li> <li>docs: document seeding the Maven cache for plugin dependencies by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1094">actions/setup-java#1094</a></li> <li>docs: clarify Maven cache paths and key hash inputs by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1096">actions/setup-java#1096</a></li> <li>Support pinning java-version as "latest" by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1093">actions/setup-java#1093</a></li> <li>chore(deps-dev): bump eslint from 10.6.0 to 10.7.0 by <a href="https://github.com/dependabot"><code>@dependabot</code></a>[bot] in <a href="https://redirect.github.com/actions/setup-java/pull/1101">actions/setup-java#1101</a></li> <li>chore(deps-dev): bump eslint-plugin-n from 18.2.1 to 18.2.2 by <a href="https://github.com/dependabot"><code>@dependabot</code></a>[bot] in <a href="https://redirect.github.com/actions/setup-java/pull/1103">actions/setup-java#1103</a></li> <li>chore(deps-dev): bump prettier from 3.9.4 to 3.9.5 by <a href="https://github.com/dependabot"><code>@dependabot</code></a>[bot] in <a href="https://redirect.github.com/actions/setup-java/pull/1105">actions/setup-java#1105</a></li> <li>chore(deps): bump actions/checkout from 6 to 7 by <a href="https://github.com/dependabot"><code>@dependabot</code></a>[bot] in <a href="https://redirect.github.com/actions/setup-java/pull/1106">actions/setup-java#1106</a></li> <li>chore(deps-dev): bump <code>@types/node</code> from 26.1.0 to 26.1.1 by <a href="https://github.com/dependabot"><code>@dependabot</code></a>[bot] in <a href="https://redirect.github.com/actions/setup-java/pull/1104">actions/setup-java#1104</a></li> <li>dist: Cover Tencent Kona JDK 25 by <a href="https://github.com/johnshajiang"><code>@johnshajiang</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1108">actions/setup-java#1108</a></li> <li>chore(deps-dev): bump typescript from 6.0.3 to 7.0.2 by <a href="https://github.com/dependabot"><code>@dependabot</code></a>[bot] in <a href="https://redirect.github.com/actions/setup-java/pull/1102">actions/setup-java#1102</a></li> <li>Preserve Maven toolchains across repeated setup-java runs (<a href="https://redirect.github.com/actions/setup-java/issues/1099">#1099</a>) by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1111">actions/setup-java#1111</a></li> <li>dist: Support Liberica NIK (<a href="https://redirect.github.com/actions/setup-java/issues/878">#878</a>) by <a href="https://github.com/asm0dey"><code>@asm0dey</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1112">actions/setup-java#1112</a></li> <li>Fix template injection (zizmor alert <a href="https://redirect.github.com/actions/setup-java/issues/118">#118</a>) in e2e-versions.yml by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> with <a href="https://github.com/Copilot"><code>@Copilot</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1114">actions/setup-java#1114</a></li> <li>Fix template injection in e2e-versions.yml (zizmor alert <a href="https://redirect.github.com/actions/setup-java/issues/122">#122</a>) by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> with <a href="https://github.com/Copilot"><code>@Copilot</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1120">actions/setup-java#1120</a></li> <li>Disable persisted checkout credentials in e2e workflow by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> with <a href="https://github.com/Copilot"><code>@Copilot</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1115">actions/setup-java#1115</a></li> <li>feat: Update recommended configuration for GPG signing by <a href="https://github.com/wetneb"><code>@wetneb</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/608">actions/setup-java#608</a></li> <li>Cache Maven and Gradle wrapper distributions separately from the dependency cache by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1097">actions/setup-java#1097</a></li> <li>Consolidate cache-dependency-path e2e workflow and add maven/sbt coverage by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1124">actions/setup-java#1124</a></li> <li>Use gpg.passphraseEnvName instead of the deprecated gpg.passphrase server by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1123">actions/setup-java#1123</a></li> <li>Extract repeated directory-check assertions into check-dir.sh helper by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1127">actions/setup-java#1127</a></li> <li>Consolidate duplicate jobs in e2e-versions workflow by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1125">actions/setup-java#1125</a></li> <li>Use YAML anchors to reduce boilerplate in e2e-versions workflow by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1126">actions/setup-java#1126</a></li> <li>Updated msft json for now by <a href="https://github.com/jmjaffe37"><code>@jmjaffe37</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1129">actions/setup-java#1129</a></li> <li>Document missing action inputs in README by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1130">actions/setup-java#1130</a></li> <li>chore(deps): bump <code>@actions/cache</code> to 6.2.0 by <a href="https://github.com/philip-gai"><code>@philip-gai</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1128">actions/setup-java#1128</a></li> <li>Add an option to disable Java problem matchers by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1133">actions/setup-java#1133</a></li> <li>docs: update setup-java examples by <a href="https://github.com/HarithaVattikuti"><code>@HarithaVattikuti</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1131">actions/setup-java#1131</a></li> <li>Clarify credential environment variable inputs by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1134">actions/setup-java#1134</a></li> <li>chore(deps-dev): bump <code>@typescript-eslint/eslint-plugin</code> from 8.63.0 to 8.64.0 by <a href="https://github.com/dependabot"><code>@dependabot</code></a>[bot] in <a href="https://redirect.github.com/actions/setup-java/pull/1135">actions/setup-java#1135</a></li> <li>chore(deps): bump actions/setup-python from 6 to 7 by <a href="https://github.com/dependabot"><code>@dependabot</code></a>[bot] in <a href="https://redirect.github.com/actions/setup-java/pull/1143">actions/setup-java#1143</a></li> <li>chore(deps): bump fast-xml-parser from 5.9.3 to 5.10.1 by <a href="https://github.com/dependabot"><code>@dependabot</code></a>[bot] in <a href="https://redirect.github.com/actions/setup-java/pull/1142">actions/setup-java#1142</a></li> <li>chore(deps-dev): bump <code>@typescript-eslint/parser</code> from 8.64.0 to 8.65.0 by <a href="https://github.com/dependabot"><code>@dependabot</code></a>[bot] in <a href="https://redirect.github.com/actions/setup-java/pull/1138">actions/setup-java#1138</a></li> <li>chore(deps-dev): bump lint-staged from 17.0.8 to 17.2.0 by <a href="https://github.com/dependabot"><code>@dependabot</code></a>[bot] in <a href="https://redirect.github.com/actions/setup-java/pull/1136">actions/setup-java#1136</a></li> <li>chore(deps-dev): bump typescript from 6.0.3 to 7.0.2 by <a href="https://github.com/dependabot"><code>@dependabot</code></a>[bot] in <a href="https://redirect.github.com/actions/setup-java/pull/1137">actions/setup-java#1137</a></li> <li>chore(deps): fix npm audited vulnerabilities by <a href="https://github.com/mhoffrog"><code>@mhoffrog</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1140">actions/setup-java#1140</a></li> <li>Fix formatting issues in README.md by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1144">actions/setup-java#1144</a></li> <li>Remediate npm audit findings and rebuild distributions by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> with <a href="https://github.com/Copilot"><code>@Copilot</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1145">actions/setup-java#1145</a></li> <li>Set GRAALVM_HOME for GraalVM distributions by <a href="https://github.com/brunoborges"><code>@brunoborges</code></a> with <a href="https://github.com/Copilot"><code>@Copilot</code></a> in <a href="https://redirect.github.com/actions/setup-java/pull/1146">actions/setup-java#1146</a></li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/actions/setup-java/commit/dd06d9cba3e5552c54d9f8ea23572deb30010f7c"><code>dd06d9c</code></a> Prepare documentation for v6 release (<a href="https://redirect.github.com/actions/setup-java/issues/1253">#1253</a>)</li> <li><a href="https://github.com/actions/setup-java/commit/59b3450628e54f250d3a3bfd413cd68b83bce8ed"><code>59b3450</code></a> chore(deps): combine open Dependabot npm updates (<a href="https://redirect.github.com/actions/setup-java/issues/1252">#1252</a>)</li> <li><a href="https://github.com/actions/setup-java/commit/b96213d9d21fbd1dd447987fe15dd75fce7f7726"><code>b96213d</code></a> Set default signature verification for supported distributions (<a href="https://redirect.github.com/actions/setup-java/issues/1246">#1246</a>)</li> <li><a href="https://github.com/actions/setup-java/commit/1dbac3c9e137b6d4d280bae1ae4e9902bb4ce1b9"><code>1dbac3c</code></a> docs: expose contributing guide to GitHub (<a href="https://redirect.github.com/actions/setup-java/issues/1245">#1245</a>)</li> <li><a href="https://github.com/actions/setup-java/commit/11741d6cfaf82354eb314633583a9ce43399238b"><code>11741d6</code></a> ci: constrain cache e2e job modes (<a href="https://redirect.github.com/actions/setup-java/issues/1244">#1244</a>)</li> <li><a href="https://github.com/actions/setup-java/commit/ff99aa1c87709f29685194226dae7d9b476c594f"><code>ff99aa1</code></a> Fix Oracle macOS E2E version (<a href="https://redirect.github.com/actions/setup-java/issues/1243">#1243</a>)</li> <li><a href="https://github.com/actions/setup-java/commit/416c6d1e8ab4ffb67a533d502fd7b21f70c5d9ee"><code>416c6d1</code></a> Add Red Hat Build of OpenJDK support (<a href="https://redirect.github.com/actions/setup-java/issues/1241">#1241</a>)</li> <li><a href="https://github.com/actions/setup-java/commit/5f75b27283990add95cd9c4ceaca74d789324bf7"><code>5f75b27</code></a> Add Maven dependency-resolution repositories (<a href="https://redirect.github.com/actions/setup-java/issues/1240">#1240</a>)</li> <li><a href="https://github.com/actions/setup-java/commit/a42a52cfb590b0682db41c911da5dc7798ba620e"><code>a42a52c</code></a> Add multiple Maven server credentials (<a href="https://redirect.github.com/actions/setup-java/issues/1239">#1239</a>)</li> <li><a href="https://github.com/actions/setup-java/commit/fb4abd7a7075173ac733c41f723ac0c47c41ad17"><code>fb4abd7</code></a> test: cover JDK 26 from SDKMAN (<a href="https://redirect.github.com/actions/setup-java/issues/1238">#1238</a>)</li> <li>Additional commits viewable in <a href="https://github.com/actions/setup-java/compare/v5...v6">compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
The following guides explain the fundamental data structures used in the Java implementation of Apache Arrow.
Generated javadoc documentation is available here.
Refer to Building Apache Arrow for documentation of environment setup and build instructions.
Arrow uses Google's Flatbuffers to transport metadata. The java version of the library requires the generated flatbuffer classes can only be used with the same version that generated them. Arrow packages a version of the arrow-vector module that shades flatbuffers and arrow-format into a single JAR. Using the classifier “shade-format-flatbuffers” in your pom.xml will make use of this JAR, you can then exclude/resolve the original dependency to a version of your choosing.
$ flatc --version flatc version 25.1.24 $ grep "dep.fbs.version" pom.xml <dep.fbs.version>25.1.24</dep.fbs.version>
cd $ARROW_HOME # remove the existing files rm -rf format/src # regenerate from the .fbs files flatc --java -o format/src/main/java arrow-format/*.fbs # prepend license header mvn spotless:apply -pl :arrow-format
There are several system/environmental variables that users can configure. These trade off safety (they turn off checking) for speed. Typically they are only used in production settings after the code has been thoroughly tested without using them.
Bounds Checking for memory accesses: Bounds checking is on by default. You can disable it by setting either the system property(arrow.enable_unsafe_memory_access) or the environmental variable (ARROW_ENABLE_UNSAFE_MEMORY_ACCESS) to true. When both the system property and the environmental variable are set, the system property takes precedence.
null checking for gets: ValueVector get methods (not getObject) methods by default verify the slot is not null. You can disable it by setting either the system property(arrow.enable_null_check_for_get) or the environmental variable (ARROW_ENABLE_NULL_CHECK_FOR_GET) to false. When both the system property and the environmental variable are set, the system property takes precedence.
-Dio.netty.tryReflectionSetAccessible=true should be set. This fixes java.lang.UnsupportedOperationException: sun.misc.Unsafe or java.nio.DirectByteBuffer.(long, int) not available. thrown by Netty.StructVector enable -Darrow.struct.conflict.policy=CONFLICT_APPEND. Duplicate fields are ignored (CONFLICT_REPLACE) by default and overwritten. To support different policies for conflicting or duplicate fields set this JVM flag or use the correct static constructor methods for StructVectors.Arrow Java follows the Google Java Style Guide with the following differences:
NoFinalizer, OverloadMethodsDeclarationOrder, and VariableDeclarationUsageDistance due to the existing code base. These rules should be followed when possible.Refer to checkstyle.xml for rule specifics.
When running tests, Arrow Java uses the Logback logger with SLF4J. By default, it uses the logback.xml present in the corresponding module's src/test/resources directory, which has the default log level set to INFO. Arrow Java can be built with an alternate logback configuration file using the following command run in the project root directory:
mvn -Dlogback.configurationFile=file:<path-of-logback-file>
See Logback Configuration for more details.
Integration tests which require more time or more memory can be run by activating the integration-tests profile. This activates the Maven Failsafe plugin and any class prefixed with IT will be run during the testing phase. The integration tests currently require a larger amount of memory (>4GB) and time to complete. To activate the profile:
mvn -Pintegration-tests <rest of mvn arguments>