MINOR: Bump io.grpc:grpc-bom from 1.79.0 to 1.80.0 (#1093) Bumps [io.grpc:grpc-bom](https://github.com/grpc/grpc-java) from 1.79.0 to 1.80.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/grpc/grpc-java/releases">io.grpc:grpc-bom's releases</a>.</em></p> <blockquote> <h2>V1.80.0</h2> <p><strong>API Changes</strong></p> <ul> <li>core: Added PickResult.copyWithSubchannel() and PickResult.copyWithStreamTracerFactory() to simplify updating PickResult while preserving metadata. Load balancing policies should now ensure ForwardingSubchannel decorators are unwrapped before being returned in a pick result. (<a href="https://redirect.github.com/grpc/grpc-java/issues/12658">#12658</a>) (eae16b251)</li> </ul> <p><strong>Bug Fixes</strong></p> <ul> <li>core: Fixed the retry backoff jitter range to [0.8, 1.2] to align with the gRPC A6 specification. Retries will now occur more consistently around the calculated backoff interval. (<a href="https://redirect.github.com/grpc/grpc-java/issues/12639">#12639</a>) (024fdd0ea) core: Fixed a race condition in RetriableStream where inFlightSubStreams counting could become inconsistent during concurrent retry and deadline events. This ensures that client calls (such as blockingUnaryCall) do not hang indefinitely and correctly receive a close signal. (<a href="https://redirect.github.com/grpc/grpc-java/issues/12649">#12649</a>) (73abb4854)</li> </ul> <p><strong>Improvements</strong></p> <ul> <li>api: Trigger R8's ServiceLoader optimization to reduce necessary configuration when using R8 Full Mode (470219f9c). This allows gRPC to avoid reflection, and the need to specify -keeps for various class’s constructors. Upgrade to protobuf 33.4 (<a href="https://redirect.github.com/grpc/grpc-java/issues/12615">#12615</a>) (50c18f183)</li> <li>cronet: Introduced CRONET_READ_BUFFER_SIZE_KEY to allow customizing the read buffer size per-stream via CallOptions. Increasing the buffer size from the 4KB default can significantly improve performance for large messages by reducing JNI and context-switching overhead. (31fdb6c22)</li> <li>api: Moved FlagResetRule to api/testFixtures and updated ManagedChannelRegistry to honor the GRPC_ENABLE_RFC3986_URIS feature flag. This ensures that target parsing is consistent across the library when the new URI parser is enabled. (<a href="https://redirect.github.com/grpc/grpc-java/issues/12608">#12608</a>)</li> <li>api: Updated NameResolverRegistry to natively support io.grpc.Uri. This is a foundational change that allows gRPC's name resolution system to handle URIs parsed with the new RFC 3986-compliant parser, ensuring more robust target handling. (<a href="https://redirect.github.com/grpc/grpc-java/issues/12609">#12609</a>) (990348876)</li> <li>xds: Removed the GRPC_EXPERIMENTAL_XDS_SNI feature flag. SNI determination via xDS is now always enabled and follows gRFC A101, where SNI is derived from xDS configurations like auto_host_sni or UpstreamTlsContext.sni. This ensures that no SNI is sent if not explicitly configured, unless the legacy channel authority fallback is enabled. (<a href="https://redirect.github.com/grpc/grpc-java/issues/12625">#12625</a>) (ac44e9681)</li> </ul> <p><strong>New Features</strong></p> <ul> <li>core: pick_first shuffling now a weighted shuffle and observes weights from EDS (34dd29042). This finishes the <a href="https://github.com/grpc/proposal/blob/master/A113-pick-first-weighted-shuffling.md">gRFC A113 pick_first: Weighted Random Shuffling</a> support</li> <li>netty: Added RFC 3986 support to the unix: name resolver. This enables proper parsing of Unix domain socket URIs, including correct handling of query and fragment components in both hierarchical (e.g., unix:///path) and opaque (e.g., unix:/path) formats. (<a href="https://redirect.github.com/grpc/grpc-java/issues/12659">#12659</a>)</li> </ul> <p><strong>Thanks to</strong></p> <ul> <li><a href="https://github.com/becomeStar"><code>@becomeStar</code></a></li> <li><a href="https://github.com/aymanm-google"><code>@aymanm-google</code></a></li> <li><a href="https://github.com/PetitBaguette"><code>@PetitBaguette</code></a></li> <li><a href="https://github.com/stagegrowth"><code>@stagegrowth</code></a></li> <li><a href="https://github.com/wcchoi"><code>@wcchoi</code></a></li> <li><a href="https://github.com/Gyuhyeok99"><code>@Gyuhyeok99</code></a></li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/grpc/grpc-java/commit/6c231b4c534d887bc6407f8af52733d996f19819"><code>6c231b4</code></a> Bump version to 1.80.0</li> <li><a href="https://github.com/grpc/grpc-java/commit/daf7a6c3c0496dce3f9d9c26aeae2479a3a4d7de"><code>daf7a6c</code></a> Update README etc to reference 1.80.0</li> <li><a href="https://github.com/grpc/grpc-java/commit/b7f9074e23fa543e9a804e20df8a8a656feb39ea"><code>b7f9074</code></a> Revert "fix(xds): Allow and normalize trailing dot (FQDN) in matchHostName (#...</li> <li><a href="https://github.com/grpc/grpc-java/commit/09a6e2ef6ebdbee4d3980d5ac6bd3e3e1c2d9755"><code>09a6e2e</code></a> Revert "netty: Preserve early server handshake failure cause in logs"</li> <li><a href="https://github.com/grpc/grpc-java/commit/31fdb6c2268b4b1c8ba6c995ee46c58e84a831aa"><code>31fdb6c</code></a> Add <code>CRONET_READ_BUFFER_SIZE_KEY</code> API to CronetClientStream</li> <li><a href="https://github.com/grpc/grpc-java/commit/470219f9ca330887215d3192f72095aa844d84fb"><code>470219f</code></a> Trigger R8's ServiceLoader optimization</li> <li><a href="https://github.com/grpc/grpc-java/commit/50ead96f4718569782cc7a3f694c9aa755722bac"><code>50ead96</code></a> netty: Preserve early server handshake failure cause in logs</li> <li><a href="https://github.com/grpc/grpc-java/commit/eae16b2517e294cde94c2a8b1171c0131fa7991a"><code>eae16b2</code></a> unwrap ForwardingSubchannel during Picks (<a href="https://redirect.github.com/grpc/grpc-java/issues/12658">#12658</a>)</li> <li><a href="https://github.com/grpc/grpc-java/commit/d9320eea62534e8a87319c1124a3a0f8443e43a8"><code>d9320ee</code></a> netty: Add RFC 3986 support to the 'unix:' name resolver.</li> <li><a href="https://github.com/grpc/grpc-java/commit/d5536b34b26788993c9b0ae4212f22a35a9ecf3c"><code>d5536b3</code></a> netty: factor out some duplicated code into a helper method</li> <li>Additional commits viewable in <a href="https://github.com/grpc/grpc-java/compare/v1.79.0...v1.80.0">compare view</a></li> </ul> </details> <br /> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
The following guides explain the fundamental data structures used in the Java implementation of Apache Arrow.
Generated javadoc documentation is available here.
Refer to Building Apache Arrow for documentation of environment setup and build instructions.
Arrow uses Google's Flatbuffers to transport metadata. The java version of the library requires the generated flatbuffer classes can only be used with the same version that generated them. Arrow packages a version of the arrow-vector module that shades flatbuffers and arrow-format into a single JAR. Using the classifier “shade-format-flatbuffers” in your pom.xml will make use of this JAR, you can then exclude/resolve the original dependency to a version of your choosing.
$ flatc --version flatc version 25.1.24 $ grep "dep.fbs.version" pom.xml <dep.fbs.version>25.1.24</dep.fbs.version>
cd $ARROW_HOME # remove the existing files rm -rf format/src # regenerate from the .fbs files flatc --java -o format/src/main/java arrow-format/*.fbs # prepend license header mvn spotless:apply -pl :arrow-format
There are several system/environmental variables that users can configure. These trade off safety (they turn off checking) for speed. Typically they are only used in production settings after the code has been thoroughly tested without using them.
Bounds Checking for memory accesses: Bounds checking is on by default. You can disable it by setting either the system property(arrow.enable_unsafe_memory_access) or the environmental variable (ARROW_ENABLE_UNSAFE_MEMORY_ACCESS) to true. When both the system property and the environmental variable are set, the system property takes precedence.
null checking for gets: ValueVector get methods (not getObject) methods by default verify the slot is not null. You can disable it by setting either the system property(arrow.enable_null_check_for_get) or the environmental variable (ARROW_ENABLE_NULL_CHECK_FOR_GET) to false. When both the system property and the environmental variable are set, the system property takes precedence.
-Dio.netty.tryReflectionSetAccessible=true should be set. This fixes java.lang.UnsupportedOperationException: sun.misc.Unsafe or java.nio.DirectByteBuffer.(long, int) not available. thrown by Netty.StructVector enable -Darrow.struct.conflict.policy=CONFLICT_APPEND. Duplicate fields are ignored (CONFLICT_REPLACE) by default and overwritten. To support different policies for conflicting or duplicate fields set this JVM flag or use the correct static constructor methods for StructVectors.Arrow Java follows the Google Java Style Guide with the following differences:
NoFinalizer, OverloadMethodsDeclarationOrder, and VariableDeclarationUsageDistance due to the existing code base. These rules should be followed when possible.Refer to checkstyle.xml for rule specifics.
When running tests, Arrow Java uses the Logback logger with SLF4J. By default, it uses the logback.xml present in the corresponding module's src/test/resources directory, which has the default log level set to INFO. Arrow Java can be built with an alternate logback configuration file using the following command run in the project root directory:
mvn -Dlogback.configurationFile=file:<path-of-logback-file>
See Logback Configuration for more details.
Integration tests which require more time or more memory can be run by activating the integration-tests profile. This activates the Maven Failsafe plugin and any class prefixed with IT will be run during the testing phase. The integration tests currently require a larger amount of memory (>4GB) and time to complete. To activate the profile:
mvn -Pintegration-tests <rest of mvn arguments>