Database connectivity API standard and libraries for Apache Arrow

Clone this repo:
  1. ef8c485 feat(csharp/src/Drivers/Databricks): Added connection params of rateLimitRetry and rateLimitRetryTimeout (#3612) by msrathore-db · 18 hours ago main
  2. 9999dab feat(csharp/Benchmarks): Add custom columns for CloudFetch benchmark metrics (#3688) by eric-wang-1990 · 19 hours ago
  3. 12deb28 fix(dev/release): fix wheel verification failure on macOS due to SIP (#3686) by Bryce Mecum · 32 hours ago
  4. 131b3d2 fix(c/driver_manager): look for correct init symbol name (#3681) by David Li · 2 days ago
  5. d18e84d feat(csharp/Benchmarks): Add .NET Framework 4.7.2 support with TLS co… (#3682) by eric-wang-1990 · 2 days ago

ADBC: Arrow Database Connectivity

License

ADBC is an API standard (version 1.0.0) for database access libraries (“drivers”) in C, Go, and Java that uses Arrow for result sets and query parameters. Instead of writing code to convert to and from Arrow data for each individual database, applications can build against the ADBC APIs, and link against drivers that implement the standard. Additionally, a JDBC/ODBC-style driver manager is provided. This also implements the ADBC APIs, but dynamically loads drivers and dispatches calls to them.

Like JDBC/ODBC, the goal is to provide a generic API for multiple databases. ADBC, however, is focused on bulk columnar data retrieval and ingestion through an Arrow-based API rather than attempting to replace JDBC/ODBC in all use cases. Hence, ADBC is complementary to those existing standards.

Like Arrow Flight SQL, ADBC is an Arrow-based way to work with databases. However, Flight SQL is a protocol defining a wire format and network transport as opposed to an API specification. Flight SQL requires a database to specifically implement support for it, while ADBC is a client API specification for wrapping existing database protocols which could be Arrow-native or not. Together, ADBC and Flight SQL offer a fully Arrow-native solution for clients and database vendors.

For more about ADBC, see the introductory blog post.

Status

ADBC versions the API standard and the implementing libraries separately.

The API standard (version 1.0.0) is considered stable, but enhancements may be made.

Libraries are under development. For more details, see the documentation, or read the changelog.

Installation

Please see the documentation.

Documentation

The core API definitions can be read in adbc.h. User documentation can be found at https://arrow.apache.org/adbc

Development and Contributing

For detailed instructions on how to build the various ADBC libraries, see CONTRIBUTING.md.