Rust object_store crate

Clone this repo:
  1. 279572e Update CHANGELOG for latest main (#855) by Andrew Lamb · 8 hours ago main v0.14.2-rc2
  2. 4ff7d04 Restore missing first line of ASF license header in src/client/s3.rs (#854) by Andrew Lamb · 13 hours ago
  3. 25fa079 Update version to 0.14.2 and add CHANGELOG (#850) by Andrew Lamb · 2 days ago v0.14.2-rc1
  4. c37db72 feat: retry failed multipart part uploads (#849) by Chris · 2 days ago
  5. 135984f Add doc hints pointing large-object uploads at the multipart API (#839) by Andrew Lamb · 2 days ago

Rust Object Store

A focused, easy to use, idiomatic, high performance, async object store library for interacting with object stores.

Using this crate, the same binary and code can easily run in multiple clouds and local test environments, via a simple runtime configuration change. Supported object stores include:

Originally developed by InfluxData and later donated to Apache Arrow.

See docs.rs for usage instructions

See CONTRIBUTING.md to learn how to contribute to this project.

Support for wasm32-unknown-unknown target

It's possible to build object_store for the wasm32-unknown-unknown target, however the cloud storage features aws, azure, gcp, and http are not supported.

cargo build -p object_store --target wasm32-unknown-unknown

Disabling reqwest

The aws, azure, gcp, and http features each bundle a reqwest-based HTTP transport. To target wasm32-wasip1 (where reqwest does not compile) or otherwise supply your own HTTP client, build against the matching *-base feature instead:

cargo build -p object_store --no-default-features --features aws-base --target wasm32-wasip1

See Disabling reqwest in the crate docs for full details.

Related Apache Crates

Here are several related crates in different repositories from other Apache projects.

CrateDescriptionDocumentation
object_store_opendalUse opendal as object_store backend(README)

Community Extensions

There following community maintained crates provide additional functionality for object_store and are NOT governed by the Apache Software Foundation. We list them below in the hope they may be useful, but they are not official Apache projects or endorsed by the Apache Arrow project.

CrateDescriptionDocumentation
hdfs_native_object_storeUse HDFS as object_store backend(README)
ic_object_storeUse ICP blockchain as object_store backend(README)
anda_object_storeExtends the object_store with metadata management and AES-256-GCM encryption(README)

Release Schedule

The object_store crate follows Semantic Versioning. We aim to release new versions approximately every 2 months.

Please see the release tracker for an up to date release schedule, to track the progress of upcoming releases, and request features or fixes.

Planned Release Schedule

Approximate DateVersionNotesTicket
Sep 20260.14.2Minor, NO breaking API changes#832
Oct 20260.14.3Minor, NO breaking API changes#833
TBD0.15.0Major, breaking API changes#762