Google Git
Sign in
apache / opendal / 7963d0883fe9310f0c276e0b2f96c84c834233e4
commit7963d0883fe9310f0c276e0b2f96c84c834233e4[log] [tgz]
authorXuanwo <github@xuanwo.io>Tue Dec 20 13:44:43 2022 +0800
committerGitHub <noreply@github.com>Tue Dec 20 13:44:43 2022 +0800
tree062c371966a50c586eff7b43927de578a1f68d0d
parent31e2aacb2bfd11835db2a43242a52a09173d77eb [diff]
feat(services/s3,gcs): Allow accepting signer directly (#1087)

* feat(services/s3,gcs): Allow accepting signer directly

Signed-off-by: Xuanwo <github@xuanwo.io>

* fix build

Signed-off-by: Xuanwo <github@xuanwo.io>

Signed-off-by: Xuanwo <github@xuanwo.io>
4 files changed
tree: 062c371966a50c586eff7b43927de578a1f68d0d
  1. .cargo/
  2. .github/
  3. benches/
  4. docs/
  5. examples/
  6. oay/
  7. oli/
  8. src/
  9. testdata/
  10. tests/
  11. .env.example
  12. .gitignore
  13. .licenserc.yaml
  14. .taplo.toml
  15. book.toml
  16. Cargo.toml
  17. CHANGELOG.md
  18. CONTRIBUTING.md
  19. LICENSE
  20. README.md
  21. rust-toolchain.toml
  22. rustfmt.toml
README.md

OpenDAL   Build Status Latest Version Crate Downloads

Open Data Access Layer: Access data freely, painlessly, and efficiently

You may be looking for:

Services

Features

Access data freely

  • Access different storage services in the same way
  • Behavior tests for all services

Access data painlessly

  • 100% documents covered
  • Powerful Layers
  • Automatic retry support
  • Full observability support: logging, tracing, metrics.
  • Native decompress support
  • Native service-side encryption support

Access data efficiently

  • Zero cost: mapping to underlying API calls directly
  • Auto metadata reuse: avoid extra metadata calls

Quickstart

use anyhow::Result;
use futures::StreamExt;
use futures::TryStreamExt;
use opendal::ObjectStreamer;
use opendal::Object;
use opendal::ObjectMetadata;
use opendal::ObjectMode;
use opendal::Operator;
use opendal::Scheme;

#[tokio::main]
async fn main() -> Result<()> {
    // Init Operator
    let op = Operator::from_env(Scheme::Fs)?;

    // Create object handler.
    let o = op.object("test_file");

    // Write data info object;
    o.write("Hello, World!").await?;

    // Read data from object;
    let bs = o.read().await?;

    // Read range from object;
    let bs = o.range_read(1..=11).await?;

    // Get object's path
    let name = o.name();
    let path = o.path();

    // Fetch more meta about object.
    let meta = o.metadata().await?;
    let mode = meta.mode();
    let length = meta.content_length();
    let content_md5 = meta.content_md5();
    let etag = meta.etag();

    // Delete object.
    o.delete().await?;

    // List dir object.
    let o = op.object("test_dir/");
    let mut os = o.list().await?;
    while let Some(entry) = os.try_next().await? {
        let path = entry.path();
        let mode = entry.mode().await?;
    }

    Ok(())
}

More examples could be found at Documentation.

Projects

  • Databend: A modern Elasticity and Performance cloud data warehouse.
  • GreptimeDB: An open-source, cloud-native, distributed time-series database.
  • deepeth/mars: The powerful analysis platform to explore and visualize data from blockchain.

Contributing

Check out the CONTRIBUTING.md guide for more details on getting started with contributing to this project.

Getting help

Submit issues for bug report or asking questions in discussion.

License