Google Git
Sign in
apache / iceberg-go / refs/heads/main
commit4929eea964305e33bd7ef930f2d6483c021df9b6[log] [tgz]
authorMatt Topol <zotthewizard@gmail.com>Wed Oct 09 10:52:53 2024 -0600
committerGitHub <noreply@github.com>Wed Oct 09 18:52:53 2024 +0200
tree0131a7ec636fd3800ba0de6d4f81b58bfa5160f1
parent2f43ed7c42d6bec2e95126ccc7005fa8d3bfeb56 [diff]
feat(table): add conversion from Arrow Schema to Iceberg (#155)
19 files changed
tree: 0131a7ec636fd3800ba0de6d4f81b58bfa5160f1
  1. .github/
  2. catalog/
  3. cmd/
  4. dev/
  5. internal/
  6. io/
  7. table/
  8. .asf.yaml
  9. .gitattributes
  10. .gitignore
  11. .pre-commit-config.yaml
  12. errors.go
  13. exprs.go
  14. exprs_test.go
  15. go.mod
  16. go.sum
  17. LICENSE
  18. literals.go
  19. literals_test.go
  20. manifest.go
  21. manifest_test.go
  22. NOTICE
  23. operation_string.go
  24. partitions.go
  25. partitions_test.go
  26. predicates.go
  27. README.md
  28. schema.go
  29. schema_test.go
  30. transforms.go
  31. transforms_test.go
  32. types.go
  33. types_test.go
  34. utils.go
  35. visitors.go
  36. visitors_test.go
README.md

Iceberg Golang

Go Reference

iceberg is a Golang implementation of the Iceberg table spec.

Build From Source

Prerequisites

  • Go 1.21 or later

Build

$ git clone https://github.com/apache/iceberg-go.git
$ cd iceberg-go/cmd/iceberg && go build .

Feature Support / Roadmap

FileSystem Support

Filesystem TypeSupported
S3X
Google Cloud Storage
Azure Blob Storage
Local FilesystemX

Metadata

OperationSupported
Get SchemaX
Get SnapshotsX
Get Sort OrdersX
Get Partition SpecsX
Get ManifestsX
Create New ManifestsX
Plan Scan
Plan Scan for Snapshot

Catalog Support

OperationRESTHiveDynamoDBGlue
Load TableX
List TablesX
Create Table
Update Current Snapshot
Create New Snapshot
Rename Table
Drop Table
Alter Table
Set Table Properties
Create Namespace
Drop Namespace
Set Namespace Properties

Read/Write Data Support

  • No intrinsic support for reading/writing data yet
  • Data can be manually read currently by retrieving data files via Manifests.
  • Plan to add Apache Arrow support eventually.

Get in Touch