tag | 5371c57aaf04e031b63d293de22dec8b1691c223 | |
---|---|---|
tagger | Matt Topol <zotthewizard@gmail.com> | Thu Mar 20 13:46:59 2025 -0400 |
object | cfd2c3ba2b61106bbbfdd1c0d045cc467c42c4e0 |
0.2.0 RC1
commit | cfd2c3ba2b61106bbbfdd1c0d045cc467c42c4e0 | [log] [tgz] |
---|---|---|
author | Matt Topol <zotthewizard@gmail.com> | Thu Mar 20 13:45:22 2025 -0400 |
committer | GitHub <noreply@github.com> | Thu Mar 20 13:45:22 2025 -0400 |
tree | f8682ef4a47be82a945082b90ebcfb37ffdbe7ab | |
parent | bb9a18fda1970b482b41642f35feaed43e7aaa21 [diff] |
fix(catalog): add rest integration write test (#352) Includes a few fixes that were found when writing the test
iceberg
is a Golang implementation of the Iceberg table spec.
$ git clone https://github.com/apache/iceberg-go.git $ cd iceberg-go/cmd/iceberg && go build .
Filesystem Type | Supported |
---|---|
S3 | X |
Google Cloud Storage | X |
Azure Blob Storage | |
Local Filesystem | X |
Operation | Supported |
---|---|
Get Schema | X |
Get Snapshots | X |
Get Sort Orders | X |
Get Partition Specs | X |
Get Manifests | X |
Create New Manifests | X |
Plan Scan | x |
Plan Scan for Snapshot | x |
Operation | REST | Hive | DynamoDB | Glue | SQL |
---|---|---|---|---|---|
Load Table | X | X | X | ||
List Tables | X | X | X | ||
Create Table | X | X | X | ||
Update Current Snapshot | X | ||||
Create New Snapshot | X | ||||
Rename Table | X | X | X | ||
Drop Table | X | X | X | ||
Alter Table | X | X | |||
Set Table Properties | X | X | |||
Create Namespace | X | X | X | ||
Check Namespace Exists | X | X | X | ||
Drop Namespace | X | X | X | ||
Set Namespace Properties | X | X | X | ||
List View | X | ||||
Drop View | X | ||||
Check View Exists | X |
As long as the FileSystem is supported and the Catalog supports altering the table, the following tracks the current write support:
Operation | Supported |
---|---|
Append Stream | |
Append Data Files | X |
Rewrite Files | |
Rewrite manifests | |
Overwrite Files | |
Write Pos Delete | |
Write Eq Delete | |
Row Delta |
Run go build ./cmd/iceberg
from the root of this repository to build the CLI executable, alternately you can run go install github.com/apache/iceberg-go/cmd/iceberg
to install it to the bin
directory of your GOPATH
.
The iceberg
CLI usage is very similar to pyiceberg CLI
You can pass the catalog URI with --uri
argument.
Example: You can start the Iceberg REST API docker image which runs on default in port 8181
docker pull apache/iceberg-rest-fixture:latest docker run -p 8181:8181 apache/iceberg-rest-fixture:latest
and run the iceberg
CLI pointing to the REST API server.
./iceberg --uri http://0.0.0.0:8181 list ┌─────┐ | IDs | | --- | └─────┘
Create Namespace
./iceberg --uri http://0.0.0.0:8181 create namespace taxitrips
List Namespace
./iceberg --uri http://0.0.0.0:8181 list ┌───────────┐ | IDs | | --------- | | taxitrips | └───────────┘