tag | 6ed4bb056b84b9023997fe0d0a0b1c9d7081a63a | |
---|---|---|
tagger | Fokko Driesprong <fokko@apache.org> | Mon Oct 13 19:51:39 2025 +0200 |
object | c082326e5d23ff0b2e10ec09847e6e943f0d1860 |
Release v0.4.0
commit | c082326e5d23ff0b2e10ec09847e6e943f0d1860 | [log] [tgz] |
---|---|---|
author | Matt Topol <zotthewizard@gmail.com> | Thu Oct 09 16:46:36 2025 -0400 |
committer | GitHub <noreply@github.com> | Thu Oct 09 13:46:36 2025 -0700 |
tree | 340c54ba730b2b6d5832574b2de27a8a3a940562 | |
parent | 325414ae39f9dd38063aef8b6305bb484a8ea601 [diff] |
fix(table): writing map column with multiple entries in a row (#598) fixes #595 Turns out we were incorrectly constructing the Map column inside of `ToRequestedSchema`. I also discovered a potential memory leak while testing this and fixed that with an added `defer batch.Release()` to correctly handle references.
iceberg
is a Golang implementation of the Iceberg table spec.
$ git clone https://github.com/apache/iceberg-go.git $ cd iceberg-go/cmd/iceberg && go build .
Filesystem Type | Supported |
---|---|
S3 | X |
Google Cloud Storage | X |
Azure Blob Storage | X |
Local Filesystem | X |
Operation | Supported |
---|---|
Get Schema | X |
Get Snapshots | X |
Get Sort Orders | X |
Get Partition Specs | X |
Get Manifests | X |
Create New Manifests | X |
Plan Scan | x |
Plan Scan for Snapshot | x |
Operation | REST | Hive | Glue | SQL |
---|---|---|---|---|
Load Table | X | X | X | |
List Tables | X | X | X | |
Create Table | X | X | X | |
Register Table | X | X | ||
Update Current Snapshot | X | X | X | |
Create New Snapshot | X | X | X | |
Rename Table | X | X | X | |
Drop Table | X | X | X | |
Alter Table | X | X | X | |
Check Table Exists | X | X | X | |
Set Table Properties | X | X | X | |
List Namespaces | X | X | X | |
Create Namespace | X | X | X | |
Check Namespace Exists | X | X | X | |
Drop Namespace | X | X | X | |
Update Namespace Properties | X | X | X | |
Create View | X | X | ||
Load View | X | |||
List View | X | X | ||
Drop View | X | X | ||
Check View Exists | X | X |
As long as the FileSystem is supported and the Catalog supports altering the table, the following tracks the current write support:
Operation | Supported |
---|---|
Append Stream | X |
Append Data Files | X |
Rewrite Files | |
Rewrite manifests | |
Overwrite Files | |
Write Pos Delete | |
Write Eq Delete | |
Row Delta |
Run go build ./cmd/iceberg
from the root of this repository to build the CLI executable, alternately you can run go install github.com/apache/iceberg-go/cmd/iceberg
to install it to the bin
directory of your GOPATH
.
The iceberg
CLI usage is very similar to pyiceberg CLI
You can pass the catalog URI with --uri
argument.
Example: You can start the Iceberg REST API docker image which runs on default in port 8181
docker pull apache/iceberg-rest-fixture:latest docker run -p 8181:8181 apache/iceberg-rest-fixture:latest
and run the iceberg
CLI pointing to the REST API server.
./iceberg --uri http://0.0.0.0:8181 list ┌─────┐ | IDs | | --- | └─────┘
Create Namespace
./iceberg --uri http://0.0.0.0:8181 create namespace taxitrips
List Namespace
./iceberg --uri http://0.0.0.0:8181 list ┌───────────┐ | IDs | | --------- | | taxitrips | └───────────┘