tree: 33dd8e47298c8b71ecc50ee98a332301ab26f86e [search]
  1. data-v3-encrypted.parquet
  2. dv-v3-encrypted.puffin
  3. manifest-list-v3-encrypted.avro
  4. manifest-v3-encrypted.avro
  5. README.md
tests/table/encryption/README.md

Encrypted test data

manifest-list-v3-encrypted.avro is an empty manifest list encrypted by iceberg-rust, copied from its crates/iceberg/testdata/manifests_lists/. It was written by iceberg-rust's EncryptionManager, with a memory KMS holding master key master-1 = bytes 0x00 to 0x0f. Its keys and snapshot are in the example_table_metadata_v3_encrypted fixture in tests/conftest.py.

manifest-v3-encrypted.avro is a v3 data manifest with two added entries, written and encrypted by iceberg-rust's ManifestWriter with key 0123456789abcdef and AAD prefix fedcba9876543210. The key metadata that its manifest list entry would record is in test_read_manifest_encrypted_by_iceberg_rust in tests/utils/test_manifest.py.

data-v3-encrypted.parquet is a Parquet data file with three rows, written and encrypted by iceberg-rust's ParquetWriter with a key from its EncryptionManager. The key metadata that its manifest entry would record is in test_task_to_record_batches_encrypted_by_iceberg_rust in tests/io/test_pyarrow.py.

dv-v3-encrypted.puffin is a Puffin file with one deletion vector, deleting positions 1, 3 and 5 of s3://bucket/table/data/00000.parquet. It was written and encrypted by iceberg-rust's PuffinWriter with key 0123456789abcdef and AAD prefix fedcba9876543210. The key metadata that its manifest entry would record is in test_read_deletes_from_puffin_file_encrypted_by_iceberg_rust in tests/io/test_pyarrow.py.