Google Git Google Git
Sign in
apache/sourcelume-spec

Apache Sourcelume is open-source instrumentation for AI training-data provenance — a metadata specification, a reference registry, and tooling that let dataset curators and model producers publish signed, independently verifiable records of where their data came from and what terms it carries.

Mirrored from https://github.com/apache/sourcelume-spec.git
Clone this repo:

Branches

  1. 1a94432 Generate field references for all record schemas (#12) by Calvin Kirs · 5 days ago main
  2. 69492ce State that one IRI denotes one record and references cross record types (#11) by Achim Nierbeck · 6 days ago
  3. 8ee2b8a Enable github issues support by jgoodyear · 7 days ago
  4. b5ab8e7 [DISCUSS] Add TrainingProvenanceRecord: which datasets a model was trained on (#10) by Achim Nierbeck · 13 days ago
  5. ce1417d Add contentCreatedEnd and require @context (follow-up to #8) (#9) by Achim Nierbeck · 3 weeks ago

Apache Sourcelume — Spec (sourcelume-spec)

Overview

This repository contains our Apache Sourcelume specification.

ssourcelume-spec/
├── LICENSE                     # Apache 2.0 (code/tooling)
├── README.md
├── NOTICE                      # required for ASF releases
├── CHANGELOG.md
├── context/
│   ├── 0.0.1/
│   │   └── sourcelume.jsonld    # the JSON-LD @context document, pinned
│   └── latest -> 0.0.1/        # symlink or redirect, NOT a moving target for actual releases
├── schema/
│   ├── 0.0.1/
│   │   ├── sourcelume.schema.json   # JSON Schema for structural validation (ProvenanceRecord)
│   │   ├── sourcelume-training.schema.json   # JSON Schema for TrainingProvenanceRecord
│   │   └── sourcelume.shacl.ttl     # SHACL shapes for RDF-level validation (optional but common for JSON-LD vocabs)
│   └── ...
├── spec/                         # the prose specification
│   ├── 0.0.1/
│   │   └── index.md (or .adoc)   # human-readable spec text, versioned alongside schema
├── examples/
│   ├── minimal-record.jsonld
│   ├── full-provenance-card.jsonld
│   └── crosswalk/                # worked examples showing mapping to Croissant / SPDX / OTDI fields
├── mappings/
│   ├── croissant-crosswalk.md
│   ├── spdx-ai-profile-crosswalk.md
│   └── otdi-crosswalk.md
├── tools/
│   ├── validate.py               # or JS — validates examples/ against schema/shacl on every PR
│   └── render-docs.py            # generates human-readable HTML/MD from schema
├── .github/workflows/
│   └── validate.yml              # CI: lint JSON-LD, run schema+SHACL validation, check examples
└── .gitignore

Versioning

This project follows Semantic Versioning. See VERSIONING.md for how MAJOR, MINOR, and PATCH apply to specification changes, and for the rules around the latest pointer and immutable released versions.

Get involved

License

This project is licensed under Apache License, Version 2.0.