Manifests

Manifests describe datasets and their contents.

Manifest Message

message Manifest {
  string id = 1;
  string name = 2;
  string version = 3;
  repeated DataFile files = 4;
  ManifestMetadata metadata = 5;
}

message DataFile {
  string path = 1;
  FileFormat format = 2;
  int64 size_bytes = 3;
  string checksum = 4;
  int64 row_count = 5;
}

Purpose

• Discovery: What data is available?
• Versioning: Which version?
• Integrity: Checksums for validation
• Metadata: Schema, row counts, date ranges

Example

{
  "id": "radar-form4-2025q1",
  "name": "Radar Form 4 - Q1 2025",
  "version": "1.0.0",
  "files": [
    {
      "path": "events.parquet",
      "format": "PARQUET",
      "size_bytes": 156789012,
      "checksum": "sha256:abc123",
      "row_count": 125000
    }
  ],
  "metadata": {
    "start_date": "2025-01-01",
    "end_date": "2025-03-31"
  }
}

File Formats

Format	Description
PARQUET	Columnar analytics
CSV	Universal compatibility
JSON	Human readable
PROTO	Binary protobuf