Merges github/main (6 commits: 17-bug audit fix, CI quality gate,
.env.example + .gitignore fix, missing platform clients + registry
services, docs accuracy overhaul) into gitea/main (8 commits: Iceberg
write boundary + live ST0RE verification, lakehouse mapping routes,
Waves 1-4 foundational hardening).
16 conflicts. Both sides had independently written the four
src/clients/*.ts and the two registry services, so those are combined
rather than picked:
- st0re-client.ts: GitHub's endpoint wins on evidence. POST goes to
/v1/st0re/artifacts/register, not /v1/st0re/artifacts -- verified in
sax3l/st0re src/api/routes/artifacts.ts, where the bare path is a
GET-only list route. Gitea's URL normalisation, error-body text and
mock kept.
- n0d-client.ts: field is `status`, not `state`, with N0D's real 13-state
union -- verified in sax3l/n0d packages/schemas/n0d.job.schema.json,
which says explicitly not to add "succeeded". Gitea's mock echo,
URL normalisation and error-body text kept.
- cl0ud-client.ts: Gitea's fail-closed HTTP normalisation kept (a 200
with no `decision` reads as "deny", not as a silent allow). GitHub's
PolicyDecision/PolicyDecisionValue naming kept; PolicyResult retained
as an alias.
- aud0-client.ts: permissive union of both input types (optional
payload/metadata/correlation_id), GitHub's echo return, Gitea's URL
normalisation and error-body text, plus a JSON-parse fallback so a
successful POST with an empty body does not throw.
- dataset-service.ts / source-service.ts: GitHub's record/DTO split and
event naming (0pt.source_created / 0pt.create_source, which the merged
docs already reference) plus Gitea's name validation, description /
created_by fields and actor_id derivation. List filters are the union.
- lakehouse mapping routes: GitHub's shared lakehouse-mapping-registry
singletons (without which every write 400'd "mapping not found") AND
Gitea's Zod parseBody validation. Both, not either.
- src/types/source.ts, src/types/dataset.ts: unions of both vocabularies;
GitHub's `access` legal-sourcing field kept.
- .env.example: GitHub's audited inventory plus Gitea's Zitadel /
AUTH_ENFORCE block.
- CLAUDE.md, docs/ICEBERG_WRITE_BOUNDARY.md: GitHub's corrections kept,
Gitea's live-verification kept and marked as superseding the
"would 400 outright" finding (Gitea had already added the required
X-Tenant-Id/X-Actor-Id headers).
- pnpm-lock.yaml: regenerated with pnpm 9.15.9, not merged.
Also corrects CLAUDE.md's claim that the banned services/scrapers stack
was "since removed" -- the removal PR is open, not merged, and this
branch inherits that code from Gitea main. Nothing here resurrects,
extends or re-wires any of it; services/scrapers/ is byte-identical to
Gitea main.
Verified on the merged tree: typecheck (src/ + tests/) clean;
17 test files, 121 passed, 1 skipped (the realinfra test skipping
honestly on ST0RE HTTP 401), 0 failures. Gitea main baseline was the
same 121/1; GitHub main baseline could not even `pnpm install`
("packages field missing or empty") -- Gitea's pnpm-workspace.yaml fix
resolves that. Whole-repo `typecheck:app` reports 9 errors, an identical
set to Gitea main's baseline, so it is advisory in both CI workflows
rather than deleted. Lint: 16 problems, identical to Gitea baseline.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
40 lines
2.3 KiB
JSON
40 lines
2.3 KiB
JSON
{
|
|
"$id": "0pt.iceberg_table.schema.v1",
|
|
"description": "NON-AUTHORITATIVE READ CACHE ONLY. ST0RE owns Iceberg table/catalog/snapshot state (docs/ICEBERG_WRITE_BOUNDARY.md, src/clients/st0re-lakehouse-client.ts's St0reIcebergTable). This schema mirrors that shape for tests/p0/enterprise-data-os-expansion.test.ts's contract assertions from an earlier pass; 0pt must never write to it as a second copy of ST0RE's table registry -- see docs/ICEBERG_WRITE_BOUNDARY.md's 'A pre-existing artifact' section.",
|
|
"type": "object",
|
|
"required": [
|
|
"table_id",
|
|
"tenant_id",
|
|
"project_id",
|
|
"table_name",
|
|
"namespace",
|
|
"storage_uri",
|
|
"catalog_ref",
|
|
"table_format",
|
|
"status",
|
|
"created_at"
|
|
],
|
|
"properties": {
|
|
"table_id": { "type": "string", "description": "Reference into ST0RE's table registry (IcebergTable.tableId, st0re_iceberg_tables)." },
|
|
"tenant_id": { "type": "string" },
|
|
"project_id": { "type": "string" },
|
|
"table_name": { "type": "string" },
|
|
"namespace": { "type": "string", "description": "ST0RE lakehouse namespace name." },
|
|
"storage_uri": { "type": "string", "description": "Object-store URI for the table's data/metadata, e.g. s3://siax-tenants/.../table." },
|
|
"catalog_ref": { "type": "string", "description": "Opaque reference into the external Iceberg catalog — ST0RE does not resolve it." },
|
|
"dataset_id": { "type": "string", "description": "ST0RE's OWN dataset foreign key as mirrored from its table row — NOT 0pt's dataset_id. 0pt must never send its own dataset_id here (it 400s with a Postgres FK violation); the 0pt-side dataset<->table link lives in DatasetIcebergMapping.iceberg_table_id. See docs/ICEBERG_WRITE_BOUNDARY.md." },
|
|
"table_format": { "type": "string", "enum": ["iceberg", "delta", "hudi"] },
|
|
"current_snapshot_id": { "type": "string" },
|
|
"schema_version": { "type": "string" },
|
|
"partition_spec": { "type": "array", "items": { "type": "string" } },
|
|
"retention_policy": { "type": "string" },
|
|
"data_residency": { "type": "string" },
|
|
"pii_level": { "type": "string", "enum": ["none", "low", "medium", "high"] },
|
|
"owner_product": { "type": "string" },
|
|
"status": { "type": "string", "enum": ["active", "deprecated", "archived"] },
|
|
"correlation_id": { "type": "string" },
|
|
"created_at": { "type": "string" },
|
|
"created_by": { "type": "string" }
|
|
}
|
|
}
|