feat(ingest): I5 — SQL D7-speil, bygget fra commons-spec alene
Speiler MAF I4 fra shared/ingest-spec.md alene: manifest → SQL-konnektor → materialisert OKF-bundle, byte-identisk med den delte golden-fasiten. Gaten I4→I5 verifisert løst mot ground truth (MAF-commits d7e5f2f/4f45fe6/1b7612b) før arbeidet startet. Spec byte-identisk delt, ingen spec-endring (I4). - ingest.py: SqlSource (type: sql, id, connection_ref); ManifestContract.source er nå diskriminert union FileSource | SqlSource på type (http/ukjent tag → fail-fast). _render_sql_cell (§5 typed: NULL→"", int→decimal, float→korteste round-trip, str→verbatim m/ delt _escape_cell, annet→fail — aldri stille coercion). _resolve_connection_ref (env-oppslag §4/§8, usatt → fail-fast). _read_sql (read-only sqlite file:?mode=ro, ett SELECT, max_rows §8). _read_extraction dispatcher på source.type; materialisering/index/replacement uendret fra I3. - examples/ingest-golden-sql/: repo-lokal golden (byte-frossen kopi av I4s fasit). - Speiltester (I4s load-bearing-sett, gjennom SQL-konnektoren, detach-bevist røde): sql-golden byte-fasit + mutasjonskontroller · typed-cell/NULL (NY §I5-søm) · provenance/navigability/verdict-reservasjon/re-ingest-safety · SqlSource-kontrakt/ typed-rendering/connection_ref/max_rows/read-only · spec-integritet utvidet med connection_ref. Stale type:"sql"-avvisningscase erstattet (sql er gyldig post-I5). - docs/2026-07-04-I5-brief.md: brief + premiss-verifisering. Suite 265 passed uten nøkkel/nettverk (239 + 26 nye) · ruff + mypy --strict rene. [skip-docs] README + docs/extending.md er bevisst utsatt til I7 per sesjonsplan (programmet batcher ingest-doc der, avgrenset til det D7 faktisk har — CSV + SQL nå, HTTP/MCP kun pekere). Dokumentert i docs/2026-07-04-I5-brief.md. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_017MM6BWb1hWmJZuXFZ7rjxT
This commit is contained in:
parent
e03bd79876
commit
32640deffc
13 changed files with 615 additions and 9 deletions
3
examples/ingest-golden-sql/expected-bundle/index.md
Normal file
3
examples/ingest-golden-sql/expected-bundle/index.md
Normal file
|
|
@ -0,0 +1,3 @@
|
|||
Golden extraction case: two SQL extracts from a local project database (sql source type).
|
||||
- [Project costs](ingest-costs.md)
|
||||
- [Catalogue metadata](ingest-meta.md)
|
||||
15
examples/ingest-golden-sql/expected-bundle/ingest-costs.md
Normal file
15
examples/ingest-golden-sql/expected-bundle/ingest-costs.md
Normal file
|
|
@ -0,0 +1,15 @@
|
|||
---
|
||||
type: dataset
|
||||
title: Project costs
|
||||
source_system: portefolje-db
|
||||
source_query: SELECT id, item, amount, note FROM costs ORDER BY id
|
||||
ingested_at: 2026-07-04T12:00:00Z
|
||||
ingest_manifest: manifest@a4b891aea55df97b
|
||||
generated: true
|
||||
---
|
||||
|
||||
| id | item | amount | note |
|
||||
| --- | --- | --- | --- |
|
||||
| 1 | LED-armatur | 1200.5 | godkjent |
|
||||
| 2 | sensor | 89.9 | |
|
||||
| 3 | kabel | 4200.0 | rest |
|
||||
14
examples/ingest-golden-sql/expected-bundle/ingest-meta.md
Normal file
14
examples/ingest-golden-sql/expected-bundle/ingest-meta.md
Normal file
|
|
@ -0,0 +1,14 @@
|
|||
---
|
||||
type: reference
|
||||
title: Catalogue metadata
|
||||
source_system: portefolje-db
|
||||
source_query: SELECT k, v FROM meta ORDER BY k
|
||||
ingested_at: 2026-07-04T12:00:00Z
|
||||
ingest_manifest: manifest@a4b891aea55df97b
|
||||
generated: true
|
||||
---
|
||||
|
||||
| k | v |
|
||||
| --- | --- |
|
||||
| owner | anlegg \| drift |
|
||||
| path | c:\\temp |
|
||||
BIN
examples/ingest-golden-sql/fixture/portefolje.sqlite
Normal file
BIN
examples/ingest-golden-sql/fixture/portefolje.sqlite
Normal file
Binary file not shown.
1
examples/ingest-golden-sql/ingested-at.txt
Normal file
1
examples/ingest-golden-sql/ingested-at.txt
Normal file
|
|
@ -0,0 +1 @@
|
|||
2026-07-04T12:00:00Z
|
||||
21
examples/ingest-golden-sql/manifest.json
Normal file
21
examples/ingest-golden-sql/manifest.json
Normal file
|
|
@ -0,0 +1,21 @@
|
|||
{
|
||||
"manifest_version": 1,
|
||||
"source": {"type": "sql", "id": "portefolje-db", "connection_ref": "PORTEFOLJE_SQL_DSN"},
|
||||
"bundle_summary": "Golden extraction case: two SQL extracts from a local project database (sql source type).",
|
||||
"extractions": [
|
||||
{
|
||||
"id": "costs",
|
||||
"title": "Project costs",
|
||||
"query": "SELECT id, item, amount, note FROM costs ORDER BY id",
|
||||
"okf_type": "dataset",
|
||||
"max_rows": 10
|
||||
},
|
||||
{
|
||||
"id": "meta",
|
||||
"title": "Catalogue metadata",
|
||||
"query": "SELECT k, v FROM meta ORDER BY k",
|
||||
"okf_type": "reference",
|
||||
"max_rows": 10
|
||||
}
|
||||
]
|
||||
}
|
||||
Loading…
Add table
Add a link
Reference in a new issue