opt-vehiq-work salvage
1d63f63dfd
This snapshot was found sitting uncommitted in a stale /opt/vehiq-work lane clone dated ~2026-09-09..18, base branch: feat/p060-p068-ingestion-plane. Not reviewed, not verified against current main. Pushed only so the directory could be deleted without losing the diff.
0pt data engine (services/api)
The governed data motor (docs/06). FastAPI orchestrator + worker pipeline that turn
configured sources into delivered, provenance-tagged data. Runs on a VPS via
../../infra/docker-compose.yml — not on Vercel (long jobs).
Sourcing and transport boundary
Per field × market, the standard profile prefers official API/bulk → public web → partner data → otherwise level 0 "ej tillgänglig". We never invent values.
Canonical ownership: WAF/challenge handling, FlareSolverr-compatible adapters, stealth browsers, proxy/fingerprint rotation, authenticated sessions and account automation are valid optional profiles owned by b0ts + 1p. They are selected through explicit contracts and are not duplicated inside the standard 0pt worker pipeline.
Layout
sources/connectors.py— compliant connectors (GLEIF, Brønnøysund, Companies House live; PRH/CVR/Bolagsverket gated on verified terms → level 0 until wired).sources/sources.yaml— source registry (access/licence/cadence; VERIFY terms).orchestrator/main.py— REST API (health, sources, estimates, orders, jobs) per docs/04.workers/adaptive_router.py— picks the cheapest standard method per market (api > bulk > authorized_web > licensed). High-risk transport profiles are delegated to b0ts + 1p.workers/pipeline.py— sourcing → extraction → structuring (dedup) → enrichment/fusion → QA (drops rows below the order's confidence target). Writes provenance per field.
Run locally
pip install -r requirements.txt
uvicorn orchestrator.main:app --reload # API on :8000
python -m workers.run # run one demo job
Reconciliation note
Supersedes the earlier nordic-eu-data-platform backend: the compliant connectors +
pipeline are migrated here; FlareSolverr/stealth/proxy/account-session paths and the
test_bypass_chain/test_proxy_pool examples belong to b0ts + 1p instead of being
duplicated in this package.