Hero is now a data-native 0pt artifact (no photos, keeps grain/reveal/float); header is the 0pt wordmark with Swedish nav; layout is sv + loads JetBrains Mono + 0pt metadata; globals wires the loaded fonts. Adds CLAUDE.md + docs/01-09 as the build contract. next build green (5 routes). Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
66 lines
4.5 KiB
Markdown
66 lines
4.5 KiB
Markdown
# 07 · Dependencies & repos to import
|
|
|
|
Curated. Each entry: what it is, where it slots in, how to install. **Do not import on reputation/star-count** — several items in earlier brainstorming were unverified or hallucinated (see Exclusions). Verify each repo exists and is maintained before adopting.
|
|
|
|
## Frontend (Next.js on Vercel)
|
|
| Package | Purpose | Install |
|
|
|---|---|---|
|
|
| next, react, typescript | App Router base | `npx create-next-app@latest --ts` |
|
|
| tailwindcss | styling (mono tokens) | per Next setup |
|
|
| shadcn/ui | base components | `npx shadcn@latest init` |
|
|
| @tanstack/react-table **or** ag-grid-react | data tables / catalog grid | `npm i @tanstack/react-table` |
|
|
| @uppy/core @uppy/react @uppy/dashboard @uppy/aws-s3 | file upload → R2 (presigned) | `npm i @uppy/core @uppy/react @uppy/dashboard @uppy/aws-s3` |
|
|
| next-auth (Auth.js) + @auth/pg-adapter | single auth, Postgres-backed | `npm i next-auth @auth/pg-adapter` |
|
|
| stripe / @stripe/stripe-js | checkout + portal | `npm i stripe @stripe/stripe-js` |
|
|
| resend / react-email | transactional email | `npm i resend @react-email/components` |
|
|
| lenis *(optional)* | smooth scroll (keeps all effects) | `npm i lenis` |
|
|
| recharts *(only if needed)* | charts inside DataArtifact/dashboards | `npm i recharts` |
|
|
|
|
> Catalog/search in v1 = Postgres full-text. Add Meilisearch later only past a few thousand rows.
|
|
|
|
## Backend / workers (Python, FastAPI — existing)
|
|
| Package | Purpose | Install |
|
|
|---|---|---|
|
|
| fastapi, uvicorn, pydantic | API (existing) | `pip install fastapi uvicorn pydantic` |
|
|
| sqlalchemy / asyncpg | Postgres access (align `db.py`) | `pip install sqlalchemy asyncpg` |
|
|
| alembic | migrations | `pip install alembic` |
|
|
| celery + redis **or** existing adaptive_router/queue | job queue/concurrency | `pip install celery redis` |
|
|
| httpx | polite HTTP fetch (identifies itself, obeys rate limits) | `pip install httpx` |
|
|
| scrapy **or** crawlee | orchestrate **authorized** fetches | `pip install scrapy` |
|
|
| playwright | public JS-rendered pages, politely | `pip install playwright && playwright install chromium` |
|
|
| unstructured | parse PDF/HTML/DOCX/images → elements | `pip install "unstructured[all-docs]"` |
|
|
| paddleocr / pytesseract | OCR cascade | `pip install paddleocr pytesseract` (+ tesseract bin) |
|
|
| spacy (+ models) / transformers | NER, entity resolution (multilingual) | `pip install spacy transformers` |
|
|
| polars | fast tabular processing | `pip install polars` |
|
|
| rapidfuzz | dedup / fuzzy matching | `pip install rapidfuzz` |
|
|
| great-expectations | data quality checks in pipeline | `pip install great-expectations` |
|
|
| dbt-postgres *(optional)* | transform layer | `pip install dbt-postgres` |
|
|
| pgvector (Postgres ext) | embeddings/matching | `CREATE EXTENSION vector;` |
|
|
| boto3 *(or aioboto3)* | R2 (S3-compatible) | `pip install boto3` |
|
|
| stripe (python) | webhook handling | `pip install stripe` |
|
|
|
|
## Self-hosted services (docker-compose on the VPS)
|
|
| Service | Purpose | Image |
|
|
|---|---|---|
|
|
| **NocoDB** | Airtable-style views over existing Postgres tables; embedded "Min data" | `nocodb/nocodb` |
|
|
| **Metabase** | customer-facing dashboards; embedded | `metabase/metabase` |
|
|
| **Postgres** *(or Neon managed)* | backbone (+ pgvector) | `pgvector/pgvector:pg16` |
|
|
| **Redis** *(if Celery)* | queue | `redis` |
|
|
| **Meilisearch** *(later)* | catalog search at scale | `getmeili/meilisearch` |
|
|
|
|
## External managed (free/cheap tiers)
|
|
- **Vercel** — Next.js hosting.
|
|
- **Cloudflare R2** — object storage (presigned URLs).
|
|
- **Stripe** — payments (test mode first).
|
|
- **Resend** — email.
|
|
- **Neon** *(optional)* — managed Postgres.
|
|
|
|
## EXCLUSIONS — do not import
|
|
|
|
- **Bypass/stealth/evasion**: FlareSolverr, "CloakBrowser", undetected-chromedriver/undetected-playwright (as bypass), proxy/fingerprint-rotation engines, any "WAF bypass" repo. Prohibited by CLAUDE.md §1 — they destroy the honest-accuracy positioning and create legal exposure.
|
|
- **Fake-account automation** on Apollo/Cognism/etc.
|
|
- **Unverified / likely-hallucinated** from earlier brainstorming: "CloakBrowser/CloakHQ", "Rota proxy engine", "OpenClaw". Do not adopt unless you confirm a real, maintained project — and even then, not if it falls in the bypass category.
|
|
- **Overlapping tools** already decided against (Superset, DataHub/OpenMetadata, Baserow/Teable, Trigger.dev, Delta Sharing in v1) — see `docs/02-architecture.md`.
|
|
|
|
> Note on real-but-overhyped tools (Firecrawl, browser-use, etc.): they exist, but ignore inflated star-counts and only adopt if they fit a *compliant* role and don't duplicate the stack.
|