* feat(import): import skattekontoutdrag files into the skattekonto pipeline Users can now upload the kontohändelse export from Skatteverket's skattekonto e-service (current CSV layout, verified against a real 2026-08 export, plus legacy .skv files) instead of needing the paid API connection. Parsed rows land in skattekonto_transactions as booked file_import rows and inherit the existing 1630 rules engine, bulk booking, match-to-verifikat and both UIs unchanged. - Core parser lib/import/skattekonto-file/ with strict detection (orgnr header + saldo markers, or two distinct SKV vocabulary terms plus row shape), sum-integrity check (opening + rows must equal closing) and a wrong-company guard against company_settings. - computeDedupKey moves to core (lib/skatteverket/skattekonto-dedup); the extension re-imports it. File rows hash-key; content-signature partitioning skips rows already booked (either key form) and promotes matching upcoming rows in place. - syncSkattekonto gains a takeover step: an id-keyed API row adopts a matching hash-keyed imported row in place, so journal links survive connecting the API after a file import. Upcoming rows can no longer clobber a booked row on hash collision. - New skattekonto_file_imports table (company-scoped file-hash dedup) plus source/file_import_id provenance columns on skattekonto_transactions. - /import gains a Skattekontoutdrag wizard (upload/preview/result, deep link ?mode=skattekonto); the bank-file flow detects skattekonto files and redirects instead of importing them as bank rows. - /skattekonto renders imported rows for unconnected companies (attn line + import CTA) instead of discarding them behind the StartCard. - Free for everyone: the local-data booking/match routes were already ungated; only API sync/saldo stay capability-gated. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> * fix(skattekonto): align the EF F-skatt rule with the 2012 -> 2013 decision 20260810120000 established that 2012 is not standard BAS and moved the booking templates to 2013 (owner taxes in an enskild firma are an eget uttag), but the skattekonto_rules seed still booked EF preliminarskatt against 2012. The file importer makes this rule fire for every EF F-skatt row, so bring it onto 2013 too. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> * fix(import): apply review findings on the skattekonto file import - Fix the takeover candidate comparator: the single-argument sort was an inconsistent relation and could adopt a stale upcoming row ahead of the booked file row in a 3+ candidate queue (regression test added), and page the candidate scan with fetchAllRows so a multi-year window is not silently capped at 1000 rows. - Fail parsing when a statement HAS saldo markers but not both readable balances: a file cut off before "Utgående saldo" previously skipped the sum check entirely. sum_valid stays null only for marker-less legacy files. - Count a promotion only when the UPDATE matched a row, so a concurrent sync cannot inflate promoted_count; log a failed finalize of the import record instead of discarding the error. - Migration (unshipped, edited in place): user_id is nullable with ON DELETE SET NULL so import records and their file-hash dedup survive user deletion, and the INSERT policy binds user_id to auth.uid() so a member cannot attribute an import to a colleague. pg tests cover both. - Make the upload drop zone keyboard-reachable (role, tabIndex, Enter/ Space) and give the six count-bearing strings ICU plural forms in both locales. Skipped with reasons on the PR: binding execute rows to file bytes and re-checking orgnr in execute (same client-trust model as the shipped bank-file execute; Zod + RLS scope writes to the caller's own company), a 404 test (the route has no not-found path), event-bus clearing in the route test (the route touches no events), and FK NOT VALID (new column referencing a brand-new empty table). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> --------- Co-authored-by: Jakob Wennberg <311770904+jakobwennberg-oss@users.noreply.github.com> Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
102 lines
3.9 KiB
TypeScript
102 lines
3.9 KiB
TypeScript
import { NextResponse } from 'next/server'
|
|
import { parseBankFile, generateFileHash, detectFileFormat } from '@/lib/import/bank-file/parser'
|
|
import { detectSkattekontoFile } from '@/lib/import/skattekonto-file/parser'
|
|
import { decodeFileContent } from '@/lib/import/shared/encoding'
|
|
import { withRouteContext } from '@/lib/api/with-route-context'
|
|
import { errorResponseFromCode } from '@/lib/errors/get-structured-error'
|
|
import type { BankFileFormatId } from '@/lib/import/bank-file/types'
|
|
import { getErrorMessage as getUserErrorMessage } from '@/lib/errors/get-error-message'
|
|
|
|
/**
|
|
* POST /api/import/bank-file/parse
|
|
*
|
|
* Accepts a bank file (CSV/XML) via FormData, auto-detects format, and returns
|
|
* a parsed transactions preview with duplicate detection.
|
|
*/
|
|
export const POST = withRouteContext(
|
|
'bank_file.parse',
|
|
async (request, ctx) => {
|
|
const { supabase, companyId, log, requestId } = ctx
|
|
|
|
const formData = await request.formData()
|
|
const file = formData.get('file') as File | null
|
|
const formatOverride = formData.get('format') as BankFileFormatId | null
|
|
|
|
if (!file) {
|
|
return errorResponseFromCode('BANK_FILE_NO_FILE', log, { requestId })
|
|
}
|
|
|
|
if (file.size > 10 * 1024 * 1024) {
|
|
return errorResponseFromCode('BANK_FILE_TOO_LARGE', log, {
|
|
requestId,
|
|
details: { sizeMb: +(file.size / 1024 / 1024).toFixed(1) },
|
|
})
|
|
}
|
|
|
|
const opLog = log.child({ filename: file.name, sizeBytes: file.size })
|
|
|
|
try {
|
|
const arrayBuffer = await file.arrayBuffer()
|
|
const content = decodeFileContent(arrayBuffer)
|
|
const fileHash = generateFileHash(content)
|
|
|
|
const { data: existingImport } = await supabase
|
|
.from('bank_file_imports')
|
|
.select('id, status, imported_count, created_at')
|
|
.eq('company_id', companyId)
|
|
.eq('file_hash', fileHash)
|
|
.single()
|
|
|
|
if (existingImport && existingImport.status === 'completed') {
|
|
return errorResponseFromCode('BANK_FILE_DUPLICATE', opLog, {
|
|
requestId,
|
|
details: {
|
|
importId: existingImport.id,
|
|
importedCount: existingImport.imported_count,
|
|
importedAt: existingImport.created_at,
|
|
},
|
|
})
|
|
}
|
|
|
|
// A skattekontoutdrag is not a bank statement: its rows belong on the
|
|
// skattekonto (1630), not on a bank account. Redirect the user to the
|
|
// dedicated importer. An explicit format override still forces a bank
|
|
// parse as the escape hatch.
|
|
if (!formatOverride && detectSkattekontoFile(content, file.name)) {
|
|
return errorResponseFromCode('BANK_FILE_SKATTEKONTO_DETECTED', opLog, { requestId })
|
|
}
|
|
|
|
const detectedFormat = formatOverride
|
|
? null
|
|
: detectFileFormat(content, file.name)
|
|
|
|
const parseResult = parseBankFile(content, file.name, formatOverride || undefined)
|
|
|
|
// Per-row duplicate detection deliberately does NOT live here: the
|
|
// wizard calls POST /api/import/bank-file/check-duplicates after every
|
|
// (re-)parse, including the client-side generic_csv re-parse that never
|
|
// hits this route. The old existing_transaction_count field (a raw count
|
|
// of ALL transactions in the date range) was consumed by nothing and has
|
|
// been removed.
|
|
return NextResponse.json({
|
|
data: {
|
|
parse_result: parseResult,
|
|
detected_format: detectedFormat?.id || formatOverride || null,
|
|
detected_format_name: detectedFormat?.name || parseResult.format_name,
|
|
file_hash: fileHash,
|
|
filename: file.name,
|
|
headers: parseResult.format === 'generic_csv'
|
|
? content.split('\n')[0]?.split(',').map((h) => h.trim()) || []
|
|
: null,
|
|
},
|
|
})
|
|
} catch (err) {
|
|
opLog.error('bank file parse failed', err as Error)
|
|
return errorResponseFromCode('BANK_FILE_PARSE_FAILED', opLog, {
|
|
requestId,
|
|
details: { reason: err instanceof Error ? getUserErrorMessage(err) : 'unknown' },
|
|
})
|
|
}
|
|
},
|
|
)
|