* feat(ai): resolve the Claude backend from the environment Tier 1 of #1406: a self-hosted deployment can now run every AI feature on a plain ANTHROPIC_API_KEY, with no AWS account. Hosted behaviour is unchanged. lib/ai/provider.ts resolves the backend once, from the environment: AI_PROVIDER explicit override, bedrock|anthropic AWS static key pair Bedrock ANTHROPIC_API_KEY the direct Anthropic API nothing set Bedrock, so the AWS credential provider chain (instance profile, IRSA) still resolves Bedrock deliberately wins when both credential sets are present. EU residency in eu-north-1 is a BFL/GDPR posture rather than a default, so adding an Anthropic key for an experiment must not silently move production inference out of the region. AI_PROVIDER is the way to say you meant it. Model ids are written bare in code and prefixed to eu.anthropic.* only for Bedrock, which needs the cross-region inference profile for on-demand throughput. An operator override that already carries a prefix passes through untouched, so BEDROCK_MODEL_ID and friends keep working as written. Converted call sites: the agent composer, invoice-inbox extraction, the document-extraction model label, and both receipt-hunt clients. The last two are not named in the issue, which predates receipt-hunt landing in main. @anthropic-ai/sdk is declared at 0.95.0, the version @anthropic-ai/bedrock-sdk 0.29.1 already pulled in transitively, so the lockfile dedupes to one copy with no new download. scripts/smoke-bedrock.ts becomes scripts/smoke-ai.ts and grows two steps. Unit tests can only prove which provider and model id get resolved; they cannot prove the resulting request is one the backend accepts. The script now sends real traffic over all three shapes the app uses: a plain create, a streamed turn carrying adaptive thinking, an effort level, an hour-long cache breakpoint and a tool, and document extraction end to end when given a file. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Signed-off-by: Bjorn Bergenheim <29535152+bjornbergenheim@users.noreply.github.com> * docs(self-hosting): document the AI smoke test The script added alongside the provider split is what closes the #1406 acceptance criterion ("document extraction and the assistant both work"), so a self-hoster needs to know it exists. Covers both invocations and states that it exits non-zero, which is what makes it usable as a post-deploy check. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Signed-off-by: Bjorn Bergenheim <29535152+bjornbergenheim@users.noreply.github.com> * test(ai): split the smoke test's thinking probe from its tool probe The combined probe could not falsify what it claimed to. It asked a question that needs a tool call, so the tool was used and adaptive thinking correctly declined to reason about it: the zero thinking-block count that came back was uninformative rather than a signal. 2a keeps the tool and drops thinking. 2b asks a question with several dependent steps (reverse charge, then a partial deduction, then the affected boxes) so that a model honouring the parameter must reason, and reports the thinking text length as well as the block count, since display:"summarized" can yield blocks with empty text. The cached system prompt is also padded past the 1024-token minimum cacheable prefix. Below that the API caches nothing and reports no error, so the old probe's cache counters read zero whether or not caching worked. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Signed-off-by: Bjorn Bergenheim <29535152+bjornbergenheim@users.noreply.github.com> * fix(document-extraction): stop requiring AWS_REGION in the manifest The extension now needs one of two credential sets, AWS static keys or ANTHROPIC_API_KEY, and the manifest schema cannot express "one of". Since requiredEnvVars only drives a build-time warning and never gates anything, listing AWS_REGION told every self-hoster running the direct API to set a variable that has no effect for them. The description was also still promising Sonnet 4.6 via Bedrock specifically, which is no longer what the extension does. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Signed-off-by: Bjorn Bergenheim <29535152+bjornbergenheim@users.noreply.github.com> * fix(ai): read documentKind defensively in the smoke test The field arrived with the receipt-aware extraction work, so referencing it directly stops the script compiling against any checkout from before that landed. tsconfig includes **/*.ts and next.config does not disable type checking, so on such a checkout this failed the production build rather than just the script: caught while preparing a test branch for a self-hosted instance that had not synced yet. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Signed-off-by: Bjorn Bergenheim <29535152+bjornbergenheim@users.noreply.github.com> * fix(deps): restore the nested @swc/helpers entry in the lockfile Declaring @anthropic-ai/sdk with `npm install --package-lock-only` also pruned node_modules/next-intl/node_modules/@swc/helpers@0.5.23, an optional peer entry the local npm 11 considers redundant and the image's npm 10.9.8 does not. The result passed every local check and failed `npm ci` inside the Docker build, which is the only place the lockfile is actually enforced. The lockfile is now the previous one plus the single root dependency line, verified with `npm ci --dry-run`. @anthropic-ai/sdk needed nothing else: it was already in the tree as a transitive dependency of @anthropic-ai/bedrock-sdk. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Signed-off-by: Bjorn Bergenheim <29535152+bjornbergenheim@users.noreply.github.com> * Update DECISIONS.md Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * Update Docker documentation for AI provider credentials Clarify the role of credentials in AI provider selection and document extraction requirements. * Update SELF-HOSTING.md with smoke-ai script details Clarify usage of smoke-ai script for credential checks and document extraction. * Improve error handling and logging in smoke-ai script * fix(ai): complete plain-key self-hosting path Signed-off-by: Emil <emilmattsson14@gmail.com> --------- Signed-off-by: Bjorn Bergenheim <29535152+bjornbergenheim@users.noreply.github.com> Signed-off-by: Emil <emilmattsson14@gmail.com> Co-authored-by: Bjorn Bergenheim <29535152+bjornbergenheim@users.noreply.github.com> Co-authored-by: Claude Opus 5 <noreply@anthropic.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
122 lines
4.1 KiB
TypeScript
122 lines
4.1 KiB
TypeScript
/**
|
|
* The second opinion on pairs the arithmetic could not settle.
|
|
*
|
|
* These tests are about what the verdict may not do: accept a pair nobody
|
|
* asked about, answer twice, or turn a failed call into approvals. A rejected
|
|
* pair simply does not appear, which leaves the run where the formula left it.
|
|
*/
|
|
import { describe, it, expect, vi, beforeEach } from 'vitest'
|
|
import type { UncertainPair } from '../adjudicate'
|
|
|
|
const mockCreate = vi.fn()
|
|
vi.mock('@/lib/ai/provider', () => ({
|
|
createAiClient: () => ({ messages: { create: (...args: unknown[]) => mockCreate(...args) } }),
|
|
toProviderModelId: (id: string) => id,
|
|
}))
|
|
|
|
import { adjudicate } from '../adjudicate'
|
|
|
|
function toolReply(input: unknown) {
|
|
return { content: [{ type: 'tool_use', name: 'verdicts', id: 'tu', input }] }
|
|
}
|
|
|
|
function pair(key = 't1::d1'): UncertainPair {
|
|
return {
|
|
key,
|
|
purchase: {
|
|
description: 'VERCEL INC',
|
|
amount: 541.2,
|
|
currency: 'SEK',
|
|
date: '2026-07-21',
|
|
},
|
|
receipt: {
|
|
vendor: 'Vercel Inc.',
|
|
total: 54.85,
|
|
currency: 'USD',
|
|
sekTotal: 534.65,
|
|
date: '2026-07-14',
|
|
fileName: 'Receipt-2955-0452.pdf',
|
|
},
|
|
confidence: 0.62,
|
|
matchReasons: ['Belopp ±1%', 'Handlare matchar'],
|
|
}
|
|
}
|
|
|
|
beforeEach(() => vi.clearAllMocks())
|
|
|
|
describe('adjudicate', () => {
|
|
it('returns the pairs it accepted, with the reason a human will read', async () => {
|
|
mockCreate.mockResolvedValue(
|
|
toolReply({
|
|
verdicts: [{ key: 't1::d1', accept: true, reason: 'Samma leverantör, beloppet stämmer efter växelkurs.' }],
|
|
}),
|
|
)
|
|
const out = await adjudicate([pair()])
|
|
expect(out).toHaveLength(1)
|
|
expect(out[0].reason).toContain('växelkurs')
|
|
})
|
|
|
|
it('drops a pair it rejected rather than proposing it anyway', async () => {
|
|
mockCreate.mockResolvedValue(
|
|
toolReply({ verdicts: [{ key: 't1::d1', accept: false, reason: 'Fakturan avser en annan månad.' }] }),
|
|
)
|
|
await expect(adjudicate([pair()])).resolves.toEqual([])
|
|
})
|
|
|
|
it('never accepts a pair nobody asked about', async () => {
|
|
// A key we did not send would attach a document to a purchase that was
|
|
// never weighed against it.
|
|
mockCreate.mockResolvedValue(
|
|
toolReply({ verdicts: [{ key: 'invented::pair', accept: true, reason: 'x' }] }),
|
|
)
|
|
await expect(adjudicate([pair()])).resolves.toEqual([])
|
|
})
|
|
|
|
it('takes the first answer when a pair is answered twice', async () => {
|
|
mockCreate.mockResolvedValue(
|
|
toolReply({
|
|
verdicts: [
|
|
{ key: 't1::d1', accept: true, reason: 'ja' },
|
|
{ key: 't1::d1', accept: false, reason: 'nej' },
|
|
],
|
|
}),
|
|
)
|
|
const out = await adjudicate([pair()])
|
|
expect(out).toHaveLength(1)
|
|
})
|
|
|
|
it('accepts nothing when the call fails', async () => {
|
|
// The run is left exactly where the arithmetic left it.
|
|
mockCreate.mockRejectedValue(new Error('bedrock timeout'))
|
|
await expect(adjudicate([pair()])).resolves.toEqual([])
|
|
})
|
|
|
|
it('does not call the model when the formula settled everything', async () => {
|
|
await expect(adjudicate([])).resolves.toEqual([])
|
|
expect(mockCreate).not.toHaveBeenCalled()
|
|
})
|
|
|
|
it('asks about the whole batch in one call', async () => {
|
|
// The pairs are independent, but a run holds a handful and a call each
|
|
// would be latency for nothing.
|
|
mockCreate.mockResolvedValue(toolReply({ verdicts: [] }))
|
|
await adjudicate([pair('a::1'), pair('b::2'), pair('c::3')])
|
|
expect(mockCreate).toHaveBeenCalledTimes(1)
|
|
})
|
|
|
|
it('shows the model both sides of the amount, including the converted one', async () => {
|
|
mockCreate.mockResolvedValue(toolReply({ verdicts: [] }))
|
|
await adjudicate([pair()])
|
|
const sent = JSON.stringify(mockCreate.mock.calls[0][0].messages[0].content)
|
|
expect(sent).toContain('534.65')
|
|
expect(sent).toContain('541.2')
|
|
})
|
|
|
|
it('accepts a verdict list the model sent as a JSON string', async () => {
|
|
mockCreate.mockResolvedValue(
|
|
toolReply({ verdicts: JSON.stringify([{ key: 't1::d1', accept: true, reason: 'ja' }]) }),
|
|
)
|
|
await expect(adjudicate([pair()])).resolves.toHaveLength(1)
|
|
})
|
|
})
|