Tagged ai-architecture
3 pieces
- · 10 min read
Temperature Zero Is Not Deterministic
Event sourcing assumes you can replay the source and get the same derived state. A model call in the derivation breaks that assumption, because the lowest temperature setting reduces variation without eliminating it, and providers document this. A model-derived layer cannot be regenerated by replay, so the output and the model version have to be stored as part of the record.
- · 11 min read
Model Retirement Is A Regulatory Event
Hosted model providers retire models on published schedules, and some deployment types upgrade automatically. For software whose behaviour has been validated, a model changing on a vendor's timetable is a change-control event, not maintenance. Version pinning becomes a regulatory requirement, and the deployment type you choose is a compliance decision.
- · 10 min read
Where Your Inference Actually Runs
Data residency for model inference is frequently not selectable in the way teams assume. Cross-region routing can place inference outside an intended boundary, and some global endpoints explicitly exclude residency guarantees. This has to be established in writing before an architecture depends on it, and the design has to survive the answer changing.