“Our RAG system returns confident wrong answers”
A retrieval audit, then the fixes
You keepA working eval set, plus the retrieval changes
What I fix
Problems, not a list of technologies
Each of these is a problem I have actually been called in for, described the way the client described it. If one of them is close to yours, the page says how I would approach it and what you would be left holding at the end.
“Our ledger disagrees with our provider and we find out at month end”
Double-entry ledger, idempotency, and daily reconciliation
You keepA ledger you can audit, and an exceptions queue instead of silent drift
“Our agent silently half-finishes tasks”
Durable state, idempotent tools, explicit incomplete states
You keepAn agent that fails loudly instead of quietly
“We need HIPAA-aware architecture and don't know where to start”
The compliance foundation, built once and properly
You keepAn authorisation matrix, audit logging, and infrastructure you own