Tag

#safety

August 11, 20265 min read

What happens when the AI goes down mid-session

In short: when the model provider fails mid-sentence, the user sees whatever the companion had already said, followed by a calm, pre-written pause line. Their unanswered question is held, and the next…

July 28, 20265 min read

Emotion detection that must never slow the voice

In short: the emotion classifier in the supervised care companion runs beside the reply, never in front of it. It starts when the user's words arrive, nothing waits for it, and when it finishes it…

June 30, 20265 min read

Why the service speaks English to everyone

In short: the supervised care companion speaks English to every participant because every line it says in a hard moment has to be signed off by a clinician, and a translation is a new text that nobody…

June 2, 20265 min read

An adversarial persona suite: how I attack my own chatbot

In short: I keep a file of attacks on my own chatbot, each one tied to a written rule, and run them through the real conversation graph against a live model. A broken hard rule fails the run with its…

May 19, 20265 min read

Fail closed: designing an AI for people who can't afford a bad answer

In short: when the user can't afford a bad answer, every part of the system that can fail has to fail towards the safe answer, not towards the model. In a supervised care product I'm building, a voice…

January 13, 20265 min read

RAG with a persona: when the knowledge base and the character disagree

In short: when a character and its knowledge base disagree, let the knowledge base win on content and the character win on voice, and let safety rules beat both. You enforce that in how you build the…

February 11, 20254 min read

What "in production" means in a hospital

In short: in a hospital, a model is in production when a clinician can see its output during real care, a named group has approved that, a named person owns it when it breaks, and the ward runs fine…