Tag

#retrieval

September 8, 20265 min read

Grounded answers or honest refusals: a rule for retrieval over personal files

In short: when a system answers questions over someone's own files, there is one rule I would not trade for anything: every answer quotes the person's own sources verbatim, or it is an honest refusal.…

August 25, 20265 min read

A second legal system: what breaks when a legal pipeline changes country

In short: taking a legal pipeline built for Canadian law to a second legal system is less about code that crashes than about assumptions: that a document is in English unless told otherwise, that a…

April 21, 20265 min read

When BM25 beat the embeddings

In short: on legal text, a keyword ranking function from the 1990s wins a whole class of queries that dense embeddings lose: citations, section numbers, defined terms. I run both and fuse the…

April 7, 20265 min read

How I evaluate retrieval before anyone asks a question

In short: before a single user types a question, I write the questions myself, mark which passage answers each one, and measure how often that passage comes back in the top k. That one number, recall…

March 24, 20265 min read

Laws have versions, and most RAG pretends they don't

In short: a section of a statute is not one text, it's a series of texts, each in force for a stretch of time. If your retrieval only knows the current one, it will answer a question about 2021 with…