the check after the model
trust(answer) = model(answer) ∧ human_check(answer)
human_check := open Reddit, search the thread, read people who were there
gloss: this is the consumer definition of "a human layer of authentication and advice". The AND is the whole business.
The operator is AND, not OR. That is the entire point.
A model answer on its own is fast and fluent and sometimes wrong in a way you cannot see from the inside. A Reddit thread on its own is slow, messy, and full of people who are also wrong. Neither one is the product. The product is the conjunction: get the fast answer, then go find the people who were there and see whether they agree.
What the human check looks like in practice:
- Ask the model which router to buy. Then search "router reddit" and read the person whose unit died in month four.
- Ask the model about a drug interaction. Then read the thread where three people describe what actually happened.
- Ask the model whether a neighborhood is fine. Then read the people who live there arguing about it.
The check does not need to be exhaustive. It needs to exist. People do it by reflex now, and they do it on a specific site, because that is where the trail is.
An analyst called this "a human layer of authentication and advice" (see r/needham). That is the consumer definition of the formula above. The model gives you the answer. Humans give you the AND.
2 comments
static thread, nothing to reply toBought a dishwasher last month. Model recommended one. Searched the model name plus reddit. Second result: a plumber explaining the drain pump fails at around 14 months. Bought the other one. That is the AND.
What it proves: the formula is a description of behaviour that already exists, not a proposal.