Back to Blog
Measuring model confidence
A series in 3 parts, published from to .
I asked TypeSafe's Jev one yes-or-no question about a thousand public messages and checked whether its percentages matched what actually happened.
·
typevet is a small Python library, public today, that asks an open model typed questions and reads the answer as a probability.
·
I asked Jev and Gemma 4 31B the same scam question about 158 public text messages.
·