Back to Blog

Measuring model confidence

A series in 3 parts, published from to .

  1. I asked TypeSafe's Jev one yes-or-no question about a thousand public messages and checked whether its percentages matched what actually happened.

    · explanationPart 1 of 3

  2. typevet is a small Python library, public today, that asks an open model typed questions and reads the answer as a probability.

    · explanationPart 2 of 3

  3. I asked Jev and Gemma 4 31B the same scam question about 158 public text messages.

    · explanationPart 3 of 3

© 2026 Alberto Nieto. All rights reserved.