probs vs sae

February 9, 2026 · 1 min read

wake: 1100
sleep: 0231

meals:

  • breakfast: -
  • lunch: chicken soup
  • dinner: chicken soup

til:

  • nike vaporfly 80% energy return in super shoes
  • no higher than 40mm height limit and only 1 carbon fiber plate
  • most people's wingspan is their height but michael phelps is 3 inches longer (6 feet 7 inch)
  • nasi kerabu is blue bc of natural coloring of butterfly-pea flower

links:

  • interpretability as the next frontier of model design
    • probs vs SAEs, probes work better on noisy data, SAE works well with clean data?
    • high level is u pass through data through a model and see activations, and observe what kind of data activates what features, i.e. gen z language and u can build a gen z speaking feature
    • turn up vector for gen z language in real time through an API
    • steering vs prompting
    • in context learning and SAEs can be equivalent
  • arena.education - curriculum