Hi, I’m Eric and I work at a big chip company making chips and such! I do math for a job, but it’s cold hard stochastic optimization that makes people who know names like Tychonoff and Sylow weep.

My pfp is Hank Azaria in Heat, but you already knew that.

  • 2 Posts
  • 5 Comments
Joined 1 year ago
cake
Cake day: January 22nd, 2024

help-circle



  • I had a similar disc with one of my friends! Anthropic is bragging that the model was not trained to play pokemon, but pokemon red has massive wikis for speed running that based on the reasoning traces are clearly in the training data. Like the model trace said it was “training a nidoran to level 12 b.c. at level 12 nidoran learns double kick which will help against brock’s rock type pokemon”, so it’s not going totally blind in the game. There was also a couple outputs when it got stuck for several hours where it started printing things like “Based on the hint…” which seemed kind of sus. I wouldn’t be surprised if it there is some additional hand holding going on in the back based on the game state (i.e., go to oaks, get a starter, go north to viridian, etc.) that help guide the model. In fact, I’d be surprised if this wasn’t the case.