anton retweeted
Alright I'm tired of being linked this example and saying repeatedly it's not my experience with GLM 5.3 Flash.
So I ran it myself. @skalskip92 what precision are you running GLM 5.3 Flash here? Are you using an API?
Can I just download all your examples unlabled somewhere?
as expected, GLM 5.3 Flash is pretty bad at vision
interesting how different models end up specializing in completely different things
some are great at coding, others at computer vision
no AGI yet, I guess
1/n aerial and satellite images, crops
link: playground.roboflow.com/shar…
I tried using Fable to train a model (LFM 2.6B) because I didn’t want to spend time on the data. Turns out neither did Fable and it ended up making the model worse on every attempt until I decided to look at the data. It was using the wrong chat template on like 1/3 of the data and had started to import HF datasets that didn’t align with the task at all. Sometimes I wonder if it was intentional sabotage or if it was just lazy
Replying to @jcrwhittington
We find that
1) Opus 5 & Fable marked a real increase in ability on these games, but they still struggle with the hardest tiers of games (Tiers 6 and 7)
2) Agentic harnesses like Prime don’t offer any benefit over a basic (non coding!) harness
3) There’s a large gap between closed-source (Opus 5) and open-source models (Kimi K3) and another big gap to smaller open-source models (Qwen 3.6 27B)
Finally, rule discovery really is the bottleneck in these games: when we give the ground-truth rules in plain language, even the previously weakest models score near perfect.
(4/5)














