Berkan Ottlik retweeted
I think people think that non-attachment leads to not caring, when in fact it can just lead to continuous motion, which is what actually caring looks like. You can move from moment to moment without sinking into the trap of negative minima or rumination or artless circling.
Berkan Ottlik retweeted
Excited to share that my book, The Worlds I See, will be published on Nov 7, 2023 from @Flatironbooks & @melindagates' Moment of Lift Books. I believe AI can help people & I hope you’ll come along on the journey. Preorder momentoflift.com/the-worlds-… #MoemtnofLiftBooks #WorldsISee 1/
If your loss ever looks like this, it might be because you aren't calling optimizer.zero_grad() in PyTorch!!! Learned this the hard way lol.
1
2
192
Berkan Ottlik retweeted
Big news: we've agreed to acquire @MosaicML, a leading generative AI platform. I couldn’t be more excited to join forces once the deal closes. databricks.com/mosaic-news
Berkan Ottlik retweeted
Unexpected description of GPT4 architecture from geohotz in a recent interview he gave. At least it’s plausible.
Berkan Ottlik retweeted
OpenAI's Discord is literally a prompt goldmine.
It's where all the prompt nerds hang out and design the craziest prompts.
Here are the 10 best mega prompts I found in there:
Berkan Ottlik retweeted
Adam, a 9-yr old optimizer, is the go-to for training LLMs (eg, GPT-3, OPT, LLAMA).
Introducing Sophia, a new optimizer that is 2x faster than Adam on LLMs. Just a few more lines of code could cut your costs from $2M to $1M (if scaling laws hold).
arxiv.org/abs/2305.14342 🧵⬇️
Anyone know alternatives to @modal_labs that you can run on your own hardware/VPC?
64
Berkan Ottlik retweeted
1/ @openai & @AnthropicAI bills got you down? a new paper from Lingjiao Chen, @matei_zaharia, & @james_y_zou last week shows you can use "LLM cascades" to cut down on cost (and even improve accuracy!!)
Berkan Ottlik retweeted
Sunday read.
This is hilarious. Engineers are competing who creates the worst UI on Reddit.
I think the winners are:
1/ Enter your phone number
Why does the login to ChatGPT suck and take so long? Bard and HuggingChat are so much better in that respect, which is why I sometimes default to them.
1
1
136
Berkan Ottlik retweeted
bbe (big builder energy) in nyc today 😃
congrats to all of the super talented hackers & thanks @contrary @betaworks @lux_capital for hosting!
Berkan Ottlik retweeted
@ylecun closing his presentation with some conjectures #phildeeplearning
Yet another blog about transformers: berkan.xyz/posts/2023/01/tra… (except it's written by me and I think it's decent 😊)
3
60
Berkan Ottlik retweeted
Twitter is an anti-compassion machine that stokes our tendency to dehumanize and even hate people we don't know personally.
Four little exercises I use to combat that and crank up the compassion in my mind:
Imagine one day we have parents for AI's, similar to the way we have parents for human babies today.
1





















