Max Pechyonkin (@max_pechyonkin) profile picture

Deep learning engineer

Joined January 2010
Photo by Max Pechyonkin (@max_pechyonkin)Photo by Max Pechyonkin (@max_pechyonkin)Photo by Max Pechyonkin (@max_pechyonkin)Photo by Max Pechyonkin (@max_pechyonkin)Photo by Max Pechyonkin (@max_pechyonkin)Photo by Max Pechyonkin (@max_pechyonkin)Photo by Max Pechyonkin (@max_pechyonkin)Photo by Max Pechyonkin (@max_pechyonkin)
Max Pechyonkin retweeted
"Based on the tremendous interest shown, I will be directing the Secretary of War, and other relevant Departments and Agencies, to begin the process of identifying and releasing Government files related to alien and extraterrestrial life, unidentified aerial phenomena (UAP), and unidentified flying objects (UFOs)..." - President Donald J. Trump
11,279
13,373
8,059
74,756
20,058,998
Max Pechyonkin retweeted
hello toronto @OpenAI 's first ever canadian community meetup is happening and it's going to be about Codex here, at home brought to you by @buildfutureto when: thursday feb 26th @ 5pm where: downtown toronto sign up link below interested in demo'ing? reach out.
32
9
6
438
59,406
Max Pechyonkin retweeted
Anti-pattern Architect.
28
145
23
1,777
126,719
Max Pechyonkin retweeted
There's a shocking fact about AI that nobody tells you: You can catch up to the public AI research frontier in just 2 weeks. Yes, really. I've built a $150M annual revenue startup over the last 8 years and If I were to start a company today, I’d drop everything and go all-in on AI. But like many busy software builders, I felt lost—overwhelmed by the noisy, crowded and fast-moving modern AI landscape. And I wasn’t alone. So I spent my entire holiday diving deep into AI research—reading 30+ papers, watching hours of lectures, analyzing trends, and catching up to the research frontier. ✨ Here’s what I learned: - You don’t need months (or years) to catch up. - You don’t need a PhD or decades of ML experience. - You need fewer than 20 papers and 2 weeks to understand the major breakthroughs shaping AI today. It's because the technology is extremely nascent and most techniques that came before are no longer relevant: - ChatGPT is barely 2 years old and Transformers are only 7 years old. - Most game-changing discoveries happened within the last 4 years, driven by a few breakthrough ideas, scaling laws, and efficient matrix multiplication. The biggest secret? Many groundbreaking AI papers with thousands of citations are surprisingly simple and applied, like adding "let's think step by step" to the prompt, or simply asking the LLM over and over again to improve its answer (Self-Refine). I realized there are tons of founders and builders in the same boat—wanting to dive deeper into AI but unsure where to start. I've created an essential AI Guide that helped me catch up, in just 2 weeks, to the frontier of public AI research to figure out where the next opportunities and gaps were: - Curated list of only the most important papers - Simple explanations of key concepts - Clear pathway to understanding the frontier of modern AI It’s perfect for: - Founders expanding into AI - Builders wanting to innovate at the frontier of AI - Investors looking to separate the signal from the noise 👇 Want the full guide? - Like and Share this post - Comment "AI Guide" - I'll send you the complete guide (ps, I’m also teaming up with @VishalVasishth, co-founder of @obviousvc with @ev (focused on large-scale societal impact companies like Twitter, Medium, Beyond Meat), to host a small meetup to discuss what's working and needs to be solved in the AI stack in SF. Message me if you're interested)
5,417
2,828
190
10,966
1,144,635
Max Pechyonkin retweeted
Today, with @Tim_Dettmers, @huggingface, & @mobius_labs, we're releasing FSDP/QLoRA, a new project that lets you efficiently train very large (70b) models on a home computer with consumer gaming GPUs. 1/🧵 answer.ai/posts/2024-03-06-f…
78
623
101
3,405
445,278
The Mojo internals technical talk is now available👇. Dig in to learn more about how Mojo's compiler architecture is a step forward from other languages, about our quest to lift performance engineering out of compilers and into libraries, and Mojo for heterogenous compute. 🔥🔥
5
51
5
340
96,031
Max Pechyonkin retweeted
Sama on monday morning
18
134
6
2,091
141,325
The University of Toronto made a video for a non technical audience in which I explain how deep learning works, the enormous promise of this technology and some of the potential risks. youtu.be/-9cW4Gcn5WY
78
482
40
1,719
269,097
Max Pechyonkin retweeted
There's a new programming language in town - it's Mojo! I'm more than a little excited about it. It's Python, but with none of Python's problems. You can write code as fast as C, and deploy small standalone applications like C. My post is below, and a 🧵 fast.ai/posts/2023-05-03-moj…
95
861
119
4,555
1,078,946
Max Pechyonkin retweeted
How to Remember Anything. I have been using Anki flashcards in my studies. It works for most topics & most ages (my 7-year old uses Anki too). I explain some of the basics here: rachel.fast.ai/posts/2023-02…
10
46
7
338
50,924
Max Pechyonkin retweeted
The "Software Engineering at Google" book is now free to read online: https://teapawt.net/t.co/cqX79uZNFK. Great insights on improving code quality & scaling engineering teams.
68
1,920
118
7,188
Max Pechyonkin retweeted
Now that PEP 646 has been accepted: python.org/dev/peps/pep-0646… We will get to attach semantic meaning to an array's axes in the type signature! For example:
11
78
22
531
Max Pechyonkin retweeted
I’ve been using #AnnotatedEquations in my recent papers. I think it really adds to the readability and understanding of the math. Here are some examples. It uses #tikz in #latex. Let me know if you like it. Happy for any feedback. [GitHub link: next tweet] #AcademicChatter +
108
951
243
5,446
Max Pechyonkin retweeted
As we close out the year, here's a thread of articles and videos if you're looking for some things to read/watch over the holidays!
1
4
17
GPT-3 writes a response to the philosophical essay about itself that was published a few days ago. Read the whole thing. Absolutely mind-blowing.
I asked GPT-3 to write a response to the philosophical essays written about it by @DrZimmermann, @rinireg @ShannonVallor, @add_hawk, @AmandaAskell, @dioscuri, David Chalmers, Carlos Montemayor, and Justin Khoo published yesterday by @DailyNousEditor. It's quite remarkable!
3
11
3
19
GPT-3 is the single most important event of 2020. And yes—I've been living in the same 2020 as all the rest of you.
I made a fully functioning search engine on top of GPT3. For any arbitrary query, it returns the exact answer AND the corresponding URL. Look at the entire video. It's MIND BLOWINGLY good. cc: @gdb @npew @gwern
1
5
23
Max Pechyonkin retweeted
So that you don't have to, I've categorized 54 papers related to mask use into 6 categories, so you can find all the research you need for whatever you want to know. #Masks4All tiny.cc/maskswork
4
53
7
113
Max Pechyonkin retweeted
We have now found and studied FIFTY papers that touch on the #Masks4All question: should everyone wear a basic face cover in public? We're preparing an academic paper reviewing this literature. In the meantime, we're sharing the papers and summaries: tiny.cc/maskswork
8
50
7
109