Solving real-world problems using data, software and ML. Co-founder Applied Machine Learning Days Africa @AMLDAfrica. PhD in ML from @EPFL

Switzerland
Joined July 2009
Language Models Need Sleep "Transformer-based large language models are increasingly used for long-horizon tasks; however, their attention mechanism scales poorly with context length. To handle this, we study a sleep-like consolidation mechanism in which a model periodically converts recent context into persistent fast weights before clearing its key-value cache." "increasing sleep duration N for our models improves performance, with the largest gains on examples that require deeper reasoning."
31
142
26
900
67,179
If my goal is brain activation and learning, this is my flow: (1) Think and write first, without any #AI augmentation (2) Use AI as an adversarial critic: prompt it to attack (3) Iterate and (4) Come back days later and reproduce the argument unaided
1
31
Caveat: this works when I already have domain knowledge. For a new territory, I flip the first step, AI maps what is possible, then I generate within it, then critique as usual.
20
Mohamed Kafsi retweeted
I love this video
151
2,153
218
19,556
798,360
Mohamed Kafsi retweeted
Engineers and salespeople think in completely different ways. - Engineers: "If you ask them a question, a hundred percent of them will try and think of what is the correct answer to that question." - Salespeople: "If you're a salesperson, your first thought isn't: what's the answer? It's: why are you asking me that question?" "And so if you have an engineer talking to a good sales guy, it's going to upset them. Because they're often not gonna answer the question." "The guys who are good at the job get rejected, because you don't like them. And then the people who are terrible at it, those are the ones that ended up getting hired." "These CEOs just wanna take a guy who failed the engineering test, put a clean shirt on him and make him the head of sales." @bhorowitz with @bhalligan
45
94
14
1,191
173,304
Mohamed Kafsi retweeted
We've been working on the Waxal dataset project since 2021, aiming to enhance the amount of data available for African languages. This public speech dataset initially covers 27 Sub-Saharan African languages spoken by over 100 million speakers across more than 26 countries. 🌍
This quoted post is unavailable.
70
262
22
1,614
195,041
Mohamed Kafsi retweeted
“16 million exchanges?!” “This is called open source”
We’ve identified industrial-scale distillation attacks on our models by DeepSeek, Moonshot AI, and MiniMax. These labs created over 24,000 fraudulent accounts and generated over 16 million exchanges with Claude, extracting its capabilities to train and improve their own models.
120
720
88
8,340
697,778
Mohamed Kafsi retweeted
Vibe coders be like 👨‍💻
173
947
174
10,312
866,299
Mohamed Kafsi retweeted
My PhD thesis is out 🥳🎓 How do LLMs, trained on trillions of tokens, reason? Can they generalise beyond their training data or are they constrained by what they've seen before? My takeaway: they can generalise beyond training in interesting ways, showing genuine reasoning
92
236
19
1,959
106,983
Mohamed Kafsi retweeted
MCP connects agents to live systems: databases, APIs, external services. It's designed for runtime tool access . But the moment you need to teach your agent how to approach a problem domain, you need something else. Skills aren't about (just) accessing data. They're about embedding knowledge into your agent's reasoning. When your agent needs to understand "here's the right sequence for debugging a data pipeline" or "this is how you validate and process complex documents," skills allow you to bake that knowledge into how the agent thinks. There's then also the whole matter of how they work fundamentally: MCP tools rely on an external connection and API calls. Skills are local.. The issue isn't choosing between them. It's understanding that they kiiinda serve different purposes. MCP extends your agent's capabilities at runtime. Skills shape how your agent reasons about problems. I wrote all about this with @itsclelia in our latest blog: llamaindex.ai/blog/skills-vs…
11
7
1
56
5,125
Mohamed Kafsi retweeted
.@Ahmad_Al_Dahle is joining as Airbnb's new CTO. I’m often asked about our AI strategy. We believe pairing great design with frontier technology will help us improve the way people experience travel. Excited to build!
177
64
25
1,195
1,217,655
Tomorrow #Nexthink is coming (back) to #EPFL! We’ll be sharing how we’re building #AI agents to transform the IT world. Seats are limited — register here epflcareer.ch/fr/evenements/… @NexthinkNews @ICepfl @EPFL
77
Mohamed Kafsi retweeted
🇪🇺 EU subsidies are such a massive waste In Portugal for example, I noticed most construction companies from window frames, glass railing, door, balcony doors etc. have a sign in the footer of their website that say they received EU funding You can search their EU funding ID and the reason for funding is always some silly bs like "Project title: Research on how to improve glass railings Project description: Ensure the company’s competitiveness by strengthening its internal competencies to be competitive in the demanding external market, investing in innovation in management processes, distribution, logistics, and work organization practices, as well as in relationships with the external environment" And they always get about €250,000 to €500,000 I even have family who received these subsidies, they got one because they were running a company in a "disadvantaged neighborhood" and had to write a 10 page document and instantly got €250,000, they laughed hysterically cause they definitely didn't need that money, but why not get it if you can, right? Free money! The EU spends hundreds of billions of euros every year from European taxpayer's money on these subsidies that just go nowhere
Top LLM models sources of funding: - OpenAI, private investment - Claude, private investment - DeepSeek, private investment - Meta AI, private investment - Gemini, private investment Meanwhile, the 🇪🇺 EU: - "Let's build an LLM with government funding" Makes no sense Instead, the EU should immediately repeal the EU Artificial Intelligence Act that literally bans most AI companies from operating within the EU If Europe wants to be competitive in AI (or tech in general), the answer isn't spending more European taxpayer's money The answer is removing the ridiculous regulations that prevent Europeans from building AI and tech companies right now
189
139
36
2,152
266,526
Congrats @anniehartley_ and hope to see you again in the next edition of @AMLDAfrica @EPFL_en
Congratulations to @anniehartley_ and her promotion to Adjunct Professor! 🥳 📣We also look forward to welcoming Dr Samy Bengio, Director for AI Research at @Apple, joining us as Adjunct Professor in the School of Computer and Communication Sciences. 👉go.epfl.ch/IC
1
48
#OpenAI is opening a new office in Zurich, recruiting 3 engineers from #Google #deepmind — right in the city with Google’s 2nd largest office (~5K employees). The #AI talent war is heating up, but this is great news for the #AI community & #Switzerland’s ecosystem! 🚀
1
113
Ce témoignage d’un médecin de retour de mission humanitaire à Gaza doit absolument être entendu.
Submergé par l’émotion, ce chirurgien de retour de Gaza a expliqué au Parlement britannique comment les drones israéliens tentent d’abattre des enfants déjà à terre.
266
7,694
64
15,836
550,228
Mohamed Kafsi retweeted
Founder & CEO is a common title, especially in tech. It happens to be my title too. I've come to believe it's an impossible title. You're either CEO, or you're Founder. You can't hold both full-time jobs. And unless your company is probably 100+, CEO isn't really a job anyway. It's more of a role someone needs to play occasionally. There simply aren't that many big picture things or decisions to "execute" day in and day out — or even week in and week out — to make it a true full time job. A role yes, a hat to wear yes, a full-time job at a smallish company? No. It's part-time at best, quarter-time even better. Further, the fundamental responsibilities of Founders and CEOs are at odds. Having them mashed up in the same title is as ridiculous as having someone who's a "CTO & Chief Luddite". Why's that? Because a Founder's job is injecting risk into the business. It's flooding it with new ideas, stuff that seems hard to do, ideas that no one else would dare try, placing the kinds of bets that only someone who started the damn thing would be willing to wager. A Founders' job is basically to stay in business by almost always putting it out of business. A CEO's job? Just about the opposite. It's reducing risk, executing diligently to achieve obvious goals, staying in business at all costs. It's primarily about about being conservative, keeping the company's collective cool, and not letting things get out of hand. Just about everything that a Founder isn't doing. A CEO's job is to stay in business by not allowing the company to do anything so stupid that it could go out of business. See? They're such different things. The minds powering the pistons run on different fuel. But I get it. It's a wonderful boost to the ego to hold the top two jobs in a company — especially when the original sin of starting the damn thing was your decision. And yes, someone ultimately has to make the big calls, no matter which side they fall on. And given that you were the first one in the door, you're the natural and convenient standard-bearer. Your skeleton key fits both locks. Founder is a unique position as it's the one job that can't be replaced. It can be eliminated, certainly, as many companies go founder-free after some time. But once the person who started it isn't there, you can't bring someone else in who started it. The closest thing then becomes a CEO. So I've shifted my personal thinking. As long as I'm still here, I'm picking a side. I'm a Founder. That's my strength, that's where I can bring the most. Which means we don't really have a full-time CEO. I'm simply the part time one that fills the void when we need to bridge the gap, make a final big decision, and move on. As it should be.
51
55
23
661
178,373
Mohamed Kafsi retweeted
Too real 😂
offshore software engineers for big AI companies
78
197
14
4,427
352,612
The Israeli military just killed an American in the West Bank. Her name is Aysenur Eygi. Remember: when Hersh Goldberg-Polin was killed, Biden said "Hamas leaders will pay for these crimes." We're about to get another demonstration of who can kill Americans with impunity.
350
2,192
128
6,677
547,202