Dr. Firend Alan Rasch (@drfirend) profile picture

Academic and researcher, author of the Problem Solving Model PSM

Joined January 2015
Dr. Firend Alan Rasch retweeted
Image input pricing varies orders of magnitudes between models - GPT-4o is ~200X more expensive than Gemini 1.5 Flash 💸 Image input is increasingly relevant as more LLMs are becoming multi-modal and as the AI community explores new ways of using vision input. This is particularly the case for RAG use-cases which require vision capabilities to interpret rich documents. This week @MistralAI released their Pixtral 12B model which, according to their announcement, performs very well on vision evals. We at Artificial Analysis are to launch our own independent evaluation of vision capabilities shortly. Models also vary as to the amount of images they accept. Gemini 1.5 Flash can accept >1000 images but LLaVA-v1.5-7B can only accept one image per request. We will be launch a vision focused page on the Artificial Analysis website shortly. Link to our pricing analysis of vision input below 🔗
2
13
1
93
8,480
Dr. Firend Alan Rasch retweeted
Cerebras continues to deliver output speed improvements, breaking the 2,000 tokens/s barrier on Llama 3.1 8B and 550 tokens/s on 70B Since launching less than a month ago, @cerebras has continued to improve output speed inference performance on their custom chips. We are now measuring 2,005 output tokens per second on @AIatMeta's Llama 3.1 8B and 566 output tokens per second on Llama 3.1 70B. Faster output speed supports use-cases which require low-latency interactions including consumer applications (games, chatbots, etc) and new techniques of using the models such as agents and multi-query RAG. Link to our comparison of Llama 3.1 70B and 8B providers below 👇
10
16
2
120
12,221
Dr. Firend Alan Rasch retweeted
Analysis of Llama 3.1 70B providers: artificialanalysis.ai/models… Analysis of Llama 3.1 8B providers: artificialanalysis.ai/models… artificialanalysis.ai/models…
2
7
2,175
Humanoid robots come to life in Chinese factory reuters.com/video/watch/idRW…
20
Dr. Firend Alan Rasch retweeted
📈 Americans Grow More Optimistic About Inflation Outlook 👗 Clothing Is First Choice for Second-Hand Shoppers 🔵 The Rise of the Swoosh 📉 Chinese Housing Market: Boom & Bust
2
17
4,588
Dr. Firend Alan Rasch retweeted
In case you missed it #ICYMI 💰 The Most Profitable Companies in the World 🐷 Where the World Eats the Most % Least Meat 🟢 Where Productivity Has Risen (& Where It Stagnated) 🌊 Under Threat: The World's Reef-Building Corals
3
16
57
9,053
UK economy shrinks, with long recession feared reuters.tv/v/sXnf/2022/11/11…
2
Crypto chaos: Missing funds, rogue transactions at FTX reuters.tv/v/sXcY/2022/11/12…
2
Lufthansa OK's check-in with digital vaccine pass reuters.tv/v/P6cB/2021/06/17…
1
Soccer stars snub drink sponsors at Euro 2020 reuters.tv/v/P6Dm/2021/06/17…
1
Microsoft puts spotlight on Xbox Game Pass at E3 reuters.tv/v/PtVq/2021/06/15…
1
The world will be divided into labourers and specialists. Those who do a repetitive job are the majority of world population, while the specialised skills workers are the few. In post-COVID, this Will be the largest economic challenge to nations.
4
Big tech could lose bargaining power under U.S. bill reuters.tv/v/PuiT/2021/02/19…
3