Vivek Nair retweeted
Claude now works inside Google Docs, Sheets, and Slides, and those files also open inside Claude.
In Google Workspace, Claude sits in a sidebar next to your file, reads what you have open, and edits it in place. You can approve each edit before it lands.
Vivek Nair retweeted
We’ve received notice that the Department of Commerce has lifted export controls on Claude Fable 5 and Mythos 5.
We'll begin restoring access tomorrow, and will share an update soon.
We’re grateful to our users for their patience, and to everyone who worked with us on redeploying the models.
Vivek Nair retweeted
Introducing Claude Opus 4.8: it builds on Opus 4.7 with sharper judgment, more honesty about its own progress, and the ability to work independently for longer than its predecessors.
Available today at the same price.
ALT Benchmark table showing how Claude Opus 4.8 compares to its predecessor and to other models on tests of coding, agentic skills, reasoning, and practical knowledge work tasks.
Vivek Nair retweeted
Introducing Claude Opus 4.7, our most capable Opus model yet.
It handles long-running tasks with more rigor, follows instructions more precisely, and verifies its own outputs before reporting back.
You can hand off your hardest work with less supervision.
ALT Claude Opus 4.7 Benchmarks
Vivek Nair retweeted
Simile is out of stealth!
At Simile, we have built the first AI simulation of society, populated by agents based on real humans.
We are building a foundation model that predicts human behavior in any situation, and a product that deploys it at scale.
Thrilled to be on this mission.
Vivek Nair retweeted
Finally, AI designs you can edit.
Moda - create brand assets on a fully editable canvas.
This is not another ChatGPT or nano banana wrapper.
We actually taught an agent layout, typography, and color. We gave it taste.
Use it for slides, social, infographics, e-books …
Vivek Nair retweeted
Just released a 20 minute beginner tutorial making a flight tracker app with @alexcodes_ai
Check it out if you're just getting started!
Vivek Nair retweeted
What a night! Packed house and some of the sharpest minds in AI from Webflow, Asana, and 11x sharing how they’re building with agents today.
Big thanks to Ampersand for co-hosting and our speakers our speakers @bryantchou @rodrigodavies @prabhavjain @ezelby @patrickt010 for their insights on the future of agents.
One takeaway from @bryantchou stood out:
"In the next 10 years, we'll find the right balance between having an AI agent do the job, but then also creating the right guardrails around it and the UI/UX around it to meet the end users' needs."
Thanks for joining us, we can't wait for the next one!
Vivek Nair retweeted
Last week, we hosted some incredible AI builders from companies like Asana, Cribl, Block, Vanta, and Pinterest to share their stories on shipping AI apps to production.
What we learned is that the road from POC to production isn't a straight path:
1. Turns out the biggest hurdles aren't always technical. It's getting everyone in the org aligned on what quality looks like and how to measure it.
2. Every team is feeling this constant tension between going for the big, transformative AI projects vs. shipping quick wins. Similarly, the build v. buy pendulum constantly swings back and forth even for AI enterprise tooling.
3. The retrieval space is wild right now:
- Tool use and function calling are eating into traditional RAG use cases
- Some teams are skipping retrieval stores entirely for simpler needs
4. Teams are getting creative with using AI to contextualize data before embedding and using agents to craft better RAG queries.
5. And here's a surprising one: despite solid performance metrics, almost no one's using Gemini in production. Right now, it's a close tie between Anthropic, Llama, and OpenAI models with everyone pretty skeptical of the DeepSeek media hype.
We do these intimate dinners monthly in SF/NYC and always walk away with new insights. Thanks to our guests for keeping it real! DM us/comment if you'd like to be considered for a future event.
Vivek Nair retweeted
Multi-model evals might seem like a clever way to fix unreliable LLM product tests. But they’re generally a smell that you should rethink your evals.
Multi-model evals (where you test a panel of models and average the scores) don’t fix a bad eval. If the eval is flaky, all you’re doing is averaging the flakiness. So you’re spending too much time optimizing for solutions with limited upside.
Instead, make your eval work reliably with one model by giving it an unfair advantage than try to patch over it with more models.
go.gentrace.ai/RnT9dxG
Vivek Nair retweeted
There's been much debate about the fate of 'low-code/no-code' x purpose-built SaaS tools — will AI agents spell their demise, or may they be a force for empowerment?
Join us at @GentraceAI w/ withampersand.com as we kick off the new year with our next speaker event on: The SaaS → AI Agent Transition.
Thurs, Feb 6th @ Gentrace Fidi (604 Mission St.) — expecting 200+ guests.
We're hosting @bryantchou, @prabhavjain, @rodrigodavies, @ezelby, and Patrick to discuss the influence of agents on the GTM stack, integrations, and more.
Interested? Register below: – at San Francisco, CA
Vivek Nair retweeted
It was a big year for Gentrace in 2024!
📈 21M+ evals and traces ran, growing 2x in the last 6 months (up from 40k when we first started Oct 2023!)
🤖 19 features and improvements launched
🪲 320 bugs squashed
Thank you to our customers and team for making this possible. 🫶
Vivek Nair retweeted
The holidays are the best time for working. Everyone who usually interrupts you isn't.
Vivek Nair retweeted
I'll die on this hill: people are ripping on LLM as a judge because they aren't doing it right. 80% are asking the LLM the same question as the prompt.
Avoid being the 80% by giving your LLM as a judge an "unfair advantage" — aka some additional context or capability that makes the eval task easier than the original generation task.
go.gentrace.ai/RnT9dxG