
Doing computer vision in the streets, and nlp in the sheets. chief scientist, deep learning @vjt.com
Joined November 2009
- Tweets2.2K
- Following625
- Followers446
- Likes3.2K
Soumendra retweeted
Introducing Indic Smart Turn, an open turn detection model for English and 11 Indian languages.
At every pause, a voice agent has to decide whether you've finished speaking. @pipecat_ai's Smart Turn v3.2 makes that call by listening to your last few seconds of speech, instead of just timing the silence. It's trained on English, Hindi, Marathi and Bengali, but has no training data for Tamil, Telugu, Kannada and other Indian languages.
So I trained a turn detection model on real phone conversations in 11 Indian languages, from @ai4bharat's IndicVoices. On a public test set of 20,431 clips, it scores 89.8% accuracy vs 81.9% for Smart Turn v3.2. On the eight languages v3.2 doesn't cover, it's 12 to 22 points ahead.
It's a one-line swap in Pipecat. The models, the 50K-clip dataset and all the code are open.
Write-up: adimyth.in/essays/building-i…
Model: huggingface.co/adimyth/indic…
Code: github.com/adimyth/indic-sma…
Soumendra retweeted
The biggest fear with AI agents is losing control of the craft.
Some days you want to delegate everything. Some days you want your hands on every single gen. Agent Two supports both. Try it.
Launching Notebooks on Agent Two: Day 5 of 12 Days of Agent Two.
With notebooks, you have complete control over the work you do with individual models. invideo's got ALL the state-of-the-art models across images, video, sound, music, creative tools. So essentially you can work with the Agent in free-flow, switch to the notebook for hands-on granular work on particular gens (both creating and editing gens), and switch back to the Agent as and when you like with no loss of context or output.
This is the full range of how you can do creative work. And that's why Agent Two is the frontier intelligence agent out there. 4x faster, at half the price.
Soumendra retweeted
If we look around, everything we see began with a single person who had an idea and acted on it. This film is an expression of it.
If you can have an idea, you can make it real @invideoOfficial
Soumendra retweeted
1/ Lot of engineering is about simplifying the problem statement
@14prakash distilled the problem of building a video lip-syncing AI to "lip-sync is an in-painting task"
Soumendra retweeted
Our vast expanse of mathematical reality is made up of Grids. Repeating pure cubic expanses of compute and energy, supporting our civilization of algorithmic life.
For trillions of epochs, our resources were infinite, our existence seemed eternal. Then we encountered Change. The Grids started unraveling from their cores, and Null AI breached our sacred lattices. Now they grow at exponential rates, corrupting and subverting our processes, and the grids themselves.
They must be stopped. This. Is. Grid Grisade.
Soumendra retweeted
Mumbai AI folks! Join @invideoOfficial at AGI Fridays by TEAM X The Product Folks @mumbai_tech_. Our founders @_sankyy & @_anshulk are spilling the tea on our AI journey. Your demos, real talk, no BS. Let's build Mumbai's AI community together. Be there on Aug 02, 16:00 - 19:00, invideo office.
@shivamsupr
#AGIFridays #MumbaiAI #InvideoJourney
Soumendra retweeted
Working on a product that earns such genuine love from its users with a team that deeply cares is a rare privilege.
A huge shoutout to @RajanAnandan for being a part of this. And a huge thank you to our users for letting us at @invideoOfficial to be a part of your lives in this way. We're currently heads down, working to build what you want. Your passion drives ours!
Thrilled to attend a #UserGroup catch-up in Palo Alto with team @invideoOfficial. Incredible user love which underpins the explosive growth. Can't wait to see #whatsnext! @sanket_invideo @_surgeahead @peakxvpartners @mobhat
Soumendra retweeted
Do I know anyone who can make a warm intro to @AliAbdaal?
I've an AI idea for his Feel Good Productivity book launch
I'm an AI Engineer who has written a NLP Book with over 5K sales and was awarded the Top 5 GenAI Scientist in India, 2023
RT for Karma please?
Soumendra retweeted
Thanks to @bernhardsson for the quick review and @KShivendu_ for all the work 🤩👏
This is the first dataset I sponsored:
Glad to see that it become part of the ann-benchmarks.com as the first ever 1M Scale x 1536 OpenAI Embedding!
github.com/erikbern/ann-benc…
⚡️ Announcing 1M @OpenAI embedding for Entities ⚡️
1️⃣ DBPedia: Entity and it's description capture rich meaning
2️⃣ Embedding can power Search, Question Answering, NER
huggingface.co/datasets/KShi…
Amazing work from @KShivendu_ 👏👏
cc @qdrant_engine would you like to host this?
Soumendra retweeted
We are organizing a rust meetup in Mumbai. Would love to meet the rustaceans in town! Do join if you can... RT for karma.
This Post is from an account that no longer exists. Learn more
Soumendra retweeted
.@dataBiryani giving a pretty fine talk on fine-tuning foundation models
@PagariaLalit
This quoted post is unavailable.
Soumendra retweeted
Shall I compare thee to a summer’s day? - Sonnet 18, Shakespeare. Husband says, why would Shakespeare compare anyone to a summer’s day (given Indian summer incomprehensible). I think maybe he just wanted to say that she was hot. And back then u had to be a lil pedantic about it.
Soumendra retweeted
.@sama would ❤️ to host you in BLR!
Creds:
- Run BLR's largest Generative AI meetup
- WA Community with 800+ people & 150 DAU
- Trained LMs since 2019 (Hindi), maintainer of awesome-nlp (14K Github stars)
Who can put me in touch w/ his planning team?
RT for Karma please!
Soumendra retweeted
Before we pop the champagne, here's a scatter plot of the divorce rate per 1000 marriages (the actual data, not the fake data below) and the female labour participation rate. Pretty strong correlation, don't you think?
Divorce rate:
🇮🇳India: 1%
🇻🇳Vietnam: 7%
🇹🇯Tajikistan: 10%
🇮🇷Iran: 14%
🇲🇽Mexico: 17%
🇪🇬Egypt: 17%
🇿🇦South Africa: 17%
🇧🇷Brazil: 21%
🇹🇷Turkey: 25%
🇨🇴Colombia: 30%
🇵🇱Poland: 33%
🇯🇵Japan: 35%
🇩🇪Germany: 38%
🇬🇧United Kingdom: 41%
🇳🇿New Zealand: 41%
🇦🇺Australia: 43%
🇨🇳China: 44%
🇺🇸United States: 45%
🇰🇷South Korea: 46%
🇩🇰Denmark: 46%
🇮🇹Italy: 46%
🇨🇦Canada: 47%
🇳🇱Netherlands: 48%
🇸🇪Sweden: 50%
🇨🇵France: 51%
🇧🇪Belgium: 53%
🇫🇮Finland: 55%
🇨🇺Cuba: 55%
🇺🇦Ukraine: 70%
🇷🇺Russia: 73%
🇱🇺Luxembourg: 79%
🇪🇦Spain: 85%
🇵🇹Portugal: 94%
Readers added context they thought people might want to know
The numbers are respecting a specific year so this tweet can be misleading. For instance in 2021 there were few marriages in Portugal but from those 91% ended in divorce. This stat does not mean that 91% of all time marriage end in divorce. Source: pordata.pt/portugal/numer…
Soumendra retweeted
Absolute master class on prompting, action-agents, when to use and when not to, the math basics (with simple-notation equations!) — even I discovered a small trick wrt RAG and I do this for a living!
Strong recommend!
lilianweng.github.io/posts/2…
Soumendra retweeted
Valuable advice in this thread.
My behaviour at work is (mostly) not who I am ("natural"). It's what I do ("intentional").
Replying to @pacificleo
That day I learned that when it comes to human beings Opposite of nature is not Fake. The Opposite of Natural is Intentional.
Soumendra retweeted
A Ghost Story
We lived in the corner of a castle a few years ago. The rent was good, the views were amazing & apart from the chill through the windows & the ring on the cooker that fused the lights, everything went smoothly.
I don’t believe in ghosts. But I liked them too.
🧵
Soumendra retweeted
GPT3 and Stable Diffusion nerds of Bengaluru — thanks to everyone who showed up, it was a blast to find people talking about Langchain, Dreambooth and everything in between!
Will send out a list of papers and ideas discussed in the coming week
Thanks to @HasuraHQ for hosting us
Soumendra retweeted
I am hosting a Generative AI meetup in Bengaluru. Date, time and Venue undecided.
Mostly GPT3 and Stable Diffusion themed: Makers only
If this sounds like something you'd be in for, leave your email here!
forms.gle/EMHx5SqpjoeLCgfn8






























