
Research scientist @hume_ai, PhD from @uni__augsburg - audio, speech, paralinguistics, affective computing, wellbeing.
New York, USA
Joined October 2012
- Tweets369
- Following264
- Followers866
- Likes1.1K
Someone says "I'm fine." You know they aren't.
You heard it - the pause, the flat tone. Voice AI doesn't. It all gets dropped at transcription.
So we built the Expression Measurement API. 48+ emotions, 600+ descriptors, 50+ languages, audio and video, real-time.
Conversation was always more than words.
Text-to-speech was built to read a single voice aloud. Now it's being asked to hold a conversation between two, and that's a different problem entirely.
The speakers have to stay distinct, trade turns with natural timing, and keep their emotional states from bleeding into each other. None of that shows up in word error rate.
So we built a rubric: five dimensions, 48 two-speaker scripts, and four scenarios designed to break a dialogue by pairing similar-sounding voices, forcing frequent interruptions, contrasting emotions, and running long exchanges.
Three blind human raters per clip. We ran three generations of Google's Gemini TTS models through it, alongside other multi-speaker systems.
Keeping two voices apart is the hardest part of the job. Every system handles a male and female pair easily and drops on at least one same-gender pairing. The newest Flash model made its biggest gain on exactly that.
Models with the same overall score get there differently. One leads on keeping speakers’ voices distinct, another on making the dialogue sound like one continuous recording. The overall score hides that difference.
New capabilities need new evaluations.
Full case study, with audio examples, is linked in the comments.
Congratulations to the @OpenAI team on the GPT-Live-1 launch.
Here is the early read from our RWVoiceEQ STS evals.
Voice naturalness is where it moves: up about 70% on their previous flagship, from near the bottom to level with Gemini 3.1 Flash Live at the top. What was OpenAI's weakest factor is now their strongest.
Emotion understanding also improved, about 10% up and the highest score in the set.
Emotion alignment is where it doesn't. Whether the model notices when tone contradicts the words, a hesitant or frustrated yes to a critical confirmation: unchanged from the previous flagship, under 1% apart.
Sounding human and understanding humans are separate problems. The industry is solving the first one quickly. The second one is where the work is.
Measuring the gap is how we close it.
Early numbers. Full leaderboard update to follow.
We asked 11 voice cloning models to copy the same 25 voices, then asked real people: is that the same person?
The most natural-sounding clone ranked 8th of 11 on sounding like the person.
New from Hume AI: the Voice Replication Leaderboard. Live now on @huggingface, links below.
Alice Baird retweeted
Theo Lebryk, David Ayllon, Alice Baird, Jakub Piotr C{\l}apa, Jens Madsen, Panagiotis Tzirakis, "Towards Quantifying Benchmark Optimization in ASR Models" arxiv.org/abs/2608.19936
Alice Baird retweeted
BIG update on the Open ASR Leaderboard!!
We introduced various benchmark-fitting probes to identify “curious” model behavior:
1. Predicting erroneous transcripts from the test data.
2. Switching spelling conventions (e.g. "colour" vs "color") to match the test data transcripts.
Kudos to @hume_ai for building these probes and tackling a problem that's important and under-addressed in ASR evals, and ML more broadly!
The uncomfortable truth: avoiding some form of benchmark fitting is almost inevitable when training data overlaps with the benchmark's characteristics (e.g. the corresponding train split), as models will mimic behavior they've seen during training.
This highlights the importance of held-out sets for measuring untainted, real-world performance, which you can already find on the "Private data" tab 🤗
A benchmarks is only useful if we understand what they’re actually measuring. Really interesting work from the team + Huggingface!
We silenced a number in the benchmark audio. It was never spoken.
Some of the highest-scoring speech recognition models wrote it down anyway, in 30–40% of cases.
New research with @huggingface on measuring when a model is optimizing for the test instead of the audio.
Alice Baird retweeted
David Ayllon, Alice Baird, Jeffrey Brooks, Franc Camps-Febrer, Jakub Piotr C{\l}apa, Theo Lebryk, Jens Madsen, Olya Ossipova, Sharath Rao, Hoon Shin, Tigran Soghbatyan, et al., "RW-Voice-EQ Bench: A Real World Benchmark for Evaluating Voice AI Systems" arxiv.org/abs/2607.14846
Excited to share the Real World VoiceEQ Benchmark!
A new benchmark for evaluating Voice AI across real-world dimensions.
Blog + technical paper: huggingface.co/blog/real-wor…
Leaderboard: huggingface.co/spaces/real-w…
Today, voice models have no problem generating “angry” or “sad” expressions.
But ask for:
→ bored + fast
→ joy + shy
→ disappointment + confident
…and most systems collapse into stereotypes.
Our latest research blog explores why this happens — and how disentangling emotion from voice at the data layer improves expressive control. Read more below!
Excited to be co-organizing the ACII 2026 DaiKon Workshop & Challenge! Reach out to register a team: [email protected]
We’re excited to launch the 2026 ACII Dyadic Contest (DaiKon) Workshop & Challenge—a new benchmark for modeling emotional influence in dyadic dialogue.
Explore a sample of our conversational audio dataset: 945 sessions, 743 hours, across 5 languages.
Submissions due May 25. We look forward to your participation!
Octave 2, now multilingual, so huge! 🥳🔥
Introducing Octave 2: our next-generation multilingual text-to-speech model
What’s new:
- Fluent in 11+ languages
- 40% faster (<200ms latency) & 50% cheaper than Octave 1
- Multi-speaker conversation
- More reliable pronunciation
- New voice conversion & phoneme editing capabilities
For the month of October, we’re offering 50% off our Creator plan - use code OCTAVE2 at checkout!
Alice Baird retweeted
Use OpenAI's new open source model with any voice, cloned or designed!
You can use Cerebras' gpt-oss-120b to build realistic speech-to-speech voice interfaces with emotion via @hume_ai's new EVI 3. Perfect for your next voice ai project!
Link to try below 👇
Alice Baird retweeted
2024: Voice Cloning
2025: What about personality cloning?
Hume’s voice AI can now not only mimic your voice but also speaking style and language.
It’s now available via our TTS and new speech-to-speech model, EVI 3, which is also launching today.
Alice Baird retweeted
This had me floored
This isn’t just a talking model. It understands and expresses voice like a human, across any accent, tone, or style.
It doesn’t just speak. It performs.
Nervous stammer? Confident debate? A whispered secret? It's all in there...
Huge! 💚
Meet EVI 3, another step toward general voice intelligence.
EVI 3 is a speech-language model that can understand and generate any human voice, not just a handful of speakers. With this broader voice intelligence comes greater expressiveness and a deeper understanding of tune, rhythm, timbre, and speaking style.
Alice Baird retweeted
Hume launches new text-to-speech model Octave that generates custom AI voices with adjustable emotions venturebeat.com/ai/hume-laun…
Wow, an incredible achievement by the entire team at Hume! 💚
Today, we’re releasing Octave: the first LLM built for text-to-speech.
🎨Design any voice with a prompt
🎬 Give acting instructions to control emotion and delivery (sarcasm, whispering, etc.)
🛠️Produce long-form content on our Creator Studio
Unlike traditional TTS that just “reads” words aloud, Octave understands how meaning affects delivery to generate emotional, human-like speech.












