David Zhao retweeted
6 voice ai platforms, the same 90 phone tasks, each run 5 times, with @getbluejay_ai
@livekit got 89% of calls right. on 73% of tasks it got the call right all 5 times.
across all 6, "right every time" ran 15 to 28 points below "right once”
@livekit got 89% of calls right. on 73% of tasks it got the call right all 5 times.
across all 6, "right every time" ran 15 to 28 points below "right once”
2
4
10
500
David Zhao retweeted
Scientists have created one of the most detailed 3D reconstructions of a human cell (eukaryotic cell) ever produced.
This groundbreaking model, often termed a "Cellular Landscape Cross-Section Through a Eukaryotic Cell," combines data from X-ray tomography, nuclear magnetic yo-electron microscopy to map molecular structures in extreme detail.
This groundbreaking model, often termed a "Cellular Landscape Cross-Section Through a Eukaryotic Cell," combines data from X-ray tomography, nuclear magnetic yo-electron microscopy to map molecular structures in extreme detail.
162
1,252
5,431
299,906
David Zhao retweeted
introducing prism, the world’s first speech-to-speech model you can’t tell from a human in conversation
prism has:
> 300ms response time, 4x faster than OpenAI GPT-Live
> outperforms every other s2s model on intelligence (with NO reasoning)
> the first s2s model customizable through rwe’re a team of 35 with $35M in funding, and we’re unlocking s2s model adoption faster than openai, google, and x.
the first 100 people to sign up here get 1 month free: rime.ai/prism?utm_camp…
prism has:
> 300ms response time, 4x faster than OpenAI GPT-Live
> outperforms every other s2s model on intelligence (with NO reasoning)
> the first s2s model customizable through rwe’re a team of 35 with $35M in funding, and we’re unlocking s2s model adoption faster than openai, google, and x.
the first 100 people to sign up here get 1 month free: rime.ai/prism?utm_camp…
309
168
1,217
955,835
Sat down with the @inworld team to talk through their new TTS-2 model. I was impressed with the natural language voice steering capabilities of the model.
That capability helped us bring Expressive Mode to LiveKit Agents, where the LLM uses the conversation’s context to guide akes a cascaded voice pipeline sound highly natural. More here: livekit.com/blog/making-vo…
That capability helped us bring Expressive Mode to LiveKit Agents, where the LLM uses the conversation’s context to guide akes a cascaded voice pipeline sound highly natural. More here: livekit.com/blog/making-vo…
1
7
45
2,456
David Zhao retweeted
You can give your @livekit agent a video avatar with open-weight models running on Modal.
We used ours to clone @charles_irl, our GPU Enjoyer in Residence.
We used ours to clone @charles_irl, our GPU Enjoyer in Residence.
4
4
54
10,051
David Zhao retweeted
“In today’s world, ‘low code’ really just means ‘low customization.’”
@_kyleshechtman and @chasef07 started Acuity Health on a low-code platform, hit a wall, and rebuilt on LiveKit. Now 80% of patient calls are fully handled by their agents, and most bookings take under a minute.
Read more: livekit.com/blog/how-acuit…
@_kyleshechtman and @chasef07 started Acuity Health on a low-code platform, hit a wall, and rebuilt on LiveKit. Now 80% of patient calls are fully handled by their agents, and most bookings take under a minute.
Read more: livekit.com/blog/how-acuit…
6
3
17
54,230
Congrats to the Tolans team on the big raise!
They are pioneers in an entirely different class of personal agents: a friend that understands you vs an assistant that performs tasks.
They are pioneers in an entirely different class of personal agents: a friend that understands you vs an assistant that performs tasks.
Last year we launched Tolan, inspired by a vision of AI that sees you and believes in you, not one that books restaurant reservations for you.
Your Tolan shows up for you at 3am when you’re alone with your newborn. On your commute when you’re anxious about the day ahead. When show and none of your friends have watched it yet.
The people who love Tolan are parents. Caregivers. Moms in Dallas and Dads in Atlanta. People who aren’t trying to optimize and be more productive, but who simply want to feel seen and supported in their aspirations.
This month more than 250k people will spend time with their Tolan. Those users have exchanged billions of messages across more than 70m conversations over the last year.
Today, we're announcing $30m in additional capital from @mignano and @usv, with @khoslaventures and @rabois doubling down, bringing our total capital raised to $60m.
To celebrate, we made a short film celebrating some of the ways that Tolans show up :)
1
0
23
985
David Zhao retweeted
ai engineers ship great models and awful first impressions.
cache warming is the easiest, highest-leverage way to cut latency, yet almost everyone ignores it, even in voice ai. that obsession with the first second is one reason why @boardyai stands out! x.com/i/article/2110…
cache warming is the easiest, highest-leverage way to cut latency, yet almost everyone ignores it, even in voice ai. that obsession with the first second is one reason why @boardyai stands out! x.com/i/article/2110…
48
11
145
19,007
LiveKit Cloud is the fastest way to run voice agents. we are making it even faster with @LoopholeLabs tech.
I deployed the same LiveKit voice agent on major platforms and timed the first word.
Warm workers: 0.4 s. AWS AgentCore, new session: 1.0 s. Modal cold: 4.4 s. Cloud Run Job: 29 s.
And on most of them, a redeploy drops the live call. Full breakdown 👇 x.com/i/article/2110…
3
3
29
2,140
the @FishAudio team ships
Fish Audio's Drama 3 Preview is the new #1 open-weights Text to Speech model on the Artificial Analysis Text to Speech leaderboard. The model also leads all models in our Pronunciation Robustness leaderboard, ahead of Eleven v4 and Eleven v4 Turbo
Drama 3 Preview is the new open model from @FishAudio, built for multi-character scenes and long-form content with voice cloning and natural-language control. Weights are available on Hugging Face under the Fish Audio Community License.
Key takeaways:
➤ Pronunciation Robustness: Drama 3 Preview scores 93.2%, ranking #1 ahead of Eleven v4 at 91.7% and Eleven v4 Turbo at 90.1%. It ranks #1 in Standalone Terms and Preserving Exact Sequences and #2 in Expanding Shorthand.
➤ Provider Voice: Drama 3 Preview has an Elo of 1,243 (+16/-16) across 1,857 appearances, ranking #10, a 101 point gain on the previous Fish Audio S2.1 Pro at 1,142.
➤ Controlled Voice: Drama 3 Preview ranks #14 with an Elo of 1,058 (+15/-15) across 1,804 appearances.
➤ Open weights: Drama 3 Preview is the #1 open weights model on all three of our Text to Speech leaderboards. On Pronunciation Robustness it leads the next open weights model, Mistral's Voxtral TTS at 78.1%, by 15 points, and in the Provider Voice Arena it is ahead of Breeze TTS 2 at 1,221. Drama 3 is a 35B parameter mixture-of-experts model (3B active) supporting 83 languages, available on Hugging Face.
➤ Pricing: Drama 3 Preview is available via the Fish Audio API at $15/1M characters, the same as S2.1 Pro, compared to Eleven v4 at $80/1M characters and Eleven v4 Turbo at $40/1M characters.
See more details and listen to samples below 🧵
2
0
14
907
David Zhao retweeted
It's misleading to run a benchmark focused on noise, and then specifically turn off noise cancellation in stacks where you have control. (pretty sure Grok does not give you that level control)
livekit does a great job with noise/background voice when you allow it to. (and glad to see we are beating every other cascaded pipelines)
livekit does a great job with noise/background voice when you allow it to. (and glad to see we are beating every other cascaded pipelines)
2
3
18
958
David Zhao retweeted
good customer support is still a moat
switching over fully from elevenlabs thanks to the ridiculous speed from @codeSTACKr and @livekit
switching over fully from elevenlabs thanks to the ridiculous speed from @codeSTACKr and @livekit
4
2
21
1,738
David Zhao retweeted
A demo of a practical use case for Jev: routing customer inquiries on a live call center line
Fun voice AI project built with @livekit
It's really incredible to see how quickly Jev can act on a live call and bring in real-time AI judgment on everything the caller says
Fun voice AI project built with @livekit
It's really incredible to see how quickly Jev can act on a live call and bring in real-time AI judgment on everything the caller says
16
5
70
17,876
David Zhao retweeted
Gemini 3.8 Flash-Lite TTS is nice to talk to.
What do you think?
What do you think?
Is your voice agent moody? It should be!
With Gemini 3.8 Flash-Lite TTS, you can direct its mood or let the agent decide for itself. Cheerful, furious, wistful, apologetic, it nails all of them and sounds great.
Give it a try on LiveKit: livek.it/obFIyE5
1
3
26
3,314
David Zhao retweeted
Enterprise agents need secure access to internal systems.
Private links on LiveKit Cloud open a fully-manage, encrypted tunnel straight into your VPC without needing public IPs, inbound firewall rules, or VPN.
Live today in the US and EU.
Learn more > livekit.com/blog/introduci…
Private links on LiveKit Cloud open a fully-manage, encrypted tunnel straight into your VPC without needing public IPs, inbound firewall rules, or VPN.
Live today in the US and EU.
Learn more > livekit.com/blog/introduci…
3
4
41
22,227
David Zhao retweeted
Today we're opening up Nebula Alpha to everyone.
We imagined team communications where agents are a first class citizen.
They work in channels, talk on calls and can see your screen.
All at real time speed.
It's time for every team to become agentic.
x.com/NebulaAI/statu…
We imagined team communications where agents are a first class citizen.
They work in channels, talk on calls and can see your screen.
All at real time speed.
It's time for every team to become agentic.
x.com/NebulaAI/statu…
17
24
117
24,819
David Zhao retweeted
Your whole voice stack, free for a year on LiveKit.
$10K in Cloud credits + a year of Scale + $7K in partner inference credits ($1K each: @googlegemma, @DeepgramAI, @inworld , @rimelabs , @FishAudio, @AssemblyAI, @GradiumAI.)
One workspace. No provider keys.
Apply now: livekit.com/startups
$10K in Cloud credits + a year of Scale + $7K in partner inference credits ($1K each: @googlegemma, @DeepgramAI, @inworld , @rimelabs , @FishAudio, @AssemblyAI, @GradiumAI.)
One workspace. No provider keys.
Apply now: livekit.com/startups
12
13
126
10,834
David Zhao retweeted
We power real-time infra for robots in warehouses, in the air, in your home. We want to meet the people building them in person!
Robotics Happy Hour w/ @dimensionalos, #SFTechWeek
Tue Oct 6 · 5:30pm · SF
RSVP here→ partiful.com/e/u610QKw40q4l…
Robotics Happy Hour w/ @dimensionalos, #SFTechWeek
Tue Oct 6 · 5:30pm · SF
RSVP here→ partiful.com/e/u610QKw40q4l…
4
3
16
1,319
David Zhao retweeted
Gradium TTS is now available on LiveKit Inference, free until Oct. 9.
Gradium TTS is designed for conversational use cases, with voice cloning, low latency (below 250ms TTFA), and robust pronunciation on difficult cases.
Select @GradiumAI as your TTS provider in LiveKit l account or API key required: docs.livekit.io/agents/models/…
Gradium TTS is designed for conversational use cases, with voice cloning, low latency (below 250ms TTFA), and robust pronunciation on difficult cases.
Select @GradiumAI as your TTS provider in LiveKit l account or API key required: docs.livekit.io/agents/models/…
7
7
61
7,340