Pinned Tweet
Today is a day I’ll never forget.
I grew up in Cupertino.
My dad was a tech founder in the 80s/90s.
I was in YC S07.
LiveKit is my 5th company.
The first 4 didn’t work out.
I’ve had a lot of advantages — it still took 20 years to get here.
Founders: keep taking shots.
I grew up in Cupertino.
My dad was a tech founder in the 80s/90s.
I was in YC S07.
LiveKit is my 5th company.
The first 4 didn’t work out.
I’ve had a lot of advantages — it still took 20 years to get here.
Founders: keep taking shots.
We learn to speak before we learn to read.
Voice is the most natural interface we have.
We just raised a $100M to make building voice AI as easy as a web app.
84
39
941
105,824
dsa retweeted
it's crazy that dream-1 (@dreamlabs_ai) literally just works
i'm at home in vietnam, testing a robot in the @dimensionalos office in sf, for our hackathon with @makermodsai
it's quite surreal to see the thing works 13000km away
@livekit is sponsoring this hack, we provide a participants using livekit-portal, but it can also be used for distillation
i would love to see someone distill dream-1 to a smaller policy, then do RL in real life to hill climb the challenge (good way to win the hack)
another idea is policy escalation, you can detect failures and use dream-1 or another fine-tuned better policy to resolve failures
anyway, the possibilities are endless with portal's multi-participant capabilities.
i'm at home in vietnam, testing a robot in the @dimensionalos office in sf, for our hackathon with @makermodsai
it's quite surreal to see the thing works 13000km away
@livekit is sponsoring this hack, we provide a participants using livekit-portal, but it can also be used for distillation
i would love to see someone distill dream-1 to a smaller policy, then do RL in real life to hill climb the challenge (good way to win the hack)
another idea is policy escalation, you can detect failures and use dream-1 or another fine-tuned better policy to resolve failures
anyway, the possibilities are endless with portal's multi-participant capabilities.
We're hosting another Physical AI Hack this weekend, November 7–8 at @fdotinc in San Francisco.
This time, we're partnering with @dreamlabs_ai and their new world action model, Dream-1, which can do tasks zero-shot. @livekit @nvidia @huggingface @dimensionalos @enact_labs are it is the real-time layer: connect your robot to human operators and cloud models with ultra low latency, then give it a voice agent so you can talk to it. You'll get LiveKit credits for real-time streaming and voice agents.
Other technical partners: @_lightcompany @mirdainsystems @SGhashghaei @spcxstarship
Prizes:
1st place: $2,000 + a Metal Arm + credits
2nd place: $1000 + a Maker Arm + credits
3rd place: $500 + a Reachy Mini + credits
Sign Up: luma.com/pah
There are two tracks:
Hill climb (New Track):
This is a new format where everyone works to improve the model's accuracy on the same task. We'll announce the task soon and provide the props. You'll climb the leaderboard through fine-tuning, DAgger and a System 2 agent harness around Dream-1, using LiveKit and Dimensional OS.
Creative (Zero shot):
Build the most creative project you can with Dream-1, LiveKit and Dimensional OS.
5
5
50
2,625
dsa retweeted
Since August, Harley, the voice agent we built on @livekit, has run 10,000+ insurance onboarding calls. Average call time is down 63%, and quotes take two or three seconds on hold, not a day or two.
My first engineering post @Harper_Insure, on how we built it: harperinsure.com/engineering/ha…
My first engineering post @Harper_Insure, on how we built it: harperinsure.com/engineering/ha…
2
3
18
1,842
dsa retweeted
Everyone knows ElevenLabs as TTS, but how does their new S2S model perform? x.com/i/article/2113…
1
1
6
341
Amazing model but fyi a whale isn’t a fish
$52M seed round. 15M+ users. But this is what we're most proud of yet.
Introducing Drama 3: the most emotive and controllable TTS model in the world
And yes, it's open-weight.
You can now control how even a single word should sound, change its tone, and shift your voice ger was impressed too.
Try it here:
s.fish.audio/rqh0l8
Comment “DRAMA” within the next 48 hours for 1 month free.
If you're an enterprise your first month is on us:
s.fish.audio/qz9r0t
3
0
28
2,042
dsa retweeted
good customer support is still a moat
switching over fully from elevenlabs thanks to the ridiculous speed from @codeSTACKr and @livekit
switching over fully from elevenlabs thanks to the ridiculous speed from @codeSTACKr and @livekit
4
2
21
1,738
dsa retweeted
Know exactly what your agent can do, catch gaps before customers do, and test any model against your own scenarios before you switch. Your agent has a QA team now.
Try LiveKit Simulations free through October: livekit.com/products/agent…
Try LiveKit Simulations free through October: livekit.com/products/agent…
5
4
42
2,513
based
On my way to the @livekit company retreat in Cancun. Half my suitcase is filled with robots and robot accesories. 🤖
0
0
18
1,341
dsa retweeted
Your whole voice stack, free for a year on LiveKit.
$10K in Cloud credits + a year of Scale + $7K in partner inference credits ($1K each: @googlegemma, @DeepgramAI, @inworld , @rimelabs , @FishAudio, @AssemblyAI, @GradiumAI.)
One workspace. No provider keys.
Apply now: livekit.com/startups
$10K in Cloud credits + a year of Scale + $7K in partner inference credits ($1K each: @googlegemma, @DeepgramAI, @inworld , @rimelabs , @FishAudio, @AssemblyAI, @GradiumAI.)
One workspace. No provider keys.
Apply now: livekit.com/startups
12
13
126
10,833
dsa retweeted
GPT-Live-1 @openaidevs is now supported in LiveKit Agents. It's full-duplex, so it listens and speaks at the same time instead of taking turns, and it hands reasoning and tool calls off to a backend model so a slow lookup doesn't leave your agent sitting in dead air.
Same plugin: `GPTLiveModel`.
Get started: docs.livekit.io/agents/models/…
Same plugin: `GPTLiveModel`.
Get started: docs.livekit.io/agents/models/…
25
24
340
85,304
dsa retweeted
LiveKit Connectors are generally available today.
They bring calls from @twilio Programmable Voice and @WhatsApp Business Calling into a LiveKit room as a regular participant, so your agent can answer there with no SIP trunk to provision and nothing new to host.
Read the full vj1Crwg3r
They bring calls from @twilio Programmable Voice and @WhatsApp Business Calling into a LiveKit room as a regular participant, so your agent can answer there with no SIP trunk to provision and nothing new to host.
Read the full vj1Crwg3r
6
12
117
8,824
dsa retweeted
Realtime TTS-2 is GA today, now the #1 model on Artificial Analysis and fastest TTS in the world of its class.
The research preview got far more usage than expected. That experience went back into research and today's GA model represents the biggest leap in Inworld's history.
The research preview got far more usage than expected. That experience went back into research and today's GA model represents the biggest leap in Inworld's history.
173
217
822
1,215,968
dsa retweeted
Introducing Pemba
The first robot to attempt Everest
This fall powered by @livekit, with support from @AskVenice , @eastworlds_io and Reflex
The first robot to attempt Everest
This fall powered by @livekit, with support from @AskVenice , @eastworlds_io and Reflex
60
41
257
109,382
Per-minute metering is an artifact of the telecom industry. Per-second is agent-native.
It's now less expensive to build and run agents on LiveKit.
Agent sessions, recording, WebRTC, and SIP are billed per-second with a 10-second minimum. A 14-second outbound call costs 14 seconds, not a full minute.
No code changes. Just a smaller bill.
Read the full post: bit.ly/4xiKnqX
3
0
25
1,521
dsa retweeted
Protect sensitive data without giving up voice agent observability.
LiveKit PII Redaction automatically removes personal information from transcripts and recordings before it is stored. It is included with LiveKit Agent Observability at no additional cost.
Read more: bit.ly/4gJ1ex7
LiveKit PII Redaction automatically removes personal information from transcripts and recordings before it is stored. It is included with LiveKit Agent Observability at no additional cost.
Read more: bit.ly/4gJ1ex7
6
4
56
108,414
dsa retweeted
1/ Today we're launching Expressive mode in LiveKit Agents.
Most voice agents deliver every sentence in that same, upbeat register we all know and hate (including bad news). Expressive mode makes your agent sound like it registers what the caller is actually feeling.
Most voice agents deliver every sentence in that same, upbeat register we all know and hate (including bad news). Expressive mode makes your agent sound like it registers what the caller is actually feeling.
15
16
329
311,574
dsa retweeted
Here's our take on benchmarks for voice: they're hard to get right, but critical if you're building humanlike AI. Our live benchmarks page is up now: pass rate on real agent scenarios, latency including the worst-case (p99) moments, side-by-side conversation comparison between ack welcome! livekit.com/benchmarks
5
4
62
6,604
dsa retweeted
The YC Office Hours Simulator was a huge success!
These were physical booths at Startup School where attendees could talk to AI avatars of the @ycombinator Partners. We interviewed over 100 attendees about their experience.
Here's a recap 👇️
1️⃣ The #1 complaint = people longer! Most conversations were 10min (the enforced time limit). There was a line of people waiting to talk to the avatars for the entire two-day conference
2️⃣ Some people wished the avatars were meaner or harsher. This was interesting!
3️⃣ Many people took notes (pen & paper, @meetgranola, or typing furiously) and said the conversation was genuinely helpful. Several folks waited in line for a 2nd or 3rd conversation :)
4️⃣ People said the avatar aspect felt different than a chatbot. The "face-to-face" interaction helped them feel a stronger connection, pay more attention, and open up more. A few people even said they forgot it was AI!
5️⃣ The magic moment = when people realized the avatars knew who they were and what they were working on (based on their conference application) 🪄
The "brains" for Office Hours Simulator was trained on hundreds of hours of real office hours. It truly simulated how each Partner talks and the types of questions they like to ask.
Built by the one-and-only @snowmaker and YC software team (so impressive) 👏
Powered by: @lemonslice (live avatars), @elevenlabs @ElevenLabsDevs (voice AI), @livekit (webRTC infra), @deepgramai (voice AI), @ployai (animations), Hamming AI (testing), and many other great companies.
These were physical booths at Startup School where attendees could talk to AI avatars of the @ycombinator Partners. We interviewed over 100 attendees about their experience.
Here's a recap 👇️
1️⃣ The #1 complaint = people longer! Most conversations were 10min (the enforced time limit). There was a line of people waiting to talk to the avatars for the entire two-day conference
2️⃣ Some people wished the avatars were meaner or harsher. This was interesting!
3️⃣ Many people took notes (pen & paper, @meetgranola, or typing furiously) and said the conversation was genuinely helpful. Several folks waited in line for a 2nd or 3rd conversation :)
4️⃣ People said the avatar aspect felt different than a chatbot. The "face-to-face" interaction helped them feel a stronger connection, pay more attention, and open up more. A few people even said they forgot it was AI!
5️⃣ The magic moment = when people realized the avatars knew who they were and what they were working on (based on their conference application) 🪄
The "brains" for Office Hours Simulator was trained on hundreds of hours of real office hours. It truly simulated how each Partner talks and the types of questions they like to ask.
Built by the one-and-only @snowmaker and YC software team (so impressive) 👏
Powered by: @lemonslice (live avatars), @elevenlabs @ElevenLabsDevs (voice AI), @livekit (webRTC infra), @deepgramai (voice AI), @ployai (animations), Hamming AI (testing), and many other great companies.
20
5
85
44,784