Pinned Tweet
Your local agent can now hear what was said, who said it, and what happened around them.
parakeet.cpp transcribes audio, separates speakers, detects 527 sound classes, and now enrolls and remembers named voices across recordings. One pass, local C++.
parakeet.cpp transcribes audio, separates speakers, detects 527 sound classes, and now enrolls and remembers named voices across recordings. One pass, local C++.
9
14
144
6,437
Who could imagine that centralizing VPN access and authorization worldwide would have been such a great idea..
Turn of your Tailscale SSH, people 🫠 tailworm.comCommunity noteThe Tailscale SSH flaws detailed require a compromised but approved device on the tailnet that has been granted SSH access by policy. Tailscale has reviewed the report and stated they do not recommend disabling Tailscale SSH for everyone while they prepare patches. tailworm.com reddit.com/r/Tailscale/co…
2
0
8
866
I really love participating to LUG initiatives and Linux days. The atmosphere, the genuine hunger for knowledge, sharing stories and engineering tips.
Thanks @GiancarloDeGreg, Benevento lug and lilis for hosting my talk!
Thanks @GiancarloDeGreg, Benevento lug and lilis for hosting my talk!
@mudler_it al #linuxdaybenevento ci parla di #LocalAI. Seguici in diretta su #YouTube
youtube.com/live/WuT9p0uu-…
#linuxday #AI #opensource
0
2
8
395
I love this work. Go check out if you have a 3d printer you won't regret. Thanks @mfranz_on!
If you are into 3D printing you should give this a try
2
0
5
588
Flint now is available as APEX quant.
the little I-Mini at 13.8 GiB is the one to try if you're tight on VRAM.
huggingface.co/mudler/flint-A…
Enjoy!
the little I-Mini at 13.8 GiB is the one to try if you're tight on VRAM.
huggingface.co/mudler/flint-A…
Enjoy!
Introducing Flint, @Recursive_SI’s first model: a fast local coding model built with our automated research system, the Eureka Machine.
• Best-in-class fast local coding
• Up to 2x faster than comparable models: 125+ tokens/sec on a MacBook Pro, 150+ on RTX Spark
• Built from hs
Private, unmetered intelligence on your own machine. Open weights available now on @huggingface, run it locally on your favorite framework or try it for free on @opencode or @pidotdev.
4
2
25
1,025
btw in italy we don't use PHP in government. We are all fine, everything is in ASP and Perl
4
0
21
1,057
we have amazing talent here from italy improving the local AI ecosystem, I'm so proud of it 🇮🇹
@francedot
@ivanfioravanti
@justvugg
@mfranz_on
and the fantastic @antirez !
For sure I'm missing many others, just come and say hi. I'd really love to build an Italian AI Builders community!
@francedot
@ivanfioravanti
@justvugg
@mfranz_on
and the fantastic @antirez !
For sure I'm missing many others, just come and say hi. I'd really love to build an Italian AI Builders community!
If you want a Local AI super star to follow here he is @mudler_it 🚀 He is the creator of LocalAI project that has ONLY 50K stars on github.
Keep pushing Ettore!
Link: localai.io
11
2
36
2,313
Ettore Di Giacinto retweeted
@mudler_it The reason I haven't posted about Tankie much more yet. I'm going down the rabbit hole of benchmarking visual/multimodal models for navigation now ;)
0
1
1
151
APEX quant of the new @liquidai model is on its way!
0
3
15
1,039
I'll probably sound grumpy, but I've been involved in OSS for quite a while now. And without pointing fingers or fueling this any further, I just browsed the website of <someone who became very popular recently>, and after just four months, they're already selling books on how to become popular and offering services to set up inference engines, in a way that feels like blatant marketing and community farming.
On top of that, my timeline has been flooded for weeks by now with nonsensical soap-opera posts about he/she fighting with someone else. If you are enjoying a bit of show on socials, go ahead, sure.
But I don't know what to say. It's not the first time something like this has happened, but I've never seen it done so blatantly, and the community seems to be encouraging this behavior.
I really miss the days when we had simple HTML pages explaining the projects we were working on, having a bit of netiquette, talking via mailing lists, maybe with a link or two and a way to support genuine and honest work in the open.
WTF.
On top of that, my timeline has been flooded for weeks by now with nonsensical soap-opera posts about he/she fighting with someone else. If you are enjoying a bit of show on socials, go ahead, sure.
But I don't know what to say. It's not the first time something like this has happened, but I've never seen it done so blatantly, and the community seems to be encouraging this behavior.
I really miss the days when we had simple HTML pages explaining the projects we were working on, having a bit of netiquette, talking via mailing lists, maybe with a link or two and a way to support genuine and honest work in the open.
WTF.
14
1
49
2,942
And this is what should worry you.
I see many users going for speed rather than quality. Sure, speed is great, but at the cost of quality, what's the sense of it? Can you use it besides demos or trust it even for small tasks? Did you really used on a daily basis to see what are the limitations of such quants? going lower than Q4 is really hard to digest if you want to do some (serious) Local AI usage.
Also.. comparing drafters vs non drafters. How does this makes even sense?
I see many users going for speed rather than quality. Sure, speed is great, but at the cost of quality, what's the sense of it? Can you use it besides demos or trust it even for small tasks? Did you really used on a daily basis to see what are the limitations of such quants? going lower than Q4 is really hard to digest if you want to do some (serious) Local AI usage.
Also.. comparing drafters vs non drafters. How does this makes even sense?
Finally we have it:
Strata against llama.cpp on my RTX 5090. Same model file, same prompt. Strata wrote this city in 28.8 s, llama.cpp needed 104.2 s.
The model is Qwen3.8-Flash-Next. It doesn't fit in 32 GB, so part of it sits in system RAM. Strata with MTP writes 204 tok/s, t's 3x. Both pass all 15 quality checks with thinking off.
The catch: ask Strata the same thing twice and you almost never get the exact same text (1 of 27 repeats matched). llama.cpp matched 27 of 27.
21
1
49
6,074
Runs out of the box on parakeet.cpp! Trying it out right now and adding it to @LocalAI_API !
We took NVIDIA's Parakeet and made it better.
Introducing Fluid Speech Mini: the best Open Source Model purpose-built for Dictation 🚀
With SOTA performance under 300 MB
Run it on your iPhone, Mac, or PC. No cloud, no internet.
Dictation shouldn't need a server.
Your voice will make sure of that.
Open weights and more info below!
1
5
16
1,292
A huge thanks to @niels_gron for supporting @LocalAI_API with a brand new M5 Max MacBook Pro!
Generous support like this helps drive open-source forward.
Excited to start optimizing and making all our projects work natively for Apple Silicon!
Generous support like this helps drive open-source forward.
Excited to start optimizing and making all our projects work natively for Apple Silicon!
2
2
19
836
Wow the locate-anything models just reached almost 11M download, and are in the most downloaded models of @huggingface , in the first page !
Thanks @fabiolalli for telling me, I didn't notice 😅
Now, I don't know about the download stats and how that's calculated, but, in any unity is using my locate anything port to @ggml_org ! you can also use it in @LocalAI_API in a couple of clicks away, published for all platforms we support.
In any case, I'm happy to contribute to the Open source community! Let's push Open source Local AI!
Thanks @fabiolalli for telling me, I didn't notice 😅
Now, I don't know about the download stats and how that's calculated, but, in any unity is using my locate anything port to @ggml_org ! you can also use it in @LocalAI_API in a couple of clicks away, published for all platforms we support.
In any case, I'm happy to contribute to the Open source community! Let's push Open source Local AI!
2
4
14
862