I don't think most people realize how powerful (and easy) LLM fine-tuning is. Here's what it gets you and how to do it locally for free
4
1
9
714
Wow @superlogical Rex is very good. Thought I was in love with Herdr for life but I don't think I'm going back. Combining terminal and multiplexer in one app just simplifies things so much
0
0
7
451
More reason not to go anywhere near the Anthropic IPO
Andrej Karpathy:
“A 1B model can be much more effective than most current LLMs.
90% of current models waste a ton of capacity and money on remembering stuff that doesn’t matter.”
here is his 5 core thesis about Small LLM’s:
1. the intelligence was never the knowledge. Strip keep the reasoning. What’s left is the cognitive core, and it’s small.
2. the core might fit in ~1B params. Maybe less. “Plenty of room at the bottom.” We’ve been paying for a library when we needed a brain.
3. size stopped being the bottleneck. What makes an agent work is the tools it can call and how tight the feedback loop is, not parameter count.
4. intelligence lives in the system, not the weights. A raw LLM is a CPU with no OS. Small core + good harness > giant model alone.
5. you can own it. A model on your hardware is one no one can rate-limit, price-hike, or deprecate on you.
in 12 months the gap between teams shipping on-device and teams paying per-token frontier bills won’t be capability.
TwIL an 8.8B model at 90%+ of frontier isn’t a benchmark flex.
It’s the thesis Karpathy’s been repeating all year, made real.
study more on this below ↓
0
0
1
537
I just posted a video comparing 5 different Cloud Providers. To say that I've received some flak for it would be an understatement. The issue was exacerbated by a huge unexpected delay between production and publishing.
youtu.be/YfahrTa3Yb4?si…
youtu.be/YfahrTa3Yb4?si…
How can @CodeToTheMoons recommend railway after everything?
Is this a joke? Not only did they leak customer environment variables but they also had this whole incident with @joshmanders like five minutes ago
youtube.com/watch?v=YfahrT…
1
0
2
319
Rust Atomics are so valuable, but they can be a bit challenging to understand. Here's a full explanation
1
5
39
1,984
plausibility that we are living in a simulation seems very high deepmind.google/blog/genie-4-a…
0
0
2
89
Wow. I still don't understand the economics of companies building these things and releasing the weights, but I'm sure glad they do. Chances of partaking in the Anthropic IPO were already low, and now even lower...
Kimi K3.1 Pro launches at 4th on the Artificial Analysis Intelligence Index scoring 55, making large gains in agentic performance; it will be the leading open-weights model once its weights are published
@Kimi_Moonshot's new reasoning model gains 11 points over Kimi K3 (max, ude Opus 5.5 (max with fallback, 58), Claude Sonnet 5.5 (max with fallback, 56), and Muse Wonder Full (max, 56) on the Intelligence Index.
Once the weights for K3.1 Pro are released it will be the highest-scoring open weights model and the gap between the leading open weights and proprietary models on the Intelligence Index will narrow from 12 points to 3.
Key results:
➤ Large gains in agentic performance: Kimi K3.1 Pro scores 3rd on GDPval-AA with 1,846 Elo, up 312 Elo from Kimi K3, behind only Claude Opus 5.5 (1,866 Elo) and Muse Wonder Full (1,857 Elo). Kimi K3.1 Pro also achieves the highest score of any model on Terminal-Bench 4.0. K3.1 Pro scores 67%, up from 13% for Kimi K3 and ahead of Claude Sonnet 5.5 (64%). AutomationBench-AA, which tests agentic SaaS workflows, rises from 58% to 73%.
➤ Gains in other evals are more moderate: Humanity's Last Exam rises from 47% to 52%, CritPt from 23% to 25%, and SciCode from 59% to 61%. AA-Omniscience Index rises from 20 to 30, as the hallucination rate falls from 53% to 44% and accuracy rises from 48% to 51%.
➤ Cost per Task roughly equal to Kimi K3 at $1.98 per Task: K3.1 Pro uses 55K output tokens per Intelligence Index task, 14% more than Kimi K3 at 48K, while its first-party token prices are 33% lower.
Additional model details:
➤ Context window: 1M tokens.
➤ Size: 2.8T total, 104B active parameters
➤ Input modalities: Text and image
➤ Weights and license: Weights currently not published, Moonshot is expected to release the weights soon after launch
➤ Pricing: $2/$10/$0.20 per 1M input/output/cache hit tokens, 33% lower than Kimi K3 on all three rates.
Congratulations to the team at @Kimi_Moonshot on the release!
0
0
1
159
Ok, I asked Opus 5.5 to do this. In 18 minutes it had written a full SNES emulator in Rust from scratch, loaded the game and it was playable. Wow.
This isn't the end goal, but it insists the best strategy is to start with running the original machine code and iteratively porting functionality to Rust. I guess that makes sense. What am I getting into....
This isn't the end goal, but it insists the best strategy is to start with running the original machine code and iteratively porting functionality to Rust. I guess that makes sense. What am I getting into....
has anyone tried pointing a harness to an SNES ROM for a reverse engineer / Rust rewrite? Mega Man X written in Rust currently floating around in my dreams...
0
1
6
662
has anyone tried pointing a harness to an SNES ROM for a reverse engineer / Rust rewrite? Mega Man X written in Rust currently floating around in my dreams...
0
0
0
831
Sweet, was about to sign up for Anthropic again, guess I don't have to now...
Introducing Gemini 4 Argon – our new frontier model.
It’s built for complex workflows across coding, enterprise knowledge work, and cybersecurity defense – rolling out today to a set of trusted testers through our Fairwind Program.
0
0
1
191
I'm all for building software fast. But now everything can completely change in the time between filming a video and publishing it 😬
1
0
6
463
its out!
Bun 1.4
- Fixes over 2,900 GitHub issues
- +1,517 tests from the Node.js test suite
- Reduces idle CPU by 5x
- Reduces memory usage by up to 35%
- Starts up to 50% faster on Linux
- Rewrites Bun in Rust
Thank you everyone who contributed since Bun 1.3!
bun.com/blog/bun-v1.4
1
0
3
346
After being AWS-pilled for 10 years I just learned what GitOps is. Which ostensibly became popular 5 years ago?
Man I am late to this party but I'm sure glad I made it
Man I am late to this party but I'm sure glad I made it
0
0
3
277
Ken_dev retweeted
Ever wondered how to build a serverless compute platform in Rust? 🚀
In his latest video, @CodeToTheMoons walks through the architecture behind Spacefare, sharing the technical decisions, implementation details and how Rhai and Boa made the project possible.
Watch now 👇
youtube.com/watch?v=EW724C…
In his latest video, @CodeToTheMoons walks through the architecture behind Spacefare, sharing the technical decisions, implementation details and how Rhai and Boa made the project possible.
Watch now 👇
youtube.com/watch?v=EW724C…
0
5
29
1,799









