Rare to hear people talking about the largest production training runs on earth. Excited to hear from the goat Rohan Anil at #reverie2026
1
0
4
189
Lei Xu retweeted
Who gets to shape the future of AI?
Today we're bringing together some of the biggest voices in open models, data, and agents to answer that question, including @rbren_dev of @OpenHandsDev, @zlxi02 of @inferact, @GerryFPatia of @boltdotnew, @vinaygo of @Amplitude_HQ and @latkins en Intelligence Summit, co-hosted with @nvidia.
Watch live, starting at 1 PM PT:
Keynote: youtube.com/live/IhWSgZlVi…
Build: youtube.com/live/eN0TqmeBN…
Serve: youtube.com/live/fkT-MhcAm…
Run: youtube.com/live/QMrY1xZ-x…
Today we're bringing together some of the biggest voices in open models, data, and agents to answer that question, including @rbren_dev of @OpenHandsDev, @zlxi02 of @inferact, @GerryFPatia of @boltdotnew, @vinaygo of @Amplitude_HQ and @latkins en Intelligence Summit, co-hosted with @nvidia.
Watch live, starting at 1 PM PT:
Keynote: youtube.com/live/IhWSgZlVi…
Build: youtube.com/live/eN0TqmeBN…
Serve: youtube.com/live/fkT-MhcAm…
Run: youtube.com/live/QMrY1xZ-x…
93
105
365
1,956,239
Lei Xu retweeted
The best kind of work almost always comes from collaborations!
This time @loldedxd helped me figure out the internal workings on funes. While I knew how to make funes work, he made sure I understand how things run on my system.
It is a fun 30 mins read.
huggingface.co/blog/ariG23498…
This time @loldedxd helped me figure out the internal workings on funes. While I knew how to make funes work, he made sure I understand how things run on my system.
It is a fun 30 mins read.
huggingface.co/blog/ariG23498…
1
11
63
1,363
Lei Xu retweeted
Just merged into Lance: a completely new FTS index layout
🚀 9.35x faster index builds (34s → 3.6s)
🚀 8.87x smaller index size (955MB → 107MB)
🚀 3.41x faster phrase queries (21ms → 6ms)
Block bitpacking + delta encoding + new phrase query algo.
Opt in today with LANCE_FTS_FORMAT_VERSION=2
github.com/lance-format/l…
🚀 9.35x faster index builds (34s → 3.6s)
🚀 8.87x smaller index size (955MB → 107MB)
🚀 3.41x faster phrase queries (21ms → 6ms)
Block bitpacking + delta encoding + new phrase query algo.
Opt in today with LANCE_FTS_FORMAT_VERSION=2
github.com/lance-format/l…
1
7
40
2,507
Lei Xu retweeted
We can just build.
I build this as a toy project but now it’s available to all duckdb users over the world. So amazing!
Let me what we should build next 🙌
I build this as a toy project but now it’s available to all duckdb users over the world. So amazing!
Let me what we should build next 🙌
Excited to announce that Lance is now a 𝗰𝗼𝗿𝗲 𝗲𝘅𝘁𝗲𝗻𝘀𝗶𝗼𝗻 of @duckdb! 🦆🚀
The Lance core extension allows DuckDB users to read and write Lance tables, enabling advanced operations directly within DuckDB, including vector similarity search, full-text search, and hybrid S3-based datasets.
1
3
15
3,525
Lei Xu retweeted
@lancedb @huggingface vector search on a 10TB dataset on HF without any separate serving system is crazy !
0
1
6
119
Lei Xu retweeted
1/5 Large multimodal blobs don’t have to break dataset workflows.
Images and videos are often treated as external files, separate from metadata and indexes. Once datasets get large, that split makes exploration, curation, and training painful.
Lance changes that on the 🤗 @huggingface Hub. 🧵👇
Images and videos are often treated as external files, separate from metadata and indexes. Once datasets get large, that split makes exploration, curation, and training painful.
Lance changes that on the 🤗 @huggingface Hub. 🧵👇
2
9
21
2,565
Lei Xu retweeted
Capping off a cold, wintry, locked-in day ☕️ with this AWESOME PR on a graph benchmark, it totally made my day.
The #Lance format is something to hold close to the heart 🤗, and there's LOTS more to do on the lance-graph front, stay tuned!
See: github.com/prrao87/graph-…
The #Lance format is something to hold close to the heart 🤗, and there's LOTS more to do on the lance-graph front, stay tuned!
See: github.com/prrao87/graph-…
1
3
13
1,787
Lei Xu retweeted
exa-d uses
@raydistributed pipeline execution for incremental recomputation
@lancedb for surgical column patching per fragment
@raydistributed pipeline execution for incremental recomputation
@lancedb for surgical column patching per fragment
What does it take to store the web as a database?
exa-d is our internal data framework that orchestrates declarative typed dependencies, sparse updates with precise granularity, efficient and parallel execution across scaling compute, and more.
exa.ai/blog/exa-d
0
1
18
1,065
Exa team is amazing early adopter of the @lancedb Lance format. Proudly collaborating with them along the way.
What does it take to store the web as a database?
exa-d is our internal data framework that orchestrates declarative typed dependencies, sparse updates with precise granularity, efficient and parallel execution across scaling compute, and more.
exa.ai/blog/exa-d
0
0
3
372
This was the most exciting development during last Christmas.
1/5 @lancedb 🫶🏻 @duckdb
We’re happy to announce a new Lance extension for DuckDB! You can simply install this extension in DuckDB and point at your Lance datasets from within a DuckDB CLI or a Python script, while getting 𝗳𝘂𝗹𝗹 𝗦𝗤𝗟 𝗰𝗮𝗽𝗮𝗯𝗶𝗹𝗶𝘁𝗶𝗲𝘀 𝗼𝗻 𝘁𝗼𝗽 𝗼𝗳 our data!
0
0
0
143
Lei Xu retweeted
1/5 In this blog post, we discuss what we mean by “multimodal” and the different lenses through which it can be viewed. Rather than thinking of “multimodal” as just a content label (text, images or video/audio), it makes sense to think of it at a *system* level.
1
4
9
805
Lei Xu retweeted
Alright, let's go! Once the @duckdb team approves my extension bump PR, we'll be able to use all those fancy features!
Today is family day, so I didn’t get much work done. I spent some time cleaning up and polishing the documentation to prepare for the v0.3.0 release.
2
1
8
2,565
Lei Xu retweeted
lance-duckdb v0.2.0 is coming!
This version will have:
- vector/fts/hybird search in @lancedb
- native support of @duckdb 's secret system
- filter & project pushdown to @lancedb
- native support of @huggingface fs
- explain diagnostics support
This version will have:
- vector/fts/hybird search in @lancedb
- native support of @duckdb 's secret system
- filter & project pushdown to @lancedb
- native support of @huggingface fs
- explain diagnostics support
The holiday has just begun!
@duckdb now supports Vector Search, Full-Text Search, and Fuzzy Search on @lancedb!
1
6
13
7,893