morgan gallant retweeted
In lieu of flowers, memorial contributions may be made to:
Johns Hopkins Alzheimer’s Disease Research Center Fund
alzresearch.org/giving/
Alzheimer’s Foundation of America Caregiver Resources
alzfdn.org/donate/
Photo Credit: Tommy Garcia
Johns Hopkins Alzheimer’s Disease Research Center Fund
alzresearch.org/giving/
Alzheimer’s Foundation of America Caregiver Resources
alzfdn.org/donate/
Photo Credit: Tommy Garcia
6,667
79,686
345,306
11,528,629
it’s exceptionally not cool to find someone’s personal phone number online and cold call them trying to sell to the company where they work at
two thoughts:
- will make damn well sure tpuf never uses pump.co
- objectively funny company name
two thoughts:
- will make damn well sure tpuf never uses pump.co
- objectively funny company name
0
1
14
667
morgan gallant retweeted
new: highlighting
extract the text fragments most relevant to a query
→ highlight matches in your search results UI
→ minimize context passed to your LLM
docs (and playground): turbopuffer.com/docs/fts#highl…
extract the text fragments most relevant to a query
→ highlight matches in your search results UI
→ minimize context passed to your LLM
docs (and playground): turbopuffer.com/docs/fts#highl…
3
8
192
10,189
latency(tpuf search w/ native embeddings) < latency(fetch embedding) + latency(tpuf search)
makes for some beautiful traces
makes for some beautiful traces
now in beta: native embeddings in tpuf
embedding is the most painful part of puffing. we want to make it easy
you can now convert chunks to vectors as you read and write to turbopuffer, without extra calls to an embedding model provider API
docs: turbopuffer.com/docs/embedding
0
1
11
1,127
morgan gallant retweeted
Globe&Mail wrote a generous piece about turbopuffer theglobeandmail.com/business/artic…
27
16
259
33,730
TIL: script.google.com lets you run automations on your calendar(s). in this case, running an hourly sync of a personal calendar (only specific events) to your work calendar as "busy" events
2
1
9
528
excited to get this out there in the hopes that other folks can benefit from our work here! a lot goes into making a good tokenizer
also wanna make sure I thank the tantivy folks, we've built our earlier tokenizers (everything before word_v4) atop their lovely open sourced work
also wanna make sure I thank the tantivy folks, we've built our earlier tokenizers (everything before word_v4) atop their lovely open sourced work
so @morgallant has optimized FTS tokenization throughput to 423 MiB/s and open-sourced it (github.com/turbopuffer/al…)
I keep telling him that it would be really high agency to get to DRAM bandwidth (~100 GiB/s), and he keeps getting annoyed at me and making it faster
3
1
13
1,792
fangirling over being on dash 8 for the first time in a while — i think my first ever flight was on a dash 8!!!
1
1
6
783
morgan gallant retweeted
BM25 efficiently scores text, but relevance often depends on more than text (recency, popularity, PageRank)
we score non-text attributes as clauses in the same MAXSCORE plan that evaluates BM25 → better first-stage relevance, still scales to 100M+
tpuf.link/rank-by-attr
we score non-text attributes as clauses in the same MAXSCORE plan that evaluates BM25 → better first-stage relevance, still scales to 100M+
tpuf.link/rank-by-attr
0
12
124
21,338
hoping to write a blog post on this eventually, it's a fascinating topic.. so many different possible approaches, each with their own tradeoffs. for v1, as is always the case at tpuf, we've optimized for simplicity
new in tpuf: regex indexes
regex and glob filters can now use a trigram index to avoid full-table scans
2
1
8
969
btw hiring for a systems eng. role at @turbopuffer soon on the text team, you’d work closely w/ @jpountz and I on billion-scale {storage,ranking,query eval}. DMs open!
9
20
213
37,723
joint work with @jpountz, covers some of the storage work behind the ftsv2 launch!
for FTS v2, we redesigned our inverted index structure
• tighter compression
• less KV overhead
• better MAXSCORE interaction
up to 10x smaller indexes → up to 20x faster text search!
tpuf.link/fts-index
1
0
6
2,253
still in awe of the talent density on the @turbopuffer team… truly such an honour and a privilege to get to work with these folks every day
7
3
99
8,809
rewrote my website, again: morgangallant.com/blog/website-r…
3
1
13
1,561
I really hope that the continued success of Zig will help convince more systems programmers that treating memory allocations as infallible is a terrible idea for PLs, and that OS-level memory overcommits in Linux server environments is similarly terrible!
0
1
7
1,313
joint work with @jpountz and @nikhilbenesch; excited to start rolling this out more broadly! insane amount of progress on FTS recently :)
FTS v2: up to 20x faster full-text search
turbopuffer is now on par with Tantivy and Lucene for many queries, more to come
v2 now in beta. 2 PRs away from all query plans being implemented. will be enabled in prod for all, shortly.
0
1
16
10,549
morgan gallant retweeted
Something that's great with Lucene is how you can run luceneutil benchmarks on a PR to assess the performance impact. So I built something similar for turbopuffer (off the Tantivy benchmark!). Here, baseline is what runs in production now, contender is what will get deployed soon
0
2
32
9,375
hand-rolled a fully uax#29-compliant tokenizer today, brain is a little fried but it was lowkey pretty fun
2
1
4
892
one of my favourite ways to deploy to @Railway! build the binary locally, package it up in a light alpine image and ship it off
1
1
8
1,267