I'm noticing a growing trend of using #S3 instead of traditional databases or block storage in products, which significantly reduces costs.

We've transitioned to using #Quickwit, an analytics and search engine for #OpenTelemetry tracing and logging. It can also be used as a #Jaeger storage backend.

You can easily integrate Jaeger with #Grafana, using Quickwit for S3-based storage. All data is stored in S3, resulting in a time-to-search of just 45 seconds, which is impressive. The time-to-read is nearly 70 ms.

Quickwit is written in Rust and packaged as a single binary, easy to install and deploy. Combined with Grafana, Jaeger and S3, it creates a powerful setup for observability.

Quickwit stores logs and traces in S3, while Grafana provides a flexible dashboard for visualizing and analyzing the data. This combination offers fast search performance and scalable storage without the complexity of traditional ELK stacks—no Java, yay!

#Turbopuffer also caught my attention—a serverless vector database that leverages S3 for storage. It offers a cost advantage of 10x-100x compared to alternative vector database solutions. The biggest user of this technology is Cursor.ai, which is my favorite AI tool for daily use.

Iggy.rs now supports OpenTelemetry logs & traces! From now on, you can have the full insights into your server, including all the necessary details. If you're looking for a blazingly fast OTel compatible tool, check @Quickwit_Inc :)

#iggyrs #otel #opentelemetry

The new Quickwit Grafana plugin 0.4 is out!

Quality of Life features ahead:
- Autocomplete hints
- Enhanced log context XP
- Adhoc Filters and more!

quickwit.io/blog/quickwit-…

💃🏼New blog post about Quickwit's serverless search performance on AWS Lambda & S3 🏇

On the menu:
- Latency on search/analytics queries
- Impact of Lambda size (1GB to 8GB)
- Impact of caching layers
- Beautiful charts to illustrate our findings 😍

=> quickwit.io/blog/quickwit-…

Just finished a short tutorial to get started with @Quickwit_Inc and @redpandadata.

=> github.com/quickwit-oss/t…

The main goal is to demonstrate how easily the indexing is distributed over 3 indexers, each taking a set of partitions of a given topic.

I've heard Bloomberg in NYC might have event space they'd let someone use to host public tech talks.

Do I know anyone who could help me figure out if that's so?

Also, do I know any devs in NYC interested in giving tech talks on any Systems Programming topics?

DMs open. 😀

Waking up... and seeing Quickwit on HN frontpage ❤️

news.ycombinator.com/news

Happy user reporting indexing 1GB/s with Quickwit!

💃🏼 Quickwit 0.6 released!🕺🏼 is released!

It packs an 𝗘𝗹𝗮𝘀𝘁𝗶𝗰𝘀𝗲𝗮𝗿𝗰𝗵 𝗰𝗼𝗺𝗽𝗮𝘁𝗶𝗯𝗹𝗲 𝗔𝗣𝗜
and a 𝗚𝗿𝗮𝗳𝗮𝗻𝗮 plugin!

See more here ⬇️
quickwit.io/blog/quickwit-…

Playing with Quickwit (github.com/quickwit-oss/q…) and my favorite dataset: @githubarchive.

𝟭𝟲𝗧𝗕 𝗼𝗳 𝗝𝗦𝗢𝗡. 𝟱.𝟮𝗯𝗶𝗹𝗹𝗶𝗼𝗻𝘀 𝗱𝗼𝗰𝘀

𝗧𝗵𝗲 𝗶𝗻𝗱𝗲𝘅 𝗶𝘀 𝗼𝗻 𝗦𝟯

With a single server 8vCPUs, 16GB of RAM
`actor.login:fulmicoton` returns 21,473 docs in 5.83s
😍

⭐ Quickwit 0.3 is released ⭐.
A lot of new features for our log Search Engine!
- Aggregations
- Schemaless
- UI
- and more!
quickwit.io/blog/quickwit-…

#rust #quickwit🦀🔍

📽We will be streaming our next event on 25 May, 12pm ET/18pm CEST!
@guilload, our Co-Founder, will present how to use Quickwit to ingest data from #Kafka & #Kinesis and how our indexing engine works.

👉Register:quickwit.io/events/stream-…

#search #devops #dev #selfhosted #rustlang

We just opensourced chitchat: Quickwit's gossip cluster membership. Here is a blog post from @evanxg852000!
quickwit.io/blog/chitchat
github.com/quickwit-oss/c…

Rustaceans in NYC, please join us for @guilload's talk "Intro to Tantivy: a full-text search engine library written in Rust"
meetup.com/Rust-NYC/event…
@Quickwit_Inc #rust #event

Quickwit 0.1 is released! Rejoice!
Search has never been so cost-efficient...
quickwit.io/blog/quickwit-…
quickwit.io/docs/getting-s…

Search 1B pages on AWS S3 for 1000$ / month, made in Rust and tantivy quickwit.io/blog/commoncra…

« French people are... very polite. » Pattern extracted from 1 billion web pages with #Quickwit search engine #Search #S3 common-crawl.quickwit.io/?query=French+… via @Quickwit_inc

Ni Français, ni Malouin, Breton suis #emojibzh

Some people, when confronted with a problem, think "I know, I'll use a mock." Now they have two problems.

.@adriancolyer I discovered the Morning Paper a few days ago. It's brilliant, thank you so much!