Cloud-native search engine for observability (logs, traces, and soon metrics!). An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.
We just released Quickwit 0.8! Read theblog postto learn about the latest powerful features!
Quickwit is the fastest search engine on cloud storage. It's the perfect fit for observability use cases
- Log management
- Distributed tracing
- Metrics support is on the roadmap
- Search and analytics on Stack Overflow dataset
- Trace analytics with Grafana
- Distributed tracing with Jaeger
gharchive-demo.mp4
- Full-text search and aggregation queries
- Elasticsearch-compatible API, use Quickwit with any Elasticsearch or OpenSearch client
- Jaeger-native
- OTEL-native forlogsandtraces
- Schemalessor strict schema inde xing
- Schemaless analytics
- Sub-second search on cloud storage (Amazon S3, Azure Blob Storage, Google Cloud Storage,…)
- Decoupled compute and storage, stateless indexers & searchers
- Grafana data source
- Kubernetes ready - See ourhelm-chart
- RESTful API
- Multipledata sourcesKafka / Kinesis / Pulsar native
- Multi-tenancy: inde xing with many indexes and partitioning
- Retention policies
- Delete tasks (for GDPR use cases)
- Distributed and highly available* engine that scales out in seconds (*HA inde xing only with Kafka)
- Architecture overview
- Log management
- Distributed traces
-
Quickwit 0.9 (July 2024)
- Inde xing and search performance improvements
- Index configuration updates (retention policy, inde xing and search settings)
- Concatenated field
-
Quickwit 0.10 (October 2024)
- Schema (doc mapping) updates
- Native distributed ingestion
- Index templates
Quickwit supports a large subset of Elasticsearch/OpenSearch API.
For instance, it has an ES-compatible ingest API to make it easier to migrate your log shippers (Vector, Fluent Bit, Syslog,...) to Quickwit.
On the search side, the most popular Elasticsearch endpoints, query DSL, and even aggregations are supported.
The list of available endpoints and queries is availablehere,while the list of supported aggregations is availablehere.
Let us know if part of the API you are using is missing!
If the client you are using is refusing to connect to Quickwit due to missing headers, you can use theextra_headersoption in thenode configurationto impersonate any compatible version of Elasticsearch or OpenSearch.
The core difference and advantage of Quickwit is its architecture built from the ground to search on cloud storage. We optimized IO paths, revamped the index data structures and made search stateless and sub-second on cloud storage.
We estimate that Quickwit can be up to 10x cheaper on average than Elastic. To understand how, check out ourblog postabout searching the web on AWS S3.
Quickwit is open-source under the GNU Affero General Public License Version 3 - AGPLv3. Fundamentally, this means you are free to use Quickwit for your project if you don't modify Quickwit. However, if you do and you are distributing your modified version to the public, you have to make the modifications public. We also provide a commercial license for enterprises to provide support and a voice on our roadmap.
HA is available for search, for inde xing it's available only with a Kafka source.
Our business model relies on our commercial license. There is no plan to become SaaS soon.
We are always thrilled to receive contributions: code, documentation, issues, or feedback. Here's how you can help us build the future of log management:
- Start by checking out theGitHub issues labeled "Good first issue".These are a great place for newcomers to contribute.
- Read ourContributor Covenant Code of Conductto understand our community standards.
- Create a fork of Quickwitto have your own copy of the repository where you can make changes.
- To understand how to contribute, read ourcontributing guide.
- Set up your development environment following ourdevelopment setup guide.
- Once you've made your changes and tested them, you can contribute bysubmitting a pull request.
✨ After your contributions are accepted, don't forget to claim your swag by emailing us at[email protected].Thank you for contributing!
We welcome everyone to our community! Whether you're contributing code or just saying hello, we'd love to hear from you. Here's how you can connect with us: