Karafka is a Ruby and Rails efficient Kafka processing framework.
Karafka allows you to capture everything that happens in your systems in large scale, without having to focus on things that are not your business domain.
Karafka is a Ruby and Rails multi-threaded efficient Kafka processing framework that:
- Has a built-inWeb UIproviding a convenient way to monitor and manage Karafka-based applications.
- Supports parallel processing inmultiple threads(also for asingle topic partitionwork) andprocesses.
- Automatically integrateswith Ruby on Rails
- HasActiveJob backendsupport (includingordered jobs)
- Has a seamlessDead Letter Queuefunctionality built-in
- Supports in-developmentcode reloading
- Is powered bylibrdkafka(the Apache Kafka C/C++ client library)
- Has an out-of the boxAppSignalandStatsD/DataDogmonitoring with dashboard templates.
If you're entirely new to the subject, you can start with our "Kafka on Rails" articles series, which will get you up and running with the terminology and basic ideas behind using Kafka:
- Kafka on Rails: Using Kafka with Ruby on Rails – Part 1 – Kafka basics and its advantages
- Kafka on Rails: Using Kafka with Ruby on Rails – Part 2 – Getting started with Rails and Kafka
If you want to get started with Kafka and Karafka as fast as possible, then the best idea is to visit ourGetting startedguides and theexample apps repository.
We also maintain manyintegration specsillustrating various use-cases and features of the framework.
I also sell Karafka Pro subscriptions. It includes a commercial-friendly license, priority support, architecture consultations, enhanced Web UI, and high throughput data processing-related features (virtual partitions, long-running jobs, and more).
10%of the income will be distributed back to other OSS projects that Karafka uses under the hood.
Help me provide high-quality open-source software. Please see the Karafkahomepagefor more details.
Karafka hasWiki pagesfor almost everything and a pretty decentFAQ.It covers the installation, setup, and deployment, along with other useful details on how to run Karafka.
If you have questions about using Karafka, feel free to join ourSlackchannel.
Karafka haspriority supportfor technical and architectural questions that is part of the Karafka Pro subscription.
