Most popular kafka repositories and open source projects

Orleans.Streams.Kafka jonathansant C#

An implementation of a PersistentStreamProvider for Microsoft Orleans and Kafka using the Confluent API

87 36 7

spark_app_twitter jmcmt87 Python

A data engineering project (Twitter monitor app)

87 13 3

sales-forecast-mlops-at-scale jomariya23156 Jupyter Notebook

Full-stack Highly Scalable Cloud-native Machine Learning system for demand forecasting with realtime data streaming, inference, retraining loop, and m...

87 27 6

kafkalet sneiko TypeScript

A desktop Kafka client for developers who want clarity, not complexity

87 2 0

clojure-kafka-examples perkss Clojure

Clojure examples for Kafka and Kafka Streams (JAVA Interop)

86 10 5

KafkaEsque patschuh Java

Kafka Development Tool

86 24 5

data-lineage-parent thestyleofme Java

数据血缘，Hive/Sqoop/HBase/Spark等，发送到kafka后，解析处理使用neo4j生成血缘

86 53 5

kafka-analyzer superstreamlabs JavaScript

Interactive CLI for analyzing Kafka health and configuration according to best practices and industry standards.

86 7 3

data-processing-pipeline rogaha HTML

Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra

85 27 14

dockerfiles jianyan74 Dockerfile

docker 快速搭建稳定安全的开发/生产环境

85 34 3

kubernetes-kafka kow3ns Makefile

Kafka integration for Kubernetes

85 67 5

chat-app subhnet JavaScript

A Realtime Chat Application built using React and Kafka as MessageBroker

85 72 4

gmqtt hb-chen Go

Golang MQTT Broker.

84 13 3

kafka-elk-docker-compose sermilrod

Deploy ELK stack and kafka with docker-compose

84 74 4

springboot-kafka-connect-debezium-ksqldb ivangfr Java

Experiment with Kafka, Debezium, and ksqlDB. research-service: Performs MySQL record manipulation. Source Connectors: Monitor MySQL changes, push mess...

84 49 2

django-action-triggers Salaah01 Python

A Django library for asynchronously triggering actions in response to database changes. It supports integration with webhooks, message brokers (e.g.,...

84 1 4

kubeblocks-addons apecloud Shell

KubeBlocks add-ons.

84 84 7

event-sourcing-castanha ivanpaulovich C#

An Event Sourcing service template with DDD, TDD and SOLID. It has High Cohesion and Loose Coupling, it's a good start for your next Microservice appl...

83 20 11

community zhengguohuang Java

仿照牛客网实现的讨论区。

83 26 1

datacater DataCater JavaScript

The developer-friendly ETL platform for transforming data in real-time. Based on Apache Kafka® and Kubernetes®.

83 5 2

typestream typestreamio Kotlin

Open Source streaming platform. Write and run typed data pipelines with a minimal, familiar syntax.

83 5 2

royal-reserve-bank zoltanvin Java

Microservice-based scalable and secure banking application to simulate real-world financial transactions and account management.

83 50 2

go-consumergroup meitu Go

golang kafka consumer group

82 15 12

BurrowUI GeneralMills TypeScript

This is a NodeJS/Angular 2 frontend UI for Kafka cluster monitoring with Burrow

82 26 82

hydra pluralsight Scala

A real-time data replication platform that "unbundles" the receiving, transforming, and transport of data streams.

82 17 10

nodejs-kafka-example theotow JavaScript

Event sourcing with kafka and nodejs

82 73 1

feeyo-redisproxy variflight Java

A fast and lightweight Redis Proxy and Kafka Proxy

82 37 7

php-rdkafka-ffi idealo PHP

PHP Kafka client - binding librdkafka via FFI

82 5 1

turnstyl oslabs-beta TypeScript

turnstyl is an open-source ETL data integrity monitoring node package built to work with event and messaging brokers like Kafka

82 14 1

kafka-microservices-with-saga sylleryum Java

Java (Spring) microservices example with Kafka and saga pattern

82 42 2

euphoria seznam Java

Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model which can expr...

81 9 11

generator-mitosis Chabane JavaScript

A micro-service infrastructure generator based on Yeoman/Chatbot, Kubernetes/Docker Swarm, Traefik, Ansible, Jenkins, Spark, Hadoop, Kafka, etc.

81 21 13

blibli-backend-framework bliblidotcom Java

Blibli.com Backend Framework

81 12 7

docker-kafka-eagle nick-zh Dockerfile

Kafka eagle for docker

81 41 2

inferencedb aporia-ai Python

🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)

81 3 3

fs2-kafka Spinoco Scala

Kafka client for functional streams for scala (fs2)

80 13 12

ksql-fork-with-deep-learning-function kaiwaehner Java

Deep Learning UDF for KSQL, the Streaming SQL Engine for Apache Kafka with Elasticsearch Sink Example

80 36 6

platys-modern-data-platform TrivadisPF Jinja

Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....

80 17 4

fullstack-movie-streaming-platform philipdaquin Rust

📺 Netflix in Rust/ React-TS/ NextJS, Actix-Web, Async Apollo-GraphQl, Cassandra/ ScyllaDB, Async SQLx, Kafka, Redis, Tokio, Actix, Elasticsearch, Inf...

80 18 2

Big-Data-Cluster mrugankray Shell

The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Postgres, Cassan...

80 24 2

monitoring-demo framiere Shell

Docker - ELK - Tick Stack - Grafana - Kafka

79 33 7

ksqldb-event-souring eugene-khyst Java

Kafka is not for event sourcing, isn't it? Kafka alone is not an event store, but Kafka and ksqlDB together allow building full-featured event stores....

79 19 1

AIGuardSIEM itshamzabendelladj C++

A production-grade SIEM/XDR platform for 1M+ EPS ingestion with sub-15ms detection latency. Built with C++, Go, and Python. Features DPDK capture, ONN...

79 7 6