Topic

kafka

Repositories (1408)

pathway
pathway pathwaycom Python

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

63.4k
data-engineering-zoomcamp
data-engineering-zoomcamp DataTalksClub Jupyter Notebook

Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Join the course...

40.2k
kafka
kafka apache Java

Apache Kafka - A distributed event streaming platform

32.4k
kestra
kestra kestra-io Java

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

26.7k
signoz
signoz SigNoz TypeScript

SigNoz is an open-source observability platform native to OpenTelemetry with logs, traces and metrics in a single application. An open-source alternat...

26.7k
cilium
cilium cilium Go

eBPF-based Networking, Security, and Observability

24.2k
thingsboard
thingsboard thingsboard Java

Open-source IoT Platform - Device management, data collection, processing and visualization.

21.6k
SpringBoot-Labs
SpringBoot-Labs yudaocode Java

一个涵盖六个专栏:Spring Boot 2.X、Spring Cloud、Spring Cloud Alibaba、Dubbo、分布式消息队列、分布式事务的仓库。希望胖友小手一抖,右上角来个 Star,感...

20.1k
BigData-Notes
BigData-Notes heibaiying Java

大数据入门指南 :star:

16.9k
telegraf
telegraf influxdata Go

Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.

16.8k
flink-learning
flink-learning zhisheng17 Java

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library...

15.1k
technology-talk
technology-talk aalansehaiyang

【大厂面试专栏】一份Java程序员需要的技术指南,这里有面试题、系统架构、职场锦囊、主流中间件等,让你成为更牛的自己!

14.7k
workflow
workflow sogou C++

C++ Parallel Computing and Asynchronous Networking Framework

14.3k
debezium
debezium debezium Java

Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.

12.6k
sarama
sarama IBM Go

Sarama is a Go library for Apache Kafka.

12.5k
kafka-ui
kafka-ui provectus Java

Open-Source Web UI for Apache Kafka Management

12k
redpanda
redpanda redpanda-data C++

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

12k
openreplay
openreplay openreplay TypeScript

Session replay, cobrowsing and product analytics you can self-host. Best for reproducing issues and iterating on your product.

12k
CMAK
CMAK yahoo Scala

CMAK is a tool for managing Apache Kafka clusters

11.9k
kubeshark
kubeshark kubeshark Go

eBPF-powered network observability for Kubernetes. Indexes L4/L7 traffic with full K8s context, decrypts TLS without keys. Queryable by AI agents via...

11.9k
God-Of-BigData
God-Of-BigData wangzhiwubigdata

专注大数据学习面试,大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

10.5k
automq
automq AutoMQ Java

AutoMQ is a diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.

9.7k
watermill
watermill ThreeDotsLabs Go

Building event-driven applications the easy way in Go.

9.7k
risingwave
risingwave risingwavelabs Rust

Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.

8.9k
connect
connect redpanda-data Go

Fancy stream processing made operationally mundane

8.6k
kafka-go
kafka-go segmentio Go

Kafka library in Go

8.5k
DevOps-Bash-tools
DevOps-Bash-tools HariSekhon Shell

1000+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka, Hadoop, Jenkins, GitHub, GitLab, B...

8.2k
graylog2-server
graylog2-server Graylog2 Java

Free and open log management

8k
KnowStreaming
KnowStreaming didi Java

一站式云原生实时流数据平台,通过0侵入、插件化构建企业级Kafka服务,极大降低操作、存储和管理实时流数据门槛

7.2k
java-eight-part
java-eight-part CoderLeixiaoshuai Java

『Java八股文』Java面试套路,Java进阶学习,打破内卷拿大厂Offer,升职加薪!

7.1k
CAP
CAP dotnetcore C#

Distributed transaction solution in micro-service base on eventually consistency, also an eventbus with Outbox pattern

7.1k
faust
faust robinhood Python

Python Stream Processing

6.8k
flink-cdc
flink-cdc apache Java

Flink CDC is a streaming data integration tool

6.4k
materialize
materialize MaterializeInc Rust

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

6.3k
kafdrop
kafdrop obsidiandynamics Java

Kafka Web UI

6.1k
hippo4j
hippo4j opengoofy Java

📌 异步线程池框架,支持线程池动态变更&监控&报警,无需修改代码轻松引入。Asynchronous thread pool framework, support Thread Pool Dynamic Change & monito...

6k
kafka-python
kafka-python dpkp Python

Python client for Apache Kafka

5.9k
strimzi-kafka-operator
strimzi-kafka-operator strimzi Java

Apache Kafka® running on Kubernetes

5.8k
share_ppt
share_ppt rfyiamcool

🚗 个人做过的技术分享... ( topic: 高性能架构, 中间件原理实践,云原生,Golang 等)

5.7k
spec
spec asyncapi JavaScript

The AsyncAPI specification allows you to create machine-readable definitions of your asynchronous APIs.

5.2k
faststream
faststream ag2ai Python

FastStream is a powerful and easy-to-use asynchronous Python framework for building asynchronous services interacting with event streams such as Apach...

5.1k
go-zero-looklook
go-zero-looklook Mikaelemmmm Go

🔥基于go-zero(go zero) 微服务全技术栈开发最佳实践项目。Develop best practice projects based on the full technology stack of go zero (go zero) microser...

5.1k
gpmall
gpmall 2227324689 Java

【咕泡学院实战项目】-基于SpringBoot+Dubbo构建的电商平台-微服务架构、商城、电商、微服务、高并发、kafka、Elasticsearch

5k
jocko
jocko travisjeffery Go

Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)

5k
arroyo
arroyo ArroyoSystems Rust

Distributed stream processing engine in Rust

4.9k
ockam
ockam build-trust Rust

Orchestrate end-to-end encryption, cryptographic identities, mutual authentication, and authorization policies between distributed applications – at m...

4.6k
console
console redpanda-data TypeScript

Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining v...

4.3k
pipeline
pipeline PipelineAI Jsonnet

PipelineAI

4.2k
learn-agentic-ai
learn-agentic-ai panaversity Jupyter Notebook

Learn Agentic AI using Dapr Agentic Cloud Ascent (DACA) Design Pattern and Agent-Native Cloud Technologies: OpenAI Agents SDK, Memory, MCP, A2A, Knowl...

4.1k
kafkajs
kafkajs tulios JavaScript

A modern Apache Kafka client for node.js

4k