Kafka streaming data pipeline diagram
This is a worked example. Wavelength built the diagram below from the description on this page. Nobody drew it by hand.
What was said
The checkout service publishes order events to Kafka. A Flink job reads the stream and flags orders that look like fraud. Flagged orders go to the fraud review team. All events also land in S3 through Kafka Connect, and Databricks processes them into Delta tables for the analytics team.
The diagram
What is in this flow
- Systems: Kafka, Flink Job, Kafka Connect and Databricks.
- Data stores: S3 and Delta Tables.
- People and teams: Fraud Review Team and Analytics Team.
- Size: 9 steps and 8 connections.
Mermaid code
Copy this into any Markdown file, GitHub README, or Mermaid Live to render the same flow.
flowchart TD
n1(["Checkout Service")]
n2{{"Kafka"}}
n3{{"Flink Job"}}
n4("Fraud Review Team")
n5[("S3")]
n6{{"Kafka Connect"}}
n7{{"Databricks"}}
n8[("Delta Tables")]
n9("Analytics Team")
n1 -->|publishes order events| n2
n2 -->|reads stream| n3
n3 -->|flags orders| n4
n2 -->|through Kafka Connect| n6
n6 -->|lands events| n5
n5 -->|processes into Delta tables| n7
n7 -->|stores| n8
n8 -->|used by analytics team| n9Map your own process
Describe your version out loud, or paste the transcript of a call. Wavelength draws the flow as you talk, and you can edit it by voice, by prompt, or by hand.
Every new account starts with 14 days of Pro. No card needed.