Section outline

• Select section Day 1: Kafka Cluster Fundamentals

  Day 1: Kafka Cluster Fundamentals

  Collapse all Expand all

  • Kafka architecture, brokers, producers, consumers

  • Zookeeper usage and configuration

  • Kafka installation and setup (single and multi-broker)

  • Lab: Create producers/consumers, Kafka queues, Pub/Sub mode
• Select section Day 2: Custom APIs and Java Integration

  Day 2: Custom APIs and Java Integration

  • Java APIs for producers/consumers

  • Message serialization (Avro), encryption (SSL)

  • Kafka Streaming API and deployment patterns

  • Lab: Custom Java-based consumers/producers, Spark + Twitter stream
• Select section Day 3: Stream Processing with Spark

  Day 3: Stream Processing with Spark

  • Spark as Kafka consumer/producer

  • Stateful and window operations

  • Stream-table joins, handling late data

  • Lab: Kafka + Spark streaming analysis
• Select section Day 4: Performance Tuning & Security

  Day 4: Performance Tuning & Security

  • Kafka design patterns, compression, replication

  • Schema management, HA configurations

  • Security: SSL, SASL, Kerberos, ACLs

  • Lab: Set up security, monitor with Kafka tools
• Select section Day 5: Kafka Connect & KSQL DB

  Day 5: Kafka Connect & KSQL DB

  • Kafka Connect architecture (standalone/distributed)

  • JDBC, HDFS, Cassandra connectors

  • KSQL DB for persistent stream queries

  • Lab: Stream RDBMS to Kafka, query using KSQL shell