Kafka Essential Training
Developed at LinkedIn, Apache Kafka is a distributed streaming platform that provides scalable, high-throughput messaging systems in place of traditional messaging systems like JMS. In this course, examine all the core concepts of Kafka. Ben Sullins kicks off the course by making the case for Kafka, and explaining who's using this efficient platform and why. He then shares Kafka workflows to provide context for core concepts, explains how to install and test Kafka locally, and dives into real-world examples. By the end of this course, you'll be prepared to achieve scalability, fault tolerance, and durability with Apache Kafka.
Topics include:
Understanding the Kafka log
Creating topics
Partitioning topics across brokers
Installing and testing Kafka locally
Sending and receiving messages
Setting up a multibroker cluster
Testing fault tolerance
Introduction
Welcome
What you should know
Exercise files
1. Why Use Kafka?
ETL is dead. Long live streams.
Who is using Kafka and how?
What is the log?
Efficiency and implication
2. Core Concepts
Architecture
Topics and brokers
Producers
Consumers
3. Workflows
Hardware specs
Typical operational tasks
Monitor in Kafka
Audit in Kafka
4. Installing and Testing Kafka Locally
Kafka local installation
Create topics
Send and receive messages
5. Real-World Examples
Set up a multibroker cluster
Test fault-tolerance
Import and export data
Stream data processing
6. Distributions and Packaging
Major vendor options
Confluent
Conclusion
Next steps