BiteSizedChunks.comLearn one small thing at a time.

Course contentsShow

690What is Event Streaming?
691Events as First-Class Citizens
692Streams vs Traditional Databases
693The Commit Log Abstraction
694Producers and Consumers
695Stream Retention and Replay
696Event Streaming Use Cases
697Push vs Pull Consumption Models
698Streaming vs Message Queues
699Event Streaming Platform Requirements
700Kafka Overview and Core Components
701Topics and Partitions
702Producers and Message Publishing
703Partitioning Strategies and Key Selection
704Brokers and Cluster Architecture
705Replication and Fault Tolerance
706Leaders and Followers
707In-Sync Replicas (ISR)
708Consumer Groups and Parallel Consumption
709Partition Assignment and Rebalancing
710Offsets and Commit Strategies
711Message Retention and Log Segments
712Log Compaction
713Kafka's Write Path and Durability
714Kafka's Read Path and Zero-Copy
715ZooKeeper vs KRaft Mode
716Consumer Groups and Partition Assignment
717Rebalancing Protocol and Strategies
718Exactly-Once Semantics (EOS)
719Kafka Transactions
720Log Compaction
721Kafka Connect Framework
722Kafka Streams API
723Kafka Streams State Stores
724Kafka Performance Tuning
725Schema Registry and Evolution
726Multi-Datacenter Replication
727Kafka Security: Authentication and Encryption
728AWS Kinesis Overview
729Kinesis vs Kafka Tradeoffs
730Apache Pulsar Architecture
731Pulsar's Unique Features
732Google Cloud Pub/Sub
733Azure Event Hubs
734NATS Streaming
735Choosing a Streaming Platform

690What is Event Streaming?
691Events as First-Class Citizens
692Streams vs Traditional Databases
693The Commit Log Abstraction
694Producers and Consumers
695Stream Retention and Replay
696Event Streaming Use Cases
697Push vs Pull Consumption Models
698Streaming vs Message Queues
699Event Streaming Platform Requirements
700Kafka Overview and Core Components
701Topics and Partitions
702Producers and Message Publishing
703Partitioning Strategies and Key Selection
704Brokers and Cluster Architecture
705Replication and Fault Tolerance
706Leaders and Followers
707In-Sync Replicas (ISR)
708Consumer Groups and Parallel Consumption
709Partition Assignment and Rebalancing
710Offsets and Commit Strategies
711Message Retention and Log Segments
712Log Compaction
713Kafka's Write Path and Durability
714Kafka's Read Path and Zero-Copy
715ZooKeeper vs KRaft Mode
716Consumer Groups and Partition Assignment
717Rebalancing Protocol and Strategies
718Exactly-Once Semantics (EOS)
719Kafka Transactions
720Log Compaction
721Kafka Connect Framework
722Kafka Streams API
723Kafka Streams State Stores
724Kafka Performance Tuning
725Schema Registry and Evolution
726Multi-Datacenter Replication
727Kafka Security: Authentication and Encryption
728AWS Kinesis Overview
729Kinesis vs Kafka Tradeoffs
730Apache Pulsar Architecture
731Pulsar's Unique Features
732Google Cloud Pub/Sub
733Azure Event Hubs
734NATS Streaming
735Choosing a Streaming Platform

← System Design

Lesson 711 of 1,919·19. Event Streaming PlatformsPro lesson

Message Retention and Log Segments

Understand Kafka's append-only log structure, retention policies (time or size-based), and how log segments enable compaction.

This lesson is for subscribers

You've completed the free preview. Subscribe to unlock every lesson in every course.

See pricing Back to course