BiteSizedChunks.comLearn one small thing at a time.

Course contentsShow

736What is Batch Processing?
737What is Stream Processing?
738Batch Processing Use Cases
739Stream Processing Use Cases
740Latency vs Throughput Tradeoffs
741Windowing in Stream Processing
742State Management in Streaming
743Batch Processing Frameworks
744Stream Processing Frameworks
745Exactly-Once Semantics
746Choosing Batch vs Stream
747Lambda Architecture Overview
748Lambda Architecture: Batch Layer
749Lambda Architecture: Speed Layer
750Lambda Architecture: Serving Layer
751Lambda Architecture Tradeoffs
752Kappa Architecture Overview
753Kappa Architecture: Single Processing Path
754Event Log Replay in Kappa
755When to Choose Lambda vs Kappa
756Hybrid and Modern Alternatives
757Data Warehouse Fundamentals
758Data Lake Fundamentals
759Schema-on-Write vs Schema-on-Read
760Data Warehouse Architecture
761Data Lake Storage Technologies
762Query Performance Tradeoffs
763Cost and Storage Efficiency
764Data Governance and Quality
765Choosing Lake vs Warehouse
766Apache Airflow Fundamentals
767Airflow Operators and Executors
768Apache Spark Overview
769Spark Streaming and Structured Streaming
770Apache Flink Architecture
771Flink vs Spark for Streaming
772Apache Beam Programming Model
773Prefect and Dagster for Modern Workflows
774dbt for Analytics Engineering
775Apache NiFi for Data Flow
776Change Data Capture Tools
777Workflow Orchestration Patterns
778Pipeline Technology Selection Criteria

736What is Batch Processing?
737What is Stream Processing?
738Batch Processing Use Cases
739Stream Processing Use Cases
740Latency vs Throughput Tradeoffs
741Windowing in Stream Processing
742State Management in Streaming
743Batch Processing Frameworks
744Stream Processing Frameworks
745Exactly-Once Semantics
746Choosing Batch vs Stream
747Lambda Architecture Overview
748Lambda Architecture: Batch Layer
749Lambda Architecture: Speed Layer
750Lambda Architecture: Serving Layer
751Lambda Architecture Tradeoffs
752Kappa Architecture Overview
753Kappa Architecture: Single Processing Path
754Event Log Replay in Kappa
755When to Choose Lambda vs Kappa
756Hybrid and Modern Alternatives
757Data Warehouse Fundamentals
758Data Lake Fundamentals
759Schema-on-Write vs Schema-on-Read
760Data Warehouse Architecture
761Data Lake Storage Technologies
762Query Performance Tradeoffs
763Cost and Storage Efficiency
764Data Governance and Quality
765Choosing Lake vs Warehouse
766Apache Airflow Fundamentals
767Airflow Operators and Executors
768Apache Spark Overview
769Spark Streaming and Structured Streaming
770Apache Flink Architecture
771Flink vs Spark for Streaming
772Apache Beam Programming Model
773Prefect and Dagster for Modern Workflows
774dbt for Analytics Engineering
775Apache NiFi for Data Flow
776Change Data Capture Tools
777Workflow Orchestration Patterns
778Pipeline Technology Selection Criteria

← System Design

Lesson 743 of 1,919·20. Data Pipelines and ETLPro lesson

Batch Processing Frameworks

MapReduce, Apache Spark, and Hadoop batch frameworks distribute processing across clusters for massive datasets.

This lesson is for subscribers

You've completed the free preview. Subscribe to unlock every lesson in every course.

See pricing Back to course