Data Engineering

ETL/ELT pipelines, data warehousing, data lakes and lakehouses, streaming data, and orchestration frameworks.

Topics

Lessons

Delta Lake, Iceberg, Hudi — combining lake flexibility with warehouse features

Snowflake, Redshift, BigQuery, Synapse — analytical storage

Airflow, dbt, Fivetran, Informatica — extract, transform, load

Kafka Streams, Flink, Spark Streaming — real-time data flows