Spark ETL Chapter 11 with Lakehouse (Delta table Optimization)

Previous blog/Context: In an earlier blog, we discussed Spark ETL with Lakehouse (All the famous lake house formats). Please find below blog post for more details. https://developershome.blog/2023/04/04/spark-etl-chapter-10-with-lakehouse-delta-lake-vs-apache-iceberg-vs-apache-hudi/ Introduction: Today, we will discuss the points below. Load data into Delta table & check performance by executing queries. Load data into Delta table with partitioning & check... Continue Reading →

April 5, 2023 1

Spark ETL Chapter 10 with Lakehouse (Delta Lake vs Apache Iceberg vs Apache HUDI)

Previous blog/Context: In an earlier blog, we discussed Spark ETL with Lakehouse (with Apache Iceberg). Please find below blog post for more details. https://developershome.blog/2023/03/21/spark-etl-chapter-9-with-lakehouse-apache-iceberg/ Introduction: Today, In this below, we will discuss below points Spark ETL with famous Lakehouse formats. (Delta Lake, Apache Iceberg, and Apache HUDI) Offerings from all these lake house data formats.... Continue Reading →

April 4, 2023 0

Up ↑