Previous blog/Context: Please see the previous blog, where we have designed a plan for Spark ETL pipelines. In the coming days we will be doing spark ETL using all of the data sources mentioned. Please find the blog for more details. https://developershome.blog/2023/03/01/spark-etl-elt-data-connections/ Introduction: In this blog, we will be discussing Spark ETL with files. We... Continue Reading →
Data Engineering Problem 6 (Students more than 75 Marks)
Please find earlier blogs to have understanding of our Data Engineering Learning plan and system setup for Data Engineering. Today we are solving and learning one more Data Engineering problem and learning new concepts. For earlier problem solution and key learning points follow below. https://developershome.blog/category/data-engineering/problem-solving/ Problem Statement Query the Name of any student in STUDENTS... Continue Reading →
Data Engineering Problem 2 (Employees with Sales Department)
Please find earlier blogs to have understanding of our Data Engineering Learning plan and system setup for Data Engineering. Today we are solving and learning one more Data engineering problem and learning new concepts. Problem Statement We have a table with employee's tables in which we have employee details with salary and department id of... Continue Reading →