Data Engineering Problem 3 (Find diff between count of cities and distinct count of cities)

Please find earlier blogs to have understanding of our Data Engineering Learning plan and system setup for Data Engineering. Today we are solving and learning one more Data engineering problem and learning new concepts. https://www.youtube.com/watch?v=c6YgtJN43sU&feature=youtu.be Problem Statement Find the difference between the total number of CITY entries in the table and the number of distinct... Continue Reading →

February 10, 2023 0

Data Engineering Problem 2 (Employees with Sales Department)

Please find earlier blogs to have understanding of our Data Engineering Learning plan and system setup for Data Engineering. Today we are solving and learning one more Data engineering problem and learning new concepts. Problem Statement We have a table with employee's tables in which we have employee details with salary and department id of... Continue Reading →

February 9, 2023 1

Data Engineering Problem 1 (Get Max Salary of each employee)

Introduction: As we discussed earlier, we will start solving Data Engineering problems using SQL (PostgreSQL and MySQL), NoSQL (MongoDB or Cassandra) and Apache Spark (PySpark and Spark SQL) We will start from very easy SQL problems to difficult SQL Problems, we will also solve problems regarding data loads (Batch, replication and Streaming). Problem Statement We... Continue Reading →

February 5, 2023 0

Up ↑