Introduction: As we discussed earlier, we will start solving Data Engineering problems using SQL (PostgreSQL and MySQL), NoSQL (MongoDB or Cassandra) and Apache Spark (PySpark and Spark SQL) We will start from very easy SQL problems to difficult SQL Problems, we will also solve problems regarding data loads (Batch, replication and Streaming). Problem Statement We... Continue Reading →
Data Engineering Problem 0 (Employees with salary more than 100K)
Introduction: As we discussed earlier, we will start solving Data Engineering problems using SQL (PostgreSQL and MySQL), NoSQL (MongoDB or Cassandra) and Apache Spark (PySpark and Spark SQL) We will start from very easy SQL problems to difficult SQL Problems, we will also solve problems regarding data loads (Batch, replication and Streaming). Please find our... Continue Reading →
Big Data Engineer Skills
Big data engineers need to know a combination of programming languages, database skills, and data processing tools in order to be successful in their careers. Also need to have understanding of below technology Big Data Processing Frameworks: Apache Hadoop, Apache Spark, Apache Storm, and Apache Flink are some of the popular big data processing frameworks used in the industry.... Continue Reading →