Data Engineering Tool Suite

Introduction In this blog post we are setting up Data Engineering tools set on our local environment using docker. For Data Engineering tool suite for now we are considering below tools on initial level. In the coming future, we will update our docker files and add more tools. Apache Spark Jupyter Lab Package for Delta... Continue Reading →

January 30, 2023 5

Deploy Spark Using Docker

In this blog, we will learn how to deploy spark using Docker. We will use this environment in future for learning spark and solving data engineering problems. With Spark, we also want to install a few of the packages (connectors) so that we don't need to install them separately. When we will learn Spark, we... Continue Reading →

January 29, 2023 4

Docker Compose & Deploy Apps using it

We had a basic understanding of what docker is and how to deploy simple applications to complex applications using docker in previous blog. If you did not have a look on that start with below blogs so you have better understanding. https://developershome.blog/2023/01/23/what-is-docker/ https://developershome.blog/2023/01/24/create-first-docker-container-app/ Here, we will discuss about docker compose and how to deploy application... Continue Reading →

January 26, 2023 1

Up ↑