In this 1-hour long project-based course, you will learn how to interact with a Spark cluster using Jupyter notebook and how to start a Spark application.
You will learn how to utilize Spark Resisilent Distributed Datasets and Spark Data Frames to explore a dataset. We will load a dataset into our Spark program, and perform analysis on it by using Actions, Transformations,Spark DataFrame API and Spark SQL.
You will learn how to choose the best tools to use for each scenario. Finally, you will learn to save your results in Parquet tables.