A Big Data Hadoop and Spark project for absolute beginners

Learn Hadoop, Spark, Google Dataproc and Google Colab step by step by solving a real world use case
Instructor:
Future X Skill
999 students enrolled
Students will learn Big Data , Hadoop and Spark from scratch. They will also learn how to use free cloud tools to do hadoop and spark programming

A bank is launching a new credit card and wants to identify prospects it can target in its marketing campaign.

It has received prospect data from various internal and 3rd party sources. The data has various issues such as missing or unknown values in certain fields.The data needs to be cleansed before any kind of analysis can be done.

Since the data is in huge volume with billions of records, the bank has asked you to use Big Data Hadoop and Spark technology to cleanse, transform and analyze this data.

What you will learn :

  • Big Data, Hadoop concepts
  • How to create a free Hadoop and Spark cluster using Google Dataproc
  • Hadoop hands-on – HDFS, Hive
  • Why there was a need for Spark
  • Python basics
  • PySpark RDD – hands-on
  • PySpark SQL, DataFrame – hands-on
  • Project work using PySpark and Hive
  • Google Colab environment

Prerequisites :

  • Some basic programming skills
  • Some knowledge of SQL queries
Would you like know more about it? Click here!Close

Introduction

1
Introduction

Big Data Hadoop concepts

1
Big Data concepts
2
Hadoop concepts

Hadoop - Hands-On

1
Creating a free Hadoop and Spark cluster using Google Dataproc
2
Reading HDFS data using Hive

Spark concepts and hands-on

1
Spark concepts
2
Installing Spark on Google Colab
3
Python basics
4
PySpark RDD
5
PySpark - Spark SQL and DataFrame
6
Running PySpark on a Hadoop Cluster

Final project work - Bank prospecting marketing

1
Project - Bank marketing prospects data transformation using Hadoop and Spark
You can view and review the lecture materials indefinitely, like an on-demand channel.
Definitely! If you have an internet connection, courses on Udemy are available on any device at any time. If you don't have an internet connection, some instructors also let their students download course lectures. That's up to the instructor though, so make sure you get on their good side!

Be the first to add a review.

Please, login to leave a review
bfd154dd7d632d40b235343dac3230c0
30-Day Money-Back Guarantee

Includes

2 hours on-demand video
Full lifetime access
Access on mobile and TV
Certificate of Completion