parthkalkar / intro_to_big_data

Introductory Big Data concepts using Spark framework and different libraries

intro_to_big_data

Labs tasks solved during the Introduction to Big Data course, fall 2021, Innopolis University

Week1

Lab1 - Vagrant, Lab_file: https://hackmd.io/@BigDataInnopolis/H16djdqrr, Lab_video: https://www.youtube.com/watch?v=N00k-21noZI&list=PLcv13aCxIfjDY1qv79zgCHRUZuh0_7tA7&index=3

Lab2 - Docker, Lab_file: https://hackmd.io/@BigDataInnopolis/By6VKwUSB, Lab_video: https://www.youtube.com/watch?v=9vNu2278y4k&list=PLcv13aCxIfjDY1qv79zgCHRUZuh0_7tA7&index=4

Week2

Lab3 - Hadoop, Lab_file: https://hackmd.io/@BigDataInnopolis/H1LehZx8S, Lab_video: https://www.youtube.com/watch?v=iHwGFh19YqQ&list=PLcv13aCxIfjDY1qv79zgCHRUZuh0_7tA7&index=6&t=1s

Lab4 - Hadoop Distributed Cluster, Lab_file: https://hackmd.io/@BigDataInnopolis/BJYVi9q7D, Lab_video: https://www.youtube.com/watch?v=ou_eoLQqW28

Week3

Lab5 - MapReduce with Java, Lab_file: https://hackmd.io/@BigDataInnopolis/Hy2ECVzVD#Initial-Configuration, Lab_video: https://www.youtube.com/watch?v=ETDbbNpq8Mg

Lab6 - MapReduce with Spark, Lab_file: https://hackmd.io/@BigDataInnopolis/SyyzxeCVP, Lab_video: https://www.youtube.com/watch?v=IweiXeKKRDI

Week4

Lab7 - Spark: MLlib, Lab_file: https://hackmd.io/@BigDataInnopolis/rkKcKOWsw, Lab_video: https://www.youtube.com/watch?v=Qtt36oq1YHA

Week5

lab8 - SparkSQL, Lab_file: https://hackmd.io/@BigDataInnopolis/B1suomqow, Lab_video: https://www.youtube.com/watch?v=wmfBWTi65No

Week6

lab9 - Spark GraphX, Lab_file: https://hackmd.io/YZtLWBGUSkyOM_r18QyOkQ

extra_lab - MapReduce, Lab_file: https://hackmd.io/0xpIY8xoSGu-963e9Mw6Gg