Datenbank Praktikum – Big Data (WS 2017)

Hands-on Lab – Big Data Technologies

Lecturers: Prof. Dott. Ing. Roberto V. Zicari, Todor Ivanov and Kim Hee

Contact person: Todor Ivanov  ( todor@dbis.cs.uni-frankfurt.de)

Course start/end:  Monday, 23.10.2017 to Monday, 05.02.2018

Time and Location: Monday 14:00 – 16:00, Room SR9

Languages: The languages of the lab are English and German.

Credit Points: Students can receive 8 CPs. Link in QIS/LFS

Registration: You have to register in the form below. Deadline for registration is 19.10.2017 (10:00 am).

Course Schedule (preliminary)

Date Topic Lab Materials
23.10.2017 Course Organization,Introduction to Big Data & Data Science  [wpdm_package id=’18322′] [wpdm_package id=’18324′]
30.10.2017 Overview of the Big Data Architectures [wpdm_package id=’18487′]

  1. Big Data Fundamentals
  2. Hadoop Fundamentals I
  3. MapReduce and YARN
  4. Using HBase for Real-time Access to your Big Data
06.11.2017  Introduction to HDFS, YARN and Sqoop [wpdm_package id=’18339′]
13.11.2017
  • Hive
  • Impala
  • File Formats (Avro and Parquet)
  • Hive Partitioning
  • Flume
 [wpdm_package id=’18381′]

  1. Accessing Hadoop Data Using Hive
  2. SQL Access for Hadoop
20.11.2017 Python + Data Science [wpdm_package id=’18407′]

  1. Applied Data Science with Python
27.11.2017  Introduction to Data Science Tools [wpdm_package id=’18415′]
04.12.2017
  • Project Assignment
  • Spark Basics
  • Example Use Cases
 [wpdm_package id=’18460′][wpdm_package id=’18463′]
[wpdm_package id=’18470′] [wpdm_package id=’18476′]
11.12.2017
  • Spark Parallel Processing
  • SparkSQL, MLlib and more (Advanced)
 [wpdm_package id=’18484′]
18.12.2017 [wpdm_package id=’18466′]
Holiday
08.01.2018
  • Kafka Demonstration
  • Project Assignment Implementation
 [wpdm_package id=’18512′][wpdm_package id=’18515′]
15.01.2018 Project Assignment Implementation
22.01.2018 Project Assignment Implementation
29.01.2018 Project Assignment Implementation
05.02.2018  Final Project Presentatoins
11.02.2018  Final Project Submission Send us your final documentation and code in github via email

 

Additional Materials

Materials

Books & Papers