Big Data Analytics (IMFI), Fall 2018

This course offers an introduction to the principles and concepts in big data analytics (BDA), which is gaining more popularity in recent years.
The course is offered for the International Master Program in Financial Technology and Innovation Enterpreneur (IMFI). It's taught by two instructors: Jenq-Haur Wang, and Chen-Shu Wang.
This page is for the first part. The major topics covered in the first part include: data mining and distributed processing.

Course Information (for the first part)

Instructor: Jenq-Haur Wang
E-mail: mailbox at the domain of CSIE within our university, and my username is jhwang
Office: R1534, Technology Building (ext. 4238)
Office Hours: Tue. 9:10-12:00am, and Thu. 14:10-17:00pm
Class Hours: Wed. 13:10-16:00pm. R735, Technology Building
TA: (N/A)
Textbook: (Selected chapters)
- Jiawei Han, Micheline Kamber and Jian Pei, Data Mining: Concepts and Techniques, 3rd ed., Morgan Kaufmann Publishers, July 2011. ([DM3])
References:
- Holden Karau, Andy Konwinski, Patrick Wendell, Matei Zaharia, Learning Spark: Lightning-Fast Big Data Analysis, O'Reilly Media, January 2015.
- Bill Chambers and Matei Zaharia, Spark: The Definitive Guide, O'Reilly Media, 2018.
- Others: online documents (Hadoop, Spark), tutorials, and selected academic papers.

Latest News

Nov. 15, 2018: HW#3 has been announced.
Nov. 1, 2018: HW#2 has been announced.
Oct. 3, 2018: HW#1 has been announced.
Sep. 12, 2018: The homepage for the first part of Big Data Analytics (IMFI, Fall 2018) has been setup.

(Tentative) Schedule (for the first part)

Week	Date	Content	Reading	Note
1	Sep. 12, 2018	Course Overview
2	Sep. 19, 2018	Introduction to Big Data Analytics	DM3, Ch.1
3	Sep. 26, 2018	Ch.2, Getting to Know Your Data	DM3, Ch.2
4	Oct. 3, 2018	Ch.3, Data Preprocessing	DM3, Ch.3	HW#1
5	Oct. 10, 2018	(10/10: Leave for The Double Tenth Day)
6	Oct. 17, 2018	(Sick Leave)
7	Oct. 24, 2018	Ch.6, Frequent Pattern Mining	DM3, Ch.6	Due: HW#1
8	Oct. 31, 2018	Introduction to Big Data Analytics Platforms: Hadoop, Spark, TensorFlow Programming in Spark & Colaboratory (Ref: Notes on installation, configuration, and management of Hadoop & Spark clusters)		HW#2
9	Nov. 7, 2018	Ch.8, Classification: Basic Concepts	DM3, Ch.8
10	Nov. 14, 2018	(11/14: Midterm Exam)		HW#3 Due: HW#2
11	Nov. 21, 2018	Ch.10, Cluster Analysis: Basic Concepts and Methods	DM3, Ch.10
12	Nov. 28, 2018	(11/28-30: Leave for AIRS 2018) TA: The MapReduce Way Spark Programming (Lab: Analyzing data using Spark) (Lab: Classification and Clustering using TensorFlow)		Due: HW#3
13	Dec. 5, 2018	(The second part)
14	Dec. 12, 2018	(The second part)
15	Dec. 19, 2018	(The second part)
16	Dec. 26, 2018	(The second part)
17	Jan. 2, 2019	(The second part)
18	Jan. 9, 2010	(The second part)

Homework Assignments & In-Class Labs

During the progress of the course, there will be several homework assignments for written exercises, and also some hand-on labs in class.

Homeworks

There will be about 3 written assignments for topics such as pattern mining, classification, and clustering.

HW#1: Ch.2-3
Due: Oct. 17, 2018
HW#2: Ch.6
Due: Nov. 15, 2018
HW#3: Ch.8
Due: Nov. 28, 2018

Please hand in your assignment before deadline according to the following instructions.

Submission Instructions

NOTE: Programs or projects in electronic files must be submitted directly to the website.

If you cannot successfully submit your work, please contact with the instructor.

Labs

There will be different hands-on labs or programming exercises in different platforms such as TensorFlow and Spark. You will be given ifferent data analysis tasks such as classification and clustering.

(TBA)

Reference:

Notes on installation, configuration, and management of Hadoop & Spark clusters

Exams

Midterm Exam: Nov. 5-9, 2018
- Date: Nov. 14 (Wed.)
- Time: 13:10-16:00
- Location: R735, Technology Building
- Range: Ch. 1, 2, 3, 6, 8 (DM3)
Final Exam:

Scores

Please check the homework submission site for more details.

The current score including HW#1-3, midterm exam, and the extra bonus for programs (as of Dec. 19, 2018)

Created: Sep. 12, 2018.
Last Updated: Dec. 19, 2018.