Introduction to Big Data Analytics, Spring 2017

This course offers an introduction to the principles and concepts in big data analytics (BDA), which is gaining more popularity in recent years.
The major topics covered in this course will include: data mining, distributed computing, and parallel programming.
The course is offered at junior-level.

Course Information

Instructor: Jenq-Haur Wang
E-mail: mailbox at the domain of csie within NTUT, and my username is jhwang
Office: R1534, Technology Building (ext. 4238)
Office Hours: Wed. and Thu. 2:00-5:00pm
Class Hours: Tue. 2:10-4:00pm, Fri. 3:10-4:00pm, R227, 6th Teaching Building
TA: Mr. Lin (R1424, Technology Building)
Prerequisite: data structures (and algorithms), database systems, and working experience of high-level programming languages
Textbook: (Selected chapters)
- Jiawei Han, Micheline Kamber and Jian Pei, Data Mining: Concepts and Techniques, 3rd ed., Morgan Kaufmann Publishers, July 2011. ([DM3])
- Tom White, Hadoop: The Definitive Guide, 4th ed., O'Reilly Media, 2015.
References:
- Jimmy Lin and Chris Dyer, Data-Intensive Text Processing with MapReduce, Morgan & Claypool Publishers, 2010.
- Jure Leskovec, Anand Rajaraman, Jeffrey David Ullman, Mining of Massive Datasets, 2nd Edition, Cambridge University Press, November 2014.
- Holden Karau, Andy Konwinski, Patrick Wendell, Matei Zaharia, Learning Spark: Lightning-Fast Big Data Analysis, O'Reilly Media, January 2015.
- Others: Web documents, tutorials, and selected academic papers.

Latest News

Jun. 12, 2017: For teams who have finished their presentations, please remember to upload your presentation files (.PPT, source codes, documentation) to the homework submission site as the final report as soon as possible before Jun. 26, 2017.
May 22, 2017: The current schedule for term project presentation has been posted. Please check if there's any questions as soon as possible.
May 16, 2017: [NOTE] HW#3 has been announced.
May 1, 2017: The current score for HW#1, HW#2, and the Midterm exam has been posted. Please check if there's any question or not.
Mar. 16, 2017: [NOTE] HW#1 has been announced.
Feb. 17, 2017: The homepage for Introduction to Big Data Analytics (Spring 2017) has been setup.

(Tentative) Schedule

Week	Date	Content	Reading	Note
1	Feb. 21 & 24, 2017	Course Overview
2	Feb. 28 & Mar. 3, 2017	(2/28:Peace Memorial Day) Introduction to Big Data Analytics	DM3, Ch.1
3	Mar. 7 & 10, 2017	Ch.2, Getting to Know Your Data Ch.3, Data Preprocessing	DM3, Ch.2 & Ch.3 (selected)
4	Mar. 14 & 17, 2017	Ch.6, Frequent Pattern Mining	DM3, Ch.6	3/17: HW#1
5	Mar. 21 & 24, 2017	Ch.8, Classification: Basic Concepts	DM3, Ch.8
6	Mar. 28 & 31, 2017	Ch.8, Classification Ch.9, Classification: Advanced Methods	DM3, Ch.9 (selected sections)	HW#2 Term Project Proposal Due: HW#1
7	Apr. 4 & 7, 2017	(4/4: Tomb Sweeping Day & Children's day) Ch.10, Cluster Analysis: Basic Concepts and Methods	DM3, Ch.10	Proposal
8	Apr. 11 & 14, 2017	Data Clustering	DM3, Ch.10	Due: HW#2
9	Apr. 18 & 21, 2017	(4/18: Midterm Exam)
10	Apr. 25 & 28, 2017	Distribtued Platforms: Hadoop, Spark Documents about installation, configuration, and management of Hadoop & Spark clusters can be referenced.		Due: Proposal
11	May 2 & 5, 2017	Parallel Programming Paradigms & Concepts (5/5: No class)
12	May 9 & 12, 2017	MapReduce Programming
13	May 16 & 19, 2017	Spark Programming		HW#3
14	May 23 & 26, 2017	MapReduce Programming Advanced Topics
15	May 30 & Jun. 2, 2017	(Dragon Boat Festival) Term Project Presentation (Week 1): 6 teams completed.
16	Jun. 6 & 9, 2017	Term Project Presentation (Week 2): 12 teams completed (6/6), 5 teams completed (6/9)		Due: HW#3
17	Jun. 13 & 16, 2017	Term Project Presentation (Week 3): 10 teams completed (6/13), 4 teams completed (6/16).
18	Jun. 20 & 23, 2017	(Leave for JCDL 2017) // TErm Project Presentation (Week 4): 8 teams remained (6/20).

Useful Links

Here're some useful links to information retrieval related resources or further readings.

Generic resources
Some open source tools
Academic
- International Conferences:
Journals:
Others:

More Books

Programming Assignments and Projects

Please hand in your assignment before deadline according to the following instructions.

Submission Instructions

NOTE: Programs or projects in electronic files must be submitted directly to the TA online.

If you cannot successfully submit your work, please contact with the TA or the instructor.

Homeworks

There will be several written assignments and programming exercises that target at different data analysis tasks.

HW#1: Ch.2-3 (DM3)
Due: Mar. 31, 2017
HW#2: Ch.4 (DM3)
Due: Apr. 14, 2017
HW#3: MapReduce
Due: Jun. 6, 2017
[NOTE] The datasets for HW#3 can be downloaded at the following: Foursquare data.

Projects

Term Project: paper presentation or system demonstration

Item	Description	Time
Proposal	You are required to submit a proposal for term project one week after midterm exam.	May 5, 2017 (Fri.)
Topics	For paper presentations, the paper quality will greatly affect your score in term project. Please carefully select good papers to read.
Schedule	Due to our time limits, we might have to start the term project presentation as early as Jun. 2, 2017 (Fri.). * [NOTE] All presentations must be finished within the scheduled time slots, which will be the last four weeks in this semester. No other time slots will be avbailable. The current schedule for term project presentation has been posted. (as of Jun. 16, 2017)	Jun. 2, 6, 9, 13, 16, 20, 2017
Report	Each team is required to upload the final report after finishing your presentation. The final report should contain at least the following: presentation slides (for all teams), and source code, installation/execution instructions, team members and task responsibility (for system projects)	Jun. 26, 2017 (Mon.)

Exams

Midterm Exam: Apr. 17-21, 2017
- Date: Apr. 18, 2017 (Tue.)
- Time: 14:10-16:00pm
- Location: R227, 6th Teaching Building
- Range: DM3, Ch.1-2, 3 (part), 6, 8, 9 (part), 10
Final Exam: Jun. 19-23, 2017
- Note: There will be no final exam in this course. Instead, you are required to finish a term project for system development or paper presentation.

Scores

Please check the homework submission site for more details.

Current score including HW#1, HW#2, and Midterm exam (as of May 3, 2017)

E-mail: jhwang AT csie . ntut . edu . tw
Created: Feb. 18, 2017.
Last Updated: Jun. 16, 2017.