Educational Data Mining and Applications, Fall 2023

This course is one of the advanced courses in the Micro Courses on Educational Big Data. It introduces the basic concepts and principles of data mining, including: data preprocessing, frequent pattern mining, classification, and clustering. Also, students need to use tools such as Weka and Python for educational big data analytics. With the programming exercises and term project, students will be able to learn the fundamental ideas of educational data analysis and real applications with practical tools.
The course is offered at undergraduate level.

Notes on online recording of course sessions

All students enrolled in this course have been added to the team in Microsoft Teams for the corresponding course number.
You can check the online recording of the course in Microsoft Teams at the following channel: Team created for Educational Data Mining and Applications Course [Course Number: 323351]

Course Information

Instructor: Jenq-Haur Wang
E-mail: mailbox at the domain of our university, and my username is jhwang
Office: R1534, Technology Building (ext. 4238)
Office Hours: Tue. and Fri. 9:10-12:00am
Class Hours: Tue. 13:10-15:00pm, Wed. 9:10-10:00am, R227, 6th Teaching Building
TA: Mr. Yen (R1424, Technology Building)
E-mail: (TBA)
Prerequisite: data structures (and algorithms), database systems, discrete math (probability), operating systems, and working experience of high-level programming languages
Textbook: (Selected chapters)
- Jiawei Han, Jian Pei, and Hanghang Tong, Data Mining: Concepts and Techniques, 4th ed., Morgan Kaufmann Publishers, Oct. 2022. ([DM4])
References:
- Tom White, Hadoop: The Definitive Guide, 4th ed., O'Reilly Media, 2015.
- Jimmy Lin and Chris Dyer, Data-Intensive Text Processing with MapReduce, Morgan & Claypool Publishers, 2010.
- Jure Leskovec, Anand Rajaraman, Jeffrey David Ullman, Mining of Massive Datasets, 3rd Edition, Cambridge University Press, Feb. 2020.
- Jules S. Damji, Brooke Wenig, Tathagata Das, Denny Lee, Learning Spark: Lightning-Fast Big Data Analysis, 2nd ed., O'Reilly Media, Jul. 2020.
- Others: online documents (Hadoop, Spark), tutorials, and selected academic papers.

Latest News

Nov. 7, 2023: [NOTE] HW#3 has been announced.
Oct. 24, 2023: [NOTE] HW#2 has been announced.
Oct. 3, 2023: [NOTE] HW#1 has been announced.
Aug. 29, 2023: The homepage for Educational Data Mining and Applications (Fall 2023) has been setup.

(Tentative) Schedule

* All slides can be downloaded at the iSchool+ plaform in NTUT.

Week	Date	Content	Reading	Note
1	Sep. 12 & 13, 2023	Course Overview Ch.1, Introduction
2	Sep. 19 & 20, 2023	Ch.2, Data, Measurements, and Data Preprocessing	DM4, Ch.2
3	Sep. 26 & 27, 2023	(Case Study: Preprocessing Educational Open Data)	DM4, Ch.2
4	Oct. 3 & 4, 2023	Ch.4, Pattern Mining: Basic Concepts and Methods	DM4, Ch.4	HW#1
5	Oct. 10 & 11, 2023	(10/10: Leave for National Day) Ch.4	DM4, Ch.4	Term Project Proposal
6	Oct. 17 & 18, 2023	Ch.5, Pattern Mining: Advanced Methods (Case Study: Frequen Pattern Mining on Educaitonal Data)	DM4, Ch.5 (selected)	Due: HW#1 Team Registration
7	Oct. 24 & 25, 2023	Ch.6, Classification: Basic Concepts	DM4, Ch.6	HW#2 Due: Team Registration
8	Oct. 31 & Nov. 1, 2023	(Case Study: Classifying Educational Data)	DM4, Ch.6
9	Nov. 7 & 8, 2023	Ch.7, Classification: Advanced Methods	DM4, Ch.7 (selected sections)	HW#3 Due: HW#2
10	Nov. 14 & 15, 2023	(11/14: Midterm Exam)
11	Nov. 21 & 22, 2023	Ch.8, Cluster Analysis: Basic Concepts and Methods	DM4, Ch.8	Due: HW#3 Due: Proposal
12	Nov. 28 & 29, 2023	(11/28 Invited Talk: Educational Data Analysis) (Case Study: Clustering Educational Data)
13	Dec. 5 & 6, 2023	Ch.9, Cluster Analysis: Advanced Methods Distribtued Platforms: Hadoop, Spark MapReduce Programming (Lab: Spark cluster demo)	DM4, Ch.9 (selected sections)
14	Dec. 12 & 13, 2023	Spark Programming (Lab: classification using Spark) Result Visualization and Interpretation
15	Dec. 19 & 20, 2023	(Leave for IEEE BigData 2023) (TA: Reviewing midterm exam papers)
16	Dec. 26 & 27, 2023	Term Project Presentation (Week 1)
17	Jan. 2 & 3, 2024	Term Project Presentation (Week 2)
18	Jan. 9 & 10, 2024	Term Project Presentation (Week 3)

Programming Assignments and Projects

Please hand in your assignment before deadline according to the following instructions.

Submission Instructions

NOTE: Programs or projects in electronic files must be submitted directly to i-School+.

If you cannot successfully submit your work, please contact with the TA and the instructor.

Homeworks

There will be several written assignments and programming exercises that target at different data analysis tasks.

HW#1 : Ch.2-3 Data Preprocessing [DM3]
Due: Oct. 17, 2023
HW#2 : Ch.6 Frequent Pattern Mining [DM3]
Due: Nov. 7, 2023
HW#3 : Ch.8-9 Classification [DM3]
Due: Nov. 21, 2023
(HW#4)

Projects

Term Project

Item	Description	Time
Proposal	You are required to submit a proposal for term project one week after midterm exam.	Nov. 21, 2023 (Tue.)
Topics	Two options: Project for data analysis or related system development Joining competitions as your term project. You can check the details of recent competitions as potential topics for term project.
Schedule	Due to our time limits, we have to start the term project presentation as early as Dec. 19, 2023 (Tue.). * [NOTE] All presentations must be finished within the scheduled time slots, which will be the last 4 weeks in this semester. No other time slots will be avbailable.	Dec. 19, 20, 26, 27, 2023 & Jan. 2, 3, 9, 10, 2024
Report	Each team is required to upload the final report after finishing your presentation. The final report should contain at least the following: presentation slides, and source code, and documents containing installation/execution instructions, team members and task responsibility	Jan. 12, 2024 (Fri.)

Exams

Midterm Exam: Nov. 6-10, 2023
- Date: Nov. 14, 2023 (Tue.)
- Time: 13:10-15:00pm
- Location: R227, 6th Teaching Building
- Range: Ch. 1-2, 4-7
Final Exam: Jan. 8-12 2024
- Note: There will be no final exam in this course. Instead, you are required to finish a term project for system development or competition.

Scores

Please check the homework submission site for more details.

E-mail: jhwang AT ntut . edu . tw
Created: Aug. 29, 2023.
Last Updated: Dec. 27, 2023.