Educational Data Mining and Applications, Fall 2024

This course is one of the advanced courses in the Micro Courses on Educational Big Data. It introduces the basic concepts and principles of data mining, including: data preprocessing, frequent pattern mining, classification, and clustering. Also, students need to use tools such as Weka and Python for educational big data analytics. With the programming exercises and term project, students will be able to learn the fundamental ideas of educational data analysis and real applications with practical tools.
The course is offered at undergraduate level.

Notes on online recording of course sessions

All students enrolled in this course have been added to the team in Microsoft Teams for the corresponding course number.
You can check the online recording of the course in Microsoft Teams at the following channel: Team created for Educational Data Mining and Applications Course [Course Number: 337849]

Course Information

Instructor: Jenq-Haur Wang
E-mail: mailbox at the domain of our university, and my username is jhwang
Office: R1534, Technology Building (ext. 4238)
Office Hours: Tue. and Thu. 9:10-12:00am
Class Hours: Mon. 10:10-12:00pm, Wed. 9:10-10:00am, R234, Technology Building / R327, 6th Teaching Building
TA: Mr. Wang (R1424, Technology Building)
E-mail: (TBA)
Prerequisite: data structures (and algorithms), database systems, discrete math (probability), operating systems, and working experience of high-level programming languages
Textbook: (Selected chapters)
- Jiawei Han, Jian Pei, and Hanghang Tong, Data Mining: Concepts and Techniques, 4th ed., Morgan Kaufmann Publishers, Oct. 2022. ([DM4])
References:
- Tom White, Hadoop: The Definitive Guide, 4th ed., O'Reilly Media, 2015.
- Jimmy Lin and Chris Dyer, Data-Intensive Text Processing with MapReduce, Morgan & Claypool Publishers, 2010.
- Jure Leskovec, Anand Rajaraman, Jeffrey David Ullman, Mining of Massive Datasets, 3rd Edition, Cambridge University Press, Feb. 2020.
- Jules S. Damji, Brooke Wenig, Tathagata Das, Denny Lee, Learning Spark: Lightning-Fast Big Data Analysis, 2nd ed., O'Reilly Media, Jul. 2020.
- Others: online documents (Hadoop, Spark), tutorials, and selected academic papers.

Latest News

Nov. 5, 2024: [NOTE] Since we just finished the midterm exam this Monday (Nov.4), the course between 9:10-10:00am on Nov. 6, 2024 (Wed.) will be cancelled.
Oct. 30, 2024: [NOTE] HW#3 has been announced.
Oct. 15, 2024: [NOTE] HW#2 has been announced.
Sep. 30, 2024: [NOTE] HW#1 has been announced.
Sep. 2, 2024: The homepage for Educational Data Mining and Applications (Fall 2024) has been setup.

(Tentative) Schedule

* All slides can be downloaded at the iSchool+ plaform in NTUT.

Week	Date	Content	Reading	Note
1	Sep. 9 & 11, 2024	Course Overview Ch.1, Introduction
2	Sep. 16 & 18, 2024	Ch.2, Data, Measurements, and Data Preprocessing	DM4, Ch.2
3	Sep. 23 & 25, 2024	(Case Study: Preprocessing Educational Open Data)	DM4, Ch.2
4	Sep. 30 & Oct. 2, 2024	Ch.4, Pattern Mining: Basic Concepts and Methods	DM4, Ch.4	HW#1
5	Oct. 7 & 9, 2024	Ch.4	DM4, Ch.4	Term Project Proposal
6	Oct. 14 & 16, 2024	Ch.5, Pattern Mining: Advanced Methods (Case Study: Frequen Pattern Mining on Educaitonal Data)	DM4, Ch.5 (selected)	Due: HW#1 10/16: HW#2 Team Registration
7	Oct. 21 & 23, 2024	Ch.6, Classification: Basic Concepts	DM4, Ch.6	Due: Team Registration
8	Oct. 28 & 30, 2024	10/28: Invited Talk (Case Study: Classifying Educational Data)	DM4, Ch.6	10/30 Due: HW#2 10/30: HW#3
9	Nov. 4 & 6, 2024	(11/4: Midterm Exam)
10	Nov. 11 & 13, 2024	Ch.7, Classification: Advanced Methods	DM4, Ch.7 (selected sections)	11/13 Due: HW#3
11	Nov. 18 & 20, 2024	Ch.8, Cluster Analysis: Basic Concepts and Methods	DM4, Ch.8	Due: Proposal
12	Nov. 25 & 27, 2024	(Case Study: Clustering Educational Data) Ch.9, Cluster Analysis: Advanced Methods		DM4, Ch.9 (selected sections)
13	Dec. 2 & 4, 2024	Distribtued Platforms: Hadoop, Spark MapReduce Programming (Lab: Spark cluster demo) Spark Programming (Lab: classification using Spark) Result Visualization and Interpretation
14	Dec. 9 & 11, 2024	Term Project Presentation (Week 1)
15	Dec. 16 & 18, 2024	(Leave for IEEE BigData 2024) (TA: Reviewing midterm exam papers)
16	Dec. 23 & 25, 2024	(Leave for IEEE BigData 2024)
17	Dec. 30, 2024 & Jan. 1, 2025	Term Project Presentation (Week 2) (1/1: Leave for New Year's Day)
18	Jan. 6 & 8, 2025	Term Project Presentation (Week 3)

Programming Assignments and Projects

Please hand in your assignment before deadline according to the following instructions.

Submission Instructions

NOTE: Programs or projects in electronic files must be submitted directly to i-School+.

If you cannot successfully submit your work, please contact with the TA and the instructor.

Homeworks

There will be several written assignments and programming exercises that target at different data analysis tasks.

HW#1 : Ch.2 Data, Measurements, and Data Preprocessing [DM4]
Due: Oct. 14, 2024
HW#2 : Ch.4 Pattern Mining: Basic Concepts and Methods [DM4]
Due: Oct. 30, 2024
HW#3 : Ch.6-7 Classification [DM4]
Due: Nov. 13, 2024
(HW#4)

Projects

Term Project

Item	Description	Time
Proposal	You are required to submit a proposal for term project one week after midterm exam.	Nov. 11, 2024 (Tue.)
Topics	Two options: Project for data analysis or related system development Joining competitions as your term project. You can check the details of recent competitions as potential topics for term project.
Schedule	Due to our time limits, we have to start the term project presentation as early as Dec. 16, 2024 (Mon.). * [NOTE] All presentations must be finished within the scheduled time slots, which will be the last 4 weeks in this semester. No other time slots will be avbailable.	Dec. 9, 11, 30, 2024 & Jan. 6, 8, 2025
Report	Each team is required to upload the final report after finishing your presentation. The final report should contain at least the following: presentation slides, and source code, and documents containing installation/execution instructions, team members and task responsibility	Jan. 10, 2025 (Fri.)

Exams

Midterm Exam: Nov. 4-8, 2024
- Date: Nov. 4, 2024 (Mon.)
- Time: 10:10-12:00pm
- Location: R234, Technology Building
- Range: Ch. 1-2, 4-7
Final Exam: Jan. 6-10, 2025
- Note: There will be no final exam in this course. Instead, you are required to finish a term project for system development or competition.

Scores

Please check the homework submission site for more details.

E-mail: jhwang AT ntut . edu . tw
Created: Sep. 2, 2024.
Last Updated: Nov. 10, 2024.