Skip to main content

Ctrl+K

DASC 5410 - Data and Database Management for Data Science

Part 1 - Relational database SQL

Lecture 1: Data types and data structures
Lecture 2: Relational models
Lecture 3: Relational models part 2
Lecture 4: PostgreSQL part 1
Lecture 5: PostgreSQL part 2
Lecture 6: PostgreSQL part 3
Lecture 7: PostgreSQL part 4
Lecture 8: Transactions ACID in SQL
Lecture 9: Joins & subqueries in SQL
Lecture 10: Window function in SQL

Part 2 - Non-relational database MongoDB

Lecture 11: Introduction to Non-Relational Databases
Lecture 12: Introduction to MongoDB and the document model
Lecture 13: Data modelling in MongoDB
Lecture 14: Schema design patterns in MongoDB
Lecture 15: CRUD operations in MongoDB
Lecture 16: Aggregation operations in MongoDB
Course recap MongoDB

Part 3 - PySpark

Lecture 17: Introduction to PySpark & Resilient Distributed Datasets (RDD)
Lecture 18: Spark Dataframes
Lecture 19: Spark Structured Streaming
Lecture 20: Monitoring ML experiement with MLFlow and Model deployment with streamlit

Installation Guide

Installation instruction for macOS
Installation instruction for Windows

Github tutorial

Version control with GitHub

Midterms Information

Midterm 1 instruction

Worksheets solutions

Worksheet 1: Introduction to databases
Worksheet 2: Introduction to relational models
Worksheet 3: PostgreSQL data manipulation
Worksheet 4: PostgreSQL data manipulation
Worksheet 5: Transactions, joins, subquerries

Index

By Quan Nguyen

© Copyright 2023.