Data Engineering Capstone Project

Demonstrate proficiency in skills required for an entry-level data engineering role.
Design and implement various concepts and components in the data engineering lifecycle such as data repositories.
Showcase working knowledge with relational databases, NoSQL data stores, big data engines, data warehouses, and data pipelines.
Apply skills in Linux shell scripting, SQL, and Python programming languages to Data Engineering problems.

Course Content

Module 1: Data Platform Architecture and OLTP Database

Introduction to Capstone Project

00:00
Assignment Overview

00:00

2 quizzes

1 app item

2 plugins

Module 2: Querying Data in NoSQL Databases

2 quizzes

1 app item

Module 3: Build a Data Warehouse

1 reading

3 quizzes

3 app items

1 plugin

Module 4: Data Analytics

2 quizzes

2 plugins

Module 5: ETL & Data Pipelines

3 quizzes

2 app items

Module 6: Big Data Analytics with Spark

2 quizzes

2 app items

Module 7: Final Submission and Peer Review

Student Ratings & Reviews

No Review Yet

What Will You Learn?

Course Content

Module 1: Data Platform Architecture and OLTP Database

Introduction to Capstone Project

Assignment Overview

2 quizzes

Checklist: OLTP Database

Graded Quiz: OLTP Database

1 app item

Hands-on Lab: OLTP Database

2 plugins

Data Platform Architecture

OLTP Database Requirements and Design

Module 2: Querying Data in NoSQL Databases

Assignment Overview: Querying Data in NoSQL Databases

2 quizzes

Checklist: Querying Data in NoSQL Databases

Graded Quiz: Querying Data in NoSQL Databases

1 app item

Hands-on Lab: Querying Data in NoSQL Databases

Module 3: Build a Data Warehouse

Assignment Overview: Data Warehouse Design & Setup

Assignment Overview: Data Warehouse Reporting

1 reading

Optional Lab Information

3 quizzes

Checklist: Data Warehousing

Checklist: Data Warehouse Reporting

Graded Quiz: Data Warehouse & Reporting

3 app items

Hands-on Lab: Data Warehousing

Hands-on Lab: Data Warehouse Reporting using PostgreSQL

(Optional) Obtain IBM Cloud Feature Code and Activate Trial Account

1 plugin

(Optional) Hands-on Lab: Data Warehouse Reporting using DB2

Module 4: Data Analytics

Assignment Overview

2 quizzes

Checklist: Dashboard Creation

Graded Quiz: Dashboard Creation

2 plugins

Hands-on Lab: Getting Started with Cognos Dashboard Emb

Hands-On Lab: Dashboard Creation

Module 5: ETL & Data Pipelines

Assignment Overview: ETL

Assignment Overview: Data Pipelines using Apache Airflow

3 quizzes

Checklist: ETL

Checklist: Data Pipelines using Apache Airflow

Graded Quiz: ETL & Data Pipelines using Apache Airflow

2 app items

Hands-on Lab: ETL

Hands-on Lab: Data Pipelines using Apache Airflow

Module 6: Big Data Analytics with Spark

Assignment Overview: Big Data Analytics with Spark

2 quizzes

Checklist: Big Data Analytics with Spark

Graded Quiz: Big Data Analytics with Spark

2 app items

Practice Hands On Lab: Saving and loading a SparkML model

Hands-on Lab: SparkML Ops

Module 7: Final Submission and Peer Review

In this final module you will complete your submission of screenshots from the hands-on labs for your peers to review. Once you have completed your submission you will then review the submission of one of your peers and grade their submission.

Student Ratings & Reviews

Quick Links

Resources

Support