From the course: Data Engineering Foundations
Unlock the full course today
Join today to access over 23,300 courses taught by industry experts.
Data extraction from a PostgreSQL database
From the course: Data Engineering Foundations
Data extraction from a PostgreSQL database
- [Instructor] So let's apply our knowledge to a practical project. Here's an example of a movie rating application. I have Movies Data and I have Users Data. In the movies.csv, you see I have ID of the movie, name, description and the category to which that movie belongs to. Similarly, I have Users. Users.csv contains ID of the user, the movie ID that the user is rating, and finally, the rating that the user has provided. On the job, you will be given access to an already existing database. But here, we'll have to set up our database from scratch. So let's quickly do that. The installation process is already provided in the Resources, so you can defer to that document, in order to download and install PostgreSQL onto your systems. Now the first step is to start your Postgres Server. The command for that is psql postgres. Hit Enter, now your Postgres Server is running. Now the next step is to create the database. The command for that is CREATE DATABASE, and then the name of the…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
-
(Locked)
Sources of data extraction4m 46s
-
(Locked)
Data extraction from a PostgreSQL database6m 55s
-
(Locked)
Challenge: Data extraction40s
-
(Locked)
Solution: Data extraction51s
-
(Locked)
Transforming data2m 3s
-
(Locked)
Challenge: Transforming data42s
-
(Locked)
Solution: Transforming data58s
-
(Locked)
Loading data into a DB4m 11s
-
(Locked)
Challenge: Loading data59s
-
(Locked)
Solution: Loading data1m
-
(Locked)
Scheduling ETL pipeline using Airflow9m 3s
-
(Locked)
-