Vidaan Shankar’s Post

View profile for Vidaan Shankar, graphic

Data Engineer @ Associated Bank | 3x AWS Certified | Snowflake | Spark | dbt | Airflow

Hey guys!!! 🚀 I've got an awesome Data Pipeline project to help you level up your SQL and Python skills. 🐍 In this project, we'll dive into the Spotify API to fetch the hottest tunes in the USA for the week and store them in a Snowflake table. Here's the lowdown: We'll use Python's Requests library to connect to Spotify and capture the data into a JSON file. Then, we'll hook up to Snowflake using its Python connector to upload the data into the table. Get ready to explore SQL functions/commands/concepts like PUT, COPY INTO <table>, CTEs, PIVOT, LISTAGG, FLATTEN, STREAMS, and TASKS. 🛠️📊 I trust you'll find this project both rewarding and educational. Happy coding! 🖥️ 🔍 Check out the complete code on GitHub: https://lnkd.in/gd2PrJBH #DataPipeline #Python #SQL #DataEngineering #Snowflake #API #DataAnalytics #TechProjects #MusicData

Data pipeline with Spotify API and Snowflake using Python

Data pipeline with Spotify API and Snowflake using Python

link.medium.com

Vibhansh Saini

Product Intern - myKaarma | Strategy Product Manager MBA grad from University of Wisconsin - Madison

4mo

Great insights, Vidaan Shankar! A quick question, in Step 2, you mentioned having same names for staging tables as the main table. Is that just for organizing purposes? If yes, would you rather suggest using With statement and pulling data directly in subquery instead of creating a staging table? PS: Well thought-out with the Cron job scheduling too! It was an insightful read!

Bala Gopinath kuchibatla

Actively seeking roles as Data Scientist, Data Analyst, & ML Engineer || Ex-Infosys || SQL, Python, Power BI, PySpark, Azure DevOps, Java

4mo

Exciting

See more comments

To view or add a comment, sign in

Explore topics