• views: 167
• date: 28 September 2024
• posted by: voska89

Using Snowflake to data engineer Kaggle and Google Trends data with Python procedures and tasks
What you'll learn:
Setup Snowflake and AWS Accounts
Work with Kaggle and SerpAPI
Download and manipulate data with Jupyter Notebooks on VS Code
Work with External Access Integration and Storage Integration on Snowflake
Create Snowflake Python based procedures
Create Snowflake tasks
Create Streamlit apps inside of Snowflake
Requirements:
Proficient knowledge on SQL and basic knowledge on Snowflake database
Basic knowledge on data modeling and engineering
Proficient Python knowledge
Description:
This course focuses on building a data engineering pipeline that integrates multiple data sources, including Kaggle datasets and Google Trends data (fetched via SerpAPI), to analyze the relationship between Netflix show releases and the popularity of actors. You'll learn to gather and combine data on Netflix actors and their trends on Google, particularly in the weeks following a show's release.You will use Kaggle as a source for the Netflix shows and actors dataset and Google Trends (accessed via SerpAPI) to fetch real-time search data for the actors. This data will be stored and processed within the Snowflake database, leveraging its cloud-native architecture for optimal scalability and performance.Technical Stack Overview:Snowflake Database: The central repository for storing and querying data.Streamlit in Snowflake: A web app framework to visualize the data directly inside Snowflake.AWS S3: For data storage and retrieval, particularly for intermediate datasets.Snowflake Python Procedures: Automating data manipulation and pipeline processes.Snowflake External Access & Storage Integrations: Managing secure access to external services and storage.By the end of the course, you'll have a fully functional data pipeline that processes and combines streaming data, cloud storage, and APIs for trend analysis, visualized through an interactive Streamlit app within Snowflake.
Who this course is for:
Data Engineers looking to get proficient on Snowflake and Streamlit for building data pipelines
Homepage

https://www.udemy.com/course/data-pipelines-with-snowflake-and-streamlit/

   
   
   

Forex Trading

Crypto Trading. 20 USD Bonus after KYC

We need your support!
Make a donation to help us stay online
        
Bitcoin (BTC)
bc1q08g9d22cxkawsjlf8etuek2pc9n2a3hs4cdrld
	
Bitcoin Cash (BCH)
qqvwexzhvgauxq2apgc4j0ewvcak6hh6lsnzmvtkem

Ethereum (ETH)
0xb55513D2c91A6e3c497621644ec99e206CDaf239

Litecoin (LTC)
ltc1qt6g2trfv9tjs4qj68sqc4uf0ukvc9jpnsyt59u

USDT (ERC20)
0xb55513D2c91A6e3c497621644ec99e206CDaf239

USDT (TRC20)
TYdPNrz7v1P9riWBWZ317oBgJueheGjATm

0 1 2 3 4 5

| Print version |

	Information
		Users of GUESTS are not allowed to comment this publication.