• views: 202
• date: 18 December 2023
• posted by: voska89

Gradient Boosted Trees, XGBoost, Spark NLP, Prophet, Data Cleaning, Descriptive Statistics, Spark SQL
What you'll learn
Data analysis and descriptive statistics with PySpark - Learning to compute essential descriptive statistics for data understanding and summarization
Data Cleaning with PySpark
Predictive modeling with PySpark using Regression
Applying Classification techniques to a real world problem in PySpark
Text analytics using PySpark and Spark NLP
Time-Series modeling with PySpark and Prophet
Introduction to Spark SQL for data querying
Requirements
Basic knowledge of data science and ML principles will be helpful
Familiarity with Python to work with PySpark
A computer with internet to access course material
Description
This course is based on real world problems in PySpark, surrounding Data Cleaning, Descriptive statistics, Classification and Regression Modeling. The first segment introduces descriptive statistics in PySpark and computing fundamental measures such as mean, standard deviation and generating an extended statistical summary. The second segment is based on cleaning the data in PySpark, working with null values, redundant data and imputing the null values.The third segment is about Predictive modeling with PySpark using Gradient Boosted Trees RegressionThe fourth and fifth segments are based on applying classification techniques in PySpark. The fourth Segment introduces the application of Spark XGB Classifier for a classification problem and the fifth segment is about using a deep learning model for text sentiment classification. The sixth segment is about time series analytics and modeling using PySpark and ProphetThe seventh segment introduces Spark SQL for data querying and analysis.These segments also include advanced visualization techniques through Seaborn and Plotly libraries including Box plots to understand the distribution of the data and assessment of outliers, Count plots to understand balance in the proportion of data, Bar chart to represent feature importance as part of the Gradient Boosted Trees Regression Model, Word Cloud for text analytics and analyzing time series data to extract seasonality and trend components. Each of these segments, has a Google Colab notebook included aligning with the lecture.
Who this course is for
This course is suited for anyone interested in the realm of analytics using PySpark - particularly useful for analysts and engineers interested in Big Data, someone with a basic knowledge of data science and ML principles
Homepage

https://www.udemy.com/course/problem-solving-using-pyspark-regression-classification/

   
   
   

Forex Trading

Crypto Trading. 20 USD Bonus after KYC

We need your support!
Make a donation to help us stay online
        
Bitcoin (BTC)
bc1q08g9d22cxkawsjlf8etuek2pc9n2a3hs4cdrld
	
Bitcoin Cash (BCH)
qqvwexzhvgauxq2apgc4j0ewvcak6hh6lsnzmvtkem

Ethereum (ETH)
0xb55513D2c91A6e3c497621644ec99e206CDaf239

Litecoin (LTC)
ltc1qt6g2trfv9tjs4qj68sqc4uf0ukvc9jpnsyt59u

USDT (ERC20)
0xb55513D2c91A6e3c497621644ec99e206CDaf239

USDT (TRC20)
TYdPNrz7v1P9riWBWZ317oBgJueheGjATm

0 1 2 3 4 5

| Print version |

	Information
		Users of GUESTS are not allowed to comment this publication.