• views: 109
• date: 4 April 2023
• posted by: voska89

What you'll learn
Spark Scala industry standard coding practices - Logging, Exception Handling, Reading from Configuration File
Unit Testing Spark Scala using JUnit , ScalaTest, FlatSpec & Assertion
Building a data pipeline using Hive, Spark and PostgreSQL
Spark Scala development with Intellij, Maven
Cloudera QuickStart VM setup on GCP
Requirements
Basic programming skills
Basic database skills
Hadoop entry level knowledge
Description
This course will bridge the gap between your academic and real world knowledge and prepare you for an entry level Big Data Spark Scala developer role. You will learn the followingSpark Scala coding best practicesLogging - log4j, slf4Exception HandlingConfiguration using Typesafe configDoing development work using IntelliJ, MavenUsing your local environment as a Hadoop Hive environmentReading and writing to a Postgres database using SparkUnit Testing Spark Scala using JUnit , ScalaTest, FlatSpec & AssertionBuilding a data pipeline using Hadoop , Spark and PostgresBonus - Setting up Cloudera QuickStart VM on Google Cloud Platform (GCP)Structured StreamingPrerequisites :Basic programming skillsBasic database knowledgeBig Data and Spark entry level knowledge
Who this course is for
Students looking at moving from Big Data Spark academic background to a real world developer role


Homepage

https://www.udemy.com/course/spark-scala-coding-best-practices-data-pipeline/

   
   
   

Forex Trading

Crypto Trading. 20 USD Bonus after KYC

We need your support!
Make a donation to help us stay online
        
Bitcoin (BTC)
bc1q08g9d22cxkawsjlf8etuek2pc9n2a3hs4cdrld
	
Bitcoin Cash (BCH)
qqvwexzhvgauxq2apgc4j0ewvcak6hh6lsnzmvtkem

Ethereum (ETH)
0xb55513D2c91A6e3c497621644ec99e206CDaf239

Litecoin (LTC)
ltc1qt6g2trfv9tjs4qj68sqc4uf0ukvc9jpnsyt59u

USDT (ERC20)
0xb55513D2c91A6e3c497621644ec99e206CDaf239

USDT (TRC20)
TYdPNrz7v1P9riWBWZ317oBgJueheGjATm

0 1 2 3 4 5

| Print version |

	Information
		Users of GUESTS are not allowed to comment this publication.