• views: 74
• date: 13 April 2025
• posted by: voska89

Industry Standard Project in Healthcare Domain using GCP services like GCS, BigQuery, Dataproc, Composer, GitHub, CICD

What you'll learn

Understand the End to End Data Engineering Project
Design and Implement Scalable ETL Pipelines for Healthcare Data
Implement Key Techniques like Incremental Data, SCD2, Metadata driven approach, Medallion Arch, Error Handling, CDM , CICD & Many more..
Develop and Deploy Data Solutions with CI/CD Practices

Requirements

Basic Knowledge on Python and SQL

Description

This project focuses on building a data lake in Google Cloud Platform (GCP) for Revenue Cycle Management (RCM) in the healthcare domain. The goal is to centralize, clean, and transform data from multiple sources, enabling healthcare providers and insurance companies to streamline billing, claims processing, and revenue tracking.GCP Services Used:Google Cloud Storage (GCS): Stores raw and processed data files.BigQuery: Serves as the analytical engine for storing and querying structured data.Dataproc: Used for large-scale data processing with Apache Spark.Cloud Composer (Apache Airflow): Automates ETL pipelines and workflow orchestration.Cloud SQL (MySQL): Stores transactional Electronic Medical Records (EMR) data.GitHub & Cloud Build: Enables version control and CI/CD implementation.CICD (Continuous Integration & Continuous Deployment): Automates deployment pipelines for data processing and ETL workflows.Techniques involved : Metadata Driven ApproachSCD type 2 implementationCDM(Common Data Model)Medallion ArchitectureLogging and MonitoringError HandlingOptimizationsCICD implementationmany more best practicesData SourcesEMR (Electronic Medical Records) data from two hospitalsClaims filesCPT (Current Procedural Terminology) CodeNPI (National Provider Identifier) DataExpected OutcomesEfficient Data Pipeline: Automating the ingestion and transformation of RCM data.Structured Data Warehouse: gold tables in BigQuery for analytical queries.KPI Dashboards: Insights into revenue collection, claims processing efficiency, and financial trends.

Who this course is for

Aspiring Data Engineers, Data Professionals
Homepage:

https://www.udemy.com/course/gcp-data-engineering-end-to-end-project-healthcare-domain/

   
   
   

Forex Trading

Crypto Trading. 20 USD Bonus after KYC

We need your support!
Make a donation to help us stay online
        
Bitcoin (BTC)
bc1q08g9d22cxkawsjlf8etuek2pc9n2a3hs4cdrld
	
Bitcoin Cash (BCH)
qqvwexzhvgauxq2apgc4j0ewvcak6hh6lsnzmvtkem

Ethereum (ETH)
0xb55513D2c91A6e3c497621644ec99e206CDaf239

Litecoin (LTC)
ltc1qt6g2trfv9tjs4qj68sqc4uf0ukvc9jpnsyt59u

USDT (ERC20)
0xb55513D2c91A6e3c497621644ec99e206CDaf239

USDT (TRC20)
TYdPNrz7v1P9riWBWZ317oBgJueheGjATm

0 1 2 3 4 5

| Print version |

	Information
		Users of GUESTS are not allowed to comment this publication.