Healthcare Data Engineer - Cloud ETL & Spark

Compunnel, Inc.; Atlanta (GA); On-site; USD 80,000 - 110,000; Full time

Job summary

A leading technology firm in Atlanta is seeking a Software Developer to build and manage efficient data pipelines. You will utilize technologies like Python, SQL, and Databricks while working closely with clients to support data distribution for large healthcare projects. Your expertise in cloud platforms and data warehousing will be essential in delivering optimized solutions. Experience in this field will provide a competitive advantage.

Qualifications

• Proven experience in building efficient ETL pipelines.
• Familiarity with cloud platforms and data warehousing.
• Strong understanding of data analysis and mapping.

Responsibilities

• Build and manage efficient ETL pipelines using Databricks.
• Optimize performance of data extract scripts.
• Collaborate with clients to understand data distribution requirements.

Skills

Proficient with Python

Proficient with SQL

Experience with Spark SQL

Familiarity with AWS services

Experience with Terraform

Experience with GitLab CI/CD

Query tuning and optimization

Familiarity with data warehousing

Experience with healthcare clients

Education

Master of Technology in Data Science & Engineering

Tools

Databricks

Terraform

GitLab CI/CD

Snowflake

Job description

A leading technology firm in Atlanta is seeking a Software Developer to build and manage efficient data pipelines. You will utilize technologies like Python, SQL, and Databricks while working closely with clients to support data distribution for large healthcare projects. Your expertise in cloud platforms and data warehousing will be essential in delivering optimized solutions. Experience in this field will provide a competitive advantage.