Databricks Data Engineer - Healthcare Pipelines

Gentiva; Atlanta (GA); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Health Insurance

401k Plan

Tuition Reimbursement

PTO

Job summary

Gentiva is seeking a Data Engineer to design and implement scalable data pipelines using Databricks, Delta Lake, and Azure Data Factory within a healthcare data environment. You will ensure data accuracy, security, and accessibility for analytics teams across the organization.

Responsibilities include building robust ETL/ELT processes, applying medallion architecture, implementing Unity Catalog, and collaborating with BI developers and data scientists to deliver insights at scale.

Qualifications

• Bachelor's degree or equivalent in a technical field.
• 5+ years of data engineering/analytics/software development experience.
• Hands-on Databricks and Spark experience in cloud environments.

Responsibilities

• Translate business requirements into technical specs and data architecture.
• Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory, Databricks and Spark.
• Implement Delta Lake, Unity Catalog, and data governance practices.
• Build and optimize data workflows with Databricks Workflows and Jobs.
• Collaborate with BI and data science teams and ensure data quality and security.

Skills

Databricks

Python (PySpark)

SQL

Spark

Azure Data Factory

Delta Lake

Data governance

Git

Education

Bachelor's degree in Computer Science, Information Technology or related field

5+ years of experience in data engineering/analytics/software development

Tools

Azure Databricks

Apache Spark

Delta Live Tables

Unity Catalog

SSIS

Job description

Gentiva is seeking a Data Engineer to design and implement scalable data pipelines using Databricks, Delta Lake, and Azure Data Factory within a healthcare data environment. You will ensure data accuracy, security, and accessibility for analytics teams across the organization.

Responsibilities include building robust ETL/ELT processes, applying medallion architecture, implementing Unity Catalog, and collaborating with BI developers and data scientists to deliver insights at scale.