Remote Databricks Data Engineer - ETL & Azure Migration

AnewHealth; United States; Remote; USD 110,000 - 145,000; Full time

Benefits offered by this job

Medical, dental, vision

Flexible spending account

Company-paid life insurance

Short-term disability

401(k)

Paid time off

Paid holidays

Job summary

AnewHealth is hiring a Data Engineer to design and operate data pipelines in Databricks, ensuring robust ETL/ELT processes and high data quality. You will migrate Azure Data Factory workflows and Functions to Databricks, validate parity, and support cross-functional teams with timely, reliable data products.

The role is remote, full-time, and requires collaboration with data architects, analysts, and business stakeholders to drive scalable analytics solutions across the organization.

Qualifications

• This position requires a Bachelor’s degree or equivalent practical experience.
• 3+ years of experience building and supporting production data pipelines.
• Hands-on Databricks experience with PySpark, Delta Lake, and Workflows/Jobs.
• Experience migrating Azure Data Factory pipelines/Functions to Databricks.

Responsibilities

• Design, build, test, and maintain scalable data pipelines in Databricks.
• Develop ETL/ELT processes to deliver analytics-ready data sets.
• Implement data quality checks and monitoring to ensure accuracy.
• Act as escalation point for production pipeline issues and resolve them quickly.
• Collaborate with data architects, analysts, and stakeholders to translate requirements.
• Lead Azure-to-Databricks migration and validate parity with legacy systems.
• Follow version control, CI/CD, and document architecture and runbooks.

Skills

SQL

Python

Databricks

PySpark

Delta Lake

Azure

ETL/ELT

Data Warehousing

Data Quality

Troubleshooting

Communication

Education

Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field

Tools

Azure Data Factory

Azure Functions

Databricks

Job description

AnewHealth is hiring a Data Engineer to design and operate data pipelines in Databricks, ensuring robust ETL/ELT processes and high data quality. You will migrate Azure Data Factory workflows and Functions to Databricks, validate parity, and support cross-functional teams with timely, reliable data products.

The role is remote, full-time, and requires collaboration with data architects, analysts, and business stakeholders to drive scalable analytics solutions across the organization.