Data Engineer

AnewHealth; United States; Remote; USD 110,000 - 145,000; Full time

Benefits offered by this job

Medical, dental, vision

Flexible spending account

Company-paid life insurance

Short-term disability

401(k)

Paid time off

Paid holidays

Job summary

AnewHealth is hiring a Data Engineer to design and operate data pipelines in Databricks, ensuring robust ETL/ELT processes and high data quality. You will migrate Azure Data Factory workflows and Functions to Databricks, validate parity, and support cross-functional teams with timely, reliable data products.

The role is remote, full-time, and requires collaboration with data architects, analysts, and business stakeholders to drive scalable analytics solutions across the organization.

Qualifications

• This position requires a Bachelor’s degree or equivalent practical experience.
• 3+ years of experience building and supporting production data pipelines.
• Hands-on Databricks experience with PySpark, Delta Lake, and Workflows/Jobs.
• Experience migrating Azure Data Factory pipelines/Functions to Databricks.

Responsibilities

• Design, build, test, and maintain scalable data pipelines in Databricks.
• Develop ETL/ELT processes to deliver analytics-ready data sets.
• Implement data quality checks and monitoring to ensure accuracy.
• Act as escalation point for production pipeline issues and resolve them quickly.
• Collaborate with data architects, analysts, and stakeholders to translate requirements.
• Lead Azure-to-Databricks migration and validate parity with legacy systems.
• Follow version control, CI/CD, and document architecture and runbooks.

Skills

SQL

Python

Databricks

PySpark

Delta Lake

Azure

ETL/ELT

Data Warehousing

Data Quality

Troubleshooting

Communication

Education

Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field

Tools

Azure Data Factory

Azure Functions

Databricks

Job description

AnewHealth is one of the nation's leading pharmacy care management companies that specializes in caring for people with the most complex, chronic needs-wherever they call home. We enable better outcomes for patients and the healthcare organizations who support them. Established in 2023 through the combination of ExactCare and Tabula Rasa HealthCare, we provide a suite of solutions that includes comprehensive pharmacy services; full-service pharmacy benefit management; and specialized support services for Program of All-Inclusive Care for the Elderly. With over 1,400 team members, we care for more than 100,000 people across all 50 states.

Job Details

Job Objective:

The Data Engineer will design, build, and support the data pipelines that power our analytics, reporting, and operational systems. This role’s primary focus is developing and maintaining data pipelines within our Databricks environment, serving as an escalation point when production pipeline issues arise, and leading the migration of existing Azure Data Factory workflows and Azure Functions into Databricks. The individual is a hands-on engineer who is comfortable owning pipelines end to end - from design and development through troubleshooting and optimization - and who can work cross-functionally with data architects, analysts, and business stakeholders.

Responsibilities:

• Pipeline Development - Design, develop, test, and maintain scalable, reliable data pipelines within Databricks, using PySpark, SQL, Delta Lake, and Databricks Workflows/Jobs.
• Build ETL/ELT processes that ingest, transform, and deliver data from a variety of source systems into curated, analytics-ready datasets.
• Implement data quality checks, validation logic, and monitoring/alerting to ensure pipeline reliability and data accuracy.
• Escalation & Production Support - Act as a primary point of escalation for production data pipeline issues, performing root-cause analysis, troubleshooting failures, and implementing timely fixes.
• Partner with support and business teams to triage incoming issues, communicate status, and drive incidents to resolution within SLA.
• Document recurring issues and implement long-term fixes or process improvements to reduce future escalations.
• Azure-to-Databricks Migration - Lead and execute the migration of existing Azure Data Factory pipelines and Azure Functions to the Databricks platform, re-architecting logic as needed to leverage Databricks-native capabilities.
• Validate data parity and pipeline performance between legacy Azure-based solutions and their Databricks replacements, ensuring a clean, low-risk cutover.
• Retire legacy Azure Data Factory/Azure Functions components once migrations are validated and stable.
• Collaboration & Best Practices - Collaborate with data architects, analysts, and business stakeholders to translate requirements into technical designs.
• Follow version control, code review, and CI/CD best practices for all pipeline code and configuration.
• Contribute to documentation of pipeline architecture, data flows, and operational runbooks
• Embody AnewHealth’s Core Values in all communications and interactions.
• Other duties as assigned.

The above essential functions are representative of major duties of positions in this job classification. Specific duties and responsibilities may vary based upon departmental needs. Other duties may be assigned similar to the above consistent with knowledge, skills and abilities required for the job. Not all of the duties may be assigned to a position.

Qualifications:

These represent the desired qualifications of the ideal candidate. They are not meant to limit consideration for candidates who do not meet all of the standards listed. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Education:

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent practical experience

Experience:

• Required: 3+ years of experience as a Data Engineer building and supporting production data pipelines.
• Hands-on experience developing data pipelines in Databricks, including PySpark, Delta Lake, and Databricks Workflows/Jobs.
• Experience with Azure Data Factory and/or Azure Functions, with the ability to interpret existing ADF pipelines/Functions and re-implement them in Databricks.

Skills and Abilities:

• Strong SQL skills, including query optimization and experience with relational and dimensional data models.
• Proficiency in Python for data engineering and pipeline automation.
• Working knowledge of the broader Azure cloud ecosystem (e.g., Azure Data Lake Storage, Azure SQL Database, Azure Key Vault).
• Solid understanding of ETL/ELT design patterns, data warehousing concepts, and data quality/validation practices.
• Strong troubleshooting and analytical skills, with the ability to diagnose and resolve production issues under time pressure.
• Excellent communication skills, with the ability to explain technical issues clearly to both technical and non-technical stakeholders.

Physical/Mental Demands: [Refer to Job Analysis Questionnaire and/or options below]

• [If Remote/home office]: This position is administrative in nature and will present physical demands requisite to a position requiring: hearing, seeing, sitting, standing, talking, and walking. The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job.
• Must be able to commute to multiple site locations within assigned territory. May be necessary to work extended hours as needed.

Schedule:

This is a full-time position with an expectation to work an average of 40 hours per week and be available outside of normal business hours to meet customer expectations on an ad-hoc basis. Schedules are set to accommodate the requirements of the position and the needs of the organization and may be adjusted as needed.

Travel:

Travel may be required for special organization or department events, department team meetings, trade shows, conferences, and other client engagements.

Supervisory: No

This is a remote position.

AnewHealth offers a comprehensive benefit package for full-time employees that includes medical/dental/vision, flexible spending, company-paid life insurance and short-term disability as well as voluntary benefits,401(k), Paid Time Off and paid holidays. Medical, dental and vision coverage are effective 1st of the month following date of hire

AnewHealth provides equal employment opportunity to all qualified applicants regardless of race, color, religion, national origin, sex, sexual orientation, gender identity, age, disability, genetic information, or veteran status, or other legally protected classification in the state in which a person is seeking employment. Applicants are encouraged to confidentially self-identify when applying. Local applicants are encouraged to apply. We maintain a drug-free work environment. Applicants must be eligible to work in this country.