Senior Data Engineer III: Databricks & Healthcare (Remote)

Abt Global Inc.; Austin (TX); On-site; USD 95,000 - 120,000; Full time

Job summary

Abt Global Inc., through its TSPI division, seeks a Data Engineer III to design, develop, and maintain scalable data pipelines and analytics workflows for CMS and Medicaid data. The role leverages Databricks to build secure, reliable data solutions supporting analytics, reporting, and operations.

The ideal candidate has strong Python, PySpark, and SQL skills, experience with distributed data processing, and US work authorization with eligibility for a Public Trust clearance.

Qualifications

• Bachelor's degree plus five years of relevant experience or Master's plus three.
• Experience with CMS systems and Medicaid data.
• Proficient in Python, PySpark and SQL.
• Experience building distributed data processing pipelines.
• US work authorization and ability to obtain a Public Trust clearance.

Responsibilities

• Design and implement scalable data pipelines for ingesting and processing healthcare data.
• Develop ETL/ELT workflows for CMS and Medicaid data integration.
• Build data processing workflows using Databricks and distributed computing.
• Develop data transformation and analytics solutions with Python, PySpark, and SQL.
• Ensure data quality, governance, and security across systems.
• Optimize performance of large-scale data workloads.
• Collaborate with analytics, engineering, and DevOps teams.
• Maintain documentation for data architecture, models, and pipelines.
• Support healthcare data security and privacy compliance.

Skills

Python

PySpark

SQL

Databricks

ETL/ELT

Distributed data pipelines

CMS/Medicaid data

Data governance

Education

Bachelor's degree + 5 years

Master's degree + 3 years

Tools

Databricks

Job description

Abt Global Inc., through its TSPI division, seeks a Data Engineer III to design, develop, and maintain scalable data pipelines and analytics workflows for CMS and Medicaid data. The role leverages Databricks to build secure, reliable data solutions supporting analytics, reporting, and operations.

The ideal candidate has strong Python, PySpark, and SQL skills, experience with distributed data processing, and US work authorization with eligibility for a Public Trust clearance.