Senior Data Engineer - Databricks & Healthcare (Remote)

Abt Global Inc.; Atlanta (GA); On-site; USD 95,000 - 120,000; Full time

Benefits offered by this job

Competitive salary

Comprehensive employee benefits

Professional development

Flexible schedules

Job summary

The Data Engineer III role at Abt Global Inc. (via TSPI) focuses on designing, developing, and maintaining scalable data pipelines for CMS and Medicaid data processing. You will leverage Databricks to build secure, efficient data solutions that support analytics, reporting, and operations.

Strong Python, PySpark, and SQL skills are required, along with experience handling large healthcare datasets. US work authorization is required with potential for Public Trust clearance.

Qualifications

• Bachelor's degree with 5 years relevant experience or Master's with 3 years relevant experience.
• Experience with CMS systems and/or Medicaid data.
• Experience with Databricks or similar cloud analytics platforms.
• Strong programming experience in Python, PySpark, and SQL.
• Experience building distributed data processing pipelines.
• Experience working with large healthcare datasets.
• Strong understanding of ETL/ELT pipeline development.
• US work authorization and ability to obtain Public Trust clearance.

Responsibilities

• Design and implement scalable data pipelines for ingesting, transforming, and processing healthcare data.
• Develop ETL/ELT workflows supporting CMS and Medicaid data integration.
• Build and maintain data processing workflows using Databricks and distributed computing technologies.
• Develop data transformation and analytics solutions using Python, PySpark, and SQL.
• Ensure data quality, consistency, and governance across systems.
• Optimize performance of data pipelines and large-scale data processing workloads.
• Collaborate with analytics, engineering, and DevOps teams to support data platform operations.
• Maintain documentation for data architecture, data models, and pipeline processes.
• Support compliance with healthcare data security and privacy requirements.

Skills

Data pipeline design

ETL/ELT development

Healthcare data familiarity

Cloud analytics platforms

Python

PySpark

SQL

Distributed processing

Education

Bachelor's degree + 5 years experience or Master's + 3 years experience

Tools

Databricks

Python

PySpark

SQL

Cloud platforms

Job description

The Data Engineer III role at Abt Global Inc. (via TSPI) focuses on designing, developing, and maintaining scalable data pipelines for CMS and Medicaid data processing. You will leverage Databricks to build secure, efficient data solutions that support analytics, reporting, and operations.

Strong Python, PySpark, and SQL skills are required, along with experience handling large healthcare datasets. US work authorization is required with potential for Public Trust clearance.