Senior Data Engineer — Enterprise Pipelines & Azure

GAP Solutions, Inc.; Atlanta, Northern (GA, KY); Hybrid; USD 140,000 - 155,000; Full time

Job summary

Centers for Disease Control & Prevention (CDC) in Atlanta, GA seeks a Senior Data Engineer to design, build, and operate enterprise-scale data pipelines and platforms, enabling analysis-ready datasets for leadership decisions.

You will work with data scientists and cloud engineers on Databricks, Azure, and governance, delivering scalable ETL/ELT pipelines, data models, and secure data architectures.

Qualifications

• 8+ years of experience in data engineering, software engineering, or database architecture.
• 6+ years of experience in Python and SQL with experience building scalable ETL/ELT pipelines.
• 2+ years of experience with cloud data ecosystems like Azure Data Factory.
• 1+ years of experience with modern data processing frameworks like Databricks.

Responsibilities

• Design, implement, and maintain enterprise grade ETL/ELT pipelines using Python and SQL.
• Build, optimize, and manage data models, warehouses, and lakehouse environments (e.g., Databricks).
• Develop processes for ingesting, cleaning, validating, and transforming large scale datasets from APIs, relational sources, and unstructured systems.
• Collaborate with cloud engineering teams to deploy and manage data solutions on Azure.

Skills

Python

SQL

ETL/ELT pipelines

Data modeling

Governance

Education

Bachelor’s degree in Computer Science or related field

Tools

Databricks

Azure Data Factory

CI/CD

Job description

Centers for Disease Control & Prevention (CDC) in Atlanta, GA seeks a Senior Data Engineer to design, build, and operate enterprise-scale data pipelines and platforms, enabling analysis-ready datasets for leadership decisions.

You will work with data scientists and cloud engineers on Databricks, Azure, and governance, delivering scalable ETL/ELT pipelines, data models, and secure data architectures.