Senior Data Engineer | Public Health Data Pipelines Hybrid

Blu Omega Inc.; Columbia, Northern (MD, KY); Hybrid; USD 150,000 - 165,000; Full time

Benefits offered by this job

Medical, Dental, and Vision coverage

401(k) with company match

Life and AD&D insurance

Short-term and long-term disability

EAP with 24/7 support

Job summary

Blu Omega Inc. is seeking a Senior Data Engineer for a hybrid role based in the Atlanta, GA or Washington, DC area, supporting the CDC's mission to enhance public health through data-driven decisions.

Responsibilities include designing and maintaining scalable ETL/ELT pipelines with Python and SQL, building data warehouses and lakehouse environments on Databricks, and implementing data quality, governance, and Azure-based solutions (Azure Data Factory).

Qualifications

• 8+ years of experience in data engineering or related technical field.
• 6+ years of hands-on experience with Python and SQL, including building scalable ETL/ELT pipelines.
• 2+ years of experience with Azure data services, including Azure Data Factory.
• 1+ years of hands-on experience with Databricks or similar platforms.
• Experience integrating and transforming data from APIs, flat files, relational databases, and other sources.
• Strong understanding of relational and NoSQL databases, data modeling, and schema design.
• Knowledge of data quality, governance, security, and compliance practices.
• Experience troubleshooting and optimizing data pipelines.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Python and SQL.
• Build and optimize data models, data warehouses, and lakehouse environments using Databricks.
• Ingest, clean, validate, and transform large-scale datasets from APIs, relational databases, flat files, and unstructured sources.
• Implement data quality, metadata management, and governance controls to support trusted enterprise analytics.
• Develop and manage cloud-based data solutions within Microsoft Azure, including Azure Data Factory.
• Monitor, troubleshoot, and optimize data pipelines for performance, scalability, and reliability.
• Support automated deployment and operational processes using logging, alerting, and CI/CD practices.
• Partner with data scientists, analysts, engineers, and business stakeholders to translate data requirements into scalable technical solutions.
• Document data architecture, pipeline logic, data models, and operational procedures.

Skills

Python

SQL

Data modeling

Data governance

Security/compliance

Troubleshooting

NoSQL

Education

Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field

Tools

Azure Data Factory

Databricks

Azure Data Services

Job description

Blu Omega Inc. is seeking a Senior Data Engineer for a hybrid role based in the Atlanta, GA or Washington, DC area, supporting the CDC's mission to enhance public health through data-driven decisions.

Responsibilities include designing and maintaining scalable ETL/ELT pipelines with Python and SQL, building data warehouses and lakehouse environments on Databricks, and implementing data quality, governance, and Azure-based solutions (Azure Data Factory).