Data Engineer / Azure Databricks Engineer - Senior

Nationwide IT Services

Maryland

Hybrid

USD 150,000 - 188,000

Full time

4 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

medical insurance

dental insurance

vision insurance

life and disability insurance

401(k) plan with employer match

paid holidays

PTO (sick/vacation)

commuter benefits

employee assistance program (EAP)

educational reimbursement

pet insurance

Job summary

Nationwide IT Services, NIS, is seeking a Senior Data Engineer / Azure Databricks Engineer to design, build, deploy, and optimize enterprise data pipelines and repository workloads in Azure Databricks. This role supports moving and transforming ANG data while strengthening data quality, observability, and repeatable delivery practices.

The Senior Data Engineer will work on CI/CD automation, data-quality checks, and performance tuning to ensure reliable, scalable data services for DoD/ANG

Qualifications

8+ years of professional data engineering experience.
Bachelor's degree in a related field required.
Advanced SQL, Python, and Azure Databricks skills.
Experience with ETL/ELT orchestration, APIs, data-quality controls, monitoring, troubleshooting, and performance tuning.
Ability to document complex data flows, mappings, dependencies, and procedures.
DoD/DAF security and access-training requirements must be satisfied.

Responsibilities

Design, develop, test, deploy, maintain, and optimize scalable ETL/ELT pipelines and Databricks workloads.
Develop SQL and Python transformations, notebooks, jobs, and orchestration routines for scheduled and event-driven processing.
Implement automated data-quality checks, reconciliation controls, exception handling, quarantine processes, and recovery procedures.
Create and maintain source-to-target mappings, data lineage, technical documentation, operating procedures, and runbooks.
Integrate APIs, files, databases, and cloud data services across DoD platforms with CI/CD automation.
Tune pipeline and repository performance to meet availability, data currency, and response-time objectives.

Skills

8+ years experience

SQL

Python

Azure Databricks

Azure data engineering services

ETL/ELT orchestration

Git & CI/CD

Data quality controls

Documentation of data flows

Education

Bachelor's degree in computer science, data engineering, information systems, engineering, or related field

Tools

Azure Databricks

Azure data services

Git

CI/CD

Job description

Senior Data Engineer / Azure Databricks Engineer

Location

Joint Base Andrews, MD / Hybrid as authorized

Security Clearance Requirement

SECRET clearance

Position Summary

Nationwide IT Services, NIS, is seeking a Senior Data Engineer / Azure Databricks Engineer to support Air National Guard Chief Data and Artificial Intelligence Office (ANG CDAO) Support Services. The Senior Data Engineer will design, build, deploy, and optimize enterprise data pipelines and repository workloads in Azure Databricks. This role supports moving and transforming CDAO mission data while strengthening data quality, observability, performance, and repeatable delivery practices.

Key Responsibilities

Design, develop, test, deploy, maintain, and optimize scalable ETL/ELT pipelines and Databricks workloads.
Develop SQL and Python transformations, notebooks, jobs, and orchestration routines for scheduled and event-driven processing.
Implement automated data-quality checks, reconciliation controls, exception handling, quarantine processes, and recovery procedures.
Create and maintain source-to-target mappings, data lineage, technical documentation, operating procedures, and runbooks.
Integrate APIs, files, databases, and cloud data services across DAF, ANG, DoD, and CDAO platforms.
Implement Git-based version control, CI/CD automation, testing, monitoring, alerting, and controlled releases.
Tune pipeline and repository performance to support availability, execution-success, data-currency, and response-time objectives.

Required Qualifications

8+ years of relevant professional experience.
Bachelor’s degree in computer science, Data Engineering, Information Systems, Engineering, or a related field.
Advanced hands-on proficiency with SQL, Python, Azure Databricks, and Azure data engineering services.
Experience with ETL/ELT orchestration, APIs, data-quality controls, monitoring, troubleshooting, and performance tuning.
Experience using Git and CI/CD practices to test and promote data-engineering code.
Ability to document complex data flows, mappings, dependencies, and operating procedures.
Must satisfy applicable DoD/DAF security, cybersecurity-awareness, CUI, OPSEC, and access-training requirements.

Preferred Qualifications

Microsoft Azure or Databricks certification.
Experience integrating DoD or DAF source systems.
Familiarity with defense HR, financial, logistics, readiness, or maintenance data.

Why Join Nationwide IT Services?

Nationwide IT Services is a trusted government contractor supporting Department of Defense customers. This role supports the Air National Guard Chief Data and Artificial Intelligence Office (CDAO), helping sustain and advance enterprise data, business intelligence, application, and AI capabilities that enable faster, data-driven mission decisions.

Benefits