Senior Data Engineer - Azure Databricks | SECRET Clearance

Nationwide IT Services; Maryland; Hybrid; USD 150,000 - 188,000; Full time

Benefits offered by this job

medical insurance

dental insurance

vision insurance

life and disability insurance

401(k) plan with employer match

paid holidays

PTO (sick/vacation)

commuter benefits

employee assistance program (EAP)

educational reimbursement

pet insurance

Job summary

Nationwide IT Services, NIS, is seeking a Senior Data Engineer / Azure Databricks Engineer to design, build, deploy, and optimize enterprise data pipelines and repository workloads in Azure Databricks. This role supports moving and transforming ANG data while strengthening data quality, observability, and repeatable delivery practices.

The Senior Data Engineer will work on CI/CD automation, data-quality checks, and performance tuning to ensure reliable, scalable data services for DoD/ANG

Qualifications

• 8+ years of professional data engineering experience.
• Bachelor's degree in a related field required.
• Advanced SQL, Python, and Azure Databricks skills.
• Experience with ETL/ELT orchestration, APIs, data-quality controls, monitoring, troubleshooting, and performance tuning.
• Ability to document complex data flows, mappings, dependencies, and procedures.
• DoD/DAF security and access-training requirements must be satisfied.

Responsibilities

• Design, develop, test, deploy, maintain, and optimize scalable ETL/ELT pipelines and Databricks workloads.
• Develop SQL and Python transformations, notebooks, jobs, and orchestration routines for scheduled and event-driven processing.
• Implement automated data-quality checks, reconciliation controls, exception handling, quarantine processes, and recovery procedures.
• Create and maintain source-to-target mappings, data lineage, technical documentation, operating procedures, and runbooks.
• Integrate APIs, files, databases, and cloud data services across DoD platforms with CI/CD automation.
• Tune pipeline and repository performance to meet availability, data currency, and response-time objectives.

Skills

8+ years experience

SQL

Python

Azure Databricks

Azure data engineering services

ETL/ELT orchestration

Git & CI/CD

Data quality controls

Documentation of data flows

Education

Bachelor's degree in computer science, data engineering, information systems, engineering, or related field

Tools

Azure Databricks

Azure data services

Git

CI/CD

Job description

Nationwide IT Services, NIS, is seeking a Senior Data Engineer / Azure Databricks Engineer to design, build, deploy, and optimize enterprise data pipelines and repository workloads in Azure Databricks. This role supports moving and transforming ANG data while strengthening data quality, observability, and repeatable delivery practices.

The Senior Data Engineer will work on CI/CD automation, data-quality checks, and performance tuning to ensure reliable, scalable data services for DoD/ANG