Senior Data Engineer — Remote, Azure Pipelines & DataOps

Node.Digital; Washington (District of Columbia); Remote; USD 120,000 - 160,000; Full time

Benefits offered by this job

Medical

Dental

Vision

Life Insurance

HSA

401K matching

PTO/Sick leave

Holidays

Job summary

Node.Digital is hiring a Senior Data Engineer to design and maintain scalable data pipelines in Azure, including ELT/ETL processes and data architectures under source control.

The role requires a Public Trust clearance and focuses on migrating data to Azure Data Lake, normalizing attributes, and enabling self-service analytics for investigations and audits. You will document architectures and stay current with AI tooling relevant to data engineering.

Qualifications

• Bachelor's degree in data engineering, CS, data science, ML, math or related field, or 5 years of equivalent experience.
• 5 years maintaining SQL databases and advanced SQL/T-SQL operations.
• 5 years designing and maintaining ELT/ETL processes in cloud analytics environments.
• 3 years working with Azure Synapse and Azure Machine Learning; DP-203 or equivalent preferred.
• 3 years manipulating data in Python; Pandas required; PySpark/Polars preferred.

Responsibilities

• Provide authoritative expertise on data engineering methods and best practices.
• Design, implement, and maintain data architectures and assets under source control.
• Build and optimize ELT/ETL pipelines in Azure data services.
• Migrate data into Azure Data Lake Storage and normalize entities.
• Establish quality controls, logging, validation, and error handling across pipelines.
• Develop self-service analytics capabilities for SBA OIG analysts.
• Document data architecture, dictionaries and process maps.
• Stay updated on AI tooling for data engineering and automation.

Skills

SQL

Python

Pandas

PySpark

Polars

Azure Synapse

Azure Machine Learning

ELT/ETL design

Data architecture

Source control

Education

Bachelor's degree in data engineering/CS/data science

5 years in SQL

3 years in Azure Synapse/AML

Tools

Python

Azure Synapse

Azure Machine Learning

Job description

Node.Digital is hiring a Senior Data Engineer to design and maintain scalable data pipelines in Azure, including ELT/ETL processes and data architectures under source control.

The role requires a Public Trust clearance and focuses on migrating data to Azure Data Lake, normalizing attributes, and enabling self-service analytics for investigations and audits. You will document architectures and stay current with AI tooling relevant to data engineering.