Senior Data Engineer - Remote, Azure & AI Tools

Node.Digital; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Medical

Dental

Vision

Life Insurance

HSA

401K matching

PTO/Sick

Holidays

Online Training

Job summary

Node.Digital is seeking a Senior Data Engineer in Herndon, VA with remote work options. You will design, build, and maintain scalable data architectures and pipelines using Azure Synapse, Azure ML, and Parquet formats to support SBA OIG investigations and audits.

You will ensure data quality, implement source control, and collaborate on analytics tooling, while staying current with emerging AI-assisted data engineering capabilities and industry best practices.

Qualifications

• Bachelor’s degree in data engineering, CS, data science, ML, math or related field; or 5 years of applied work experience.
• 5 years maintaining SQL databases and advanced operations in SQL/T-SQL.
• 3 years working with Azure Synapse and Azure ML in modern data stack.
• 3 years manipulating data in Python; Pandas required; PySpark/Polars preferred.

Responsibilities

• Provide authoritative expertise on data engineering methods and pipeline design.
• Design, implement, and maintain data architecture and assets under source control.
• Develop ELT and ETL pipelines in Azure Synapse and Azure ML (SDK v1 & v2).
• Migrate source data into Azure Data Lake Storage.
• Normalize entity attributes (addresses, phones, etc.).
• Review and improve architecture, addressing bottlenecks and drift.
• Establish quality controls, error handling, logging, and validation across pipelines.
• Incorporate source control across pipelines and analytics codebases.
• Optimize ingestion, processing, and storage across diverse datasets.
• Develop self-service analytics for SBA OIG analysts.
• Author SOPs for data pipelines and Azure deployments.
• Produce data architecture documentation and data dictionaries.
• Expand environment with new datasets/services per intake/testing process.
• Stay current with AI tooling relevant to data engineering.

Skills

SQL

Python

Pandas

PySpark

Polars

Data modeling

ETL/ELT pipelines

Azure data services

Source control

CI/CD

Education

Bachelor’s degree in data engineering, CS, data science, ML, math

5 years of relevant work experience

Tools

Azure Synapse

Azure Machine Learning

Azure Data Lake Storage

Parquet

Git

Terraform

Bicep

Python SDK

CLI

REST APIs

Job description

Node.Digital is seeking a Senior Data Engineer in Herndon, VA with remote work options. You will design, build, and maintain scalable data architectures and pipelines using Azure Synapse, Azure ML, and Parquet formats to support SBA OIG investigations and audits.

You will ensure data quality, implement source control, and collaborate on analytics tooling, while staying current with emerging AI-assisted data engineering capabilities and industry best practices.