Senior Data Engineer - Remote (Azure Data Platform)

Node.Digital LLC; Washington (District of Columbia); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Medical

Dental

Vision

Basic Life Insurance

Health Saving Account

401K matching

Three weeks PTO/Sick

11 Paid Holidays

Online Training

Job summary

Node.Digital LLC offers a data engineering role focused on building and maintaining scalable data pipelines and architectures in Azure, supporting SBA OIG investigations and audits. The ideal candidate will optimize ELT/ETL processes, ensure data quality, and enable self-service analytics for analysts.

Responsibilities include migrating data to Azure Data Lake, normalizing attributes, and enforcing source control across pipelines, with a strong emphasis on code-first development and modern

Qualifications

• 5 years maintaining SQL databases and conducting advanced operations in SQL and T-SQL.
• 5 years designing, implementing, and maintaining ELT and ETL processes in cloud-based data analytics environments.
• 3 years working in Azure Synapse and Azure Machine Learning with the modern data stack; certifications preferred (DP-203 or equivalent).
• 3 years manipulating data in Python; Pandas required; PySpark and Polars preferred; reusable modular code preferred.

Responsibilities

• Provide authoritative expertise on data engineering methods and best practices, including code-first development approaches and modern pipeline design patterns.
• Design, implement, and maintain data architecture that supports products and end users, with assets under source control.
• Design, implement, and maintain ELT and ETL pipelines for Azure Synapse and Azure ML using SDK v1 and SDK v2.
• Migrate source data identified by SBA OIG into Azure Data Lake Storage.
• Normalize entity attributes such as addresses and phone numbers.
• Review and improve architecture and pipelines; address bottlenecks and architecture drift.
• Establish quality controls, logging, and validation checks across pipelines.
• Incorporate source control across pipelines and analytics codebases.

Skills

SQL

Python

Data modeling

ETL/ELT

Education

Bachelor's degree in data engineering, computer science, data science, or related field

Tools

Azure Synapse

Azure Machine Learning

PySpark

Polars

Pandas

Job description

Node.Digital LLC offers a data engineering role focused on building and maintaining scalable data pipelines and architectures in Azure, supporting SBA OIG investigations and audits. The ideal candidate will optimize ELT/ETL processes, ensure data quality, and enable self-service analytics for analysts.

Responsibilities include migrating data to Azure Data Lake, normalizing attributes, and enforcing source control across pipelines, with a strong emphasis on code-first development and modern