Remote Senior Data Engineer: Azure Data Lake & ML Pipelines

Info Gain Consulting; Virginia (MN); Remote; USD 120,000 - 180,000; Full time

Job summary

Info Gain Consulting is seeking a Senior Data Engineer to build and maintain an Azure-based data architecture powering fraud analytics for a federal OIG. Design secure, scalable pipelines moving data to a modern cloud environment and enabling audits, investigations, and ML workloads.

Telework with occasional on-site collaboration; Git, CI/CD, and modular design are core to the team. You will migrate data to ADLS, develop ELT/ETL pipelines in Azure Synapse and Azure ML, and partner with data

Qualifications

• 5 years of hands-on experience maintaining SQL databases and ETL in cloud data analytics environments.
• 3 years of hands-on experience with Azure Synapse and Azure Machine Learning, modern data stack, DP-203 or equivalent preferred.
• Proficient in Python (Pandas); PySpark/Polars preferred; modular, reusable code design.

Responsibilities

• Design, implement, and maintain secure, scalable data architecture with source control.
• Migrate data to ADLS and build ETL/ELT pipelines in Azure Synapse and Azure ML.
• Review and improve pipelines; periodic audits to address bottlenecks and architecture drift.
• Establish quality controls, error handling, logging, and validation across pipelines.
• Produce data dictionaries, ER diagrams, and pipeline process maps.

Skills

SQL/T-SQL

ELT/ETL design

Azure Synapse

Azure Machine Learning

Python (Pandas)

Tools

Azure Data Lake Storage (ADLS)

PySpark/Polars

CI/CD tooling

Job description

Info Gain Consulting is seeking a Senior Data Engineer to build and maintain an Azure-based data architecture powering fraud analytics for a federal OIG. Design secure, scalable pipelines moving data to a modern cloud environment and enabling audits, investigations, and ML workloads.

Telework with occasional on-site collaboration; Git, CI/CD, and modular design are core to the team. You will migrate data to ADLS, develop ELT/ETL pipelines in Azure Synapse and Azure ML, and partner with data