Senior Azure Data Engineer: Pipelines, ML & Analytics

Immersion Consulting, LLC; United States; On-site; USD 120,000 - 180,000; Full time

Job summary

Immersion Consulting, LLC seeks a Senior Data Engineer to design and operate a cloud-based data architecture on Azure, supporting audits, investigations, and fraud analytics.

You will build scalable ELT/ETL pipelines, maintain data models and dictionaries, and enable self-service access for analysts and investigators, while collaborating with data scientists to advance ML initiatives and AI-driven insights.

Qualifications

• Bachelor's degree or 5+ years of applied experience.
• 5+ years maintaining SQL databases and advanced SQL/T-SQL.
• 5+ years designing and maintaining cloud ELT/ETL solutions.
• 3+ years with Azure Synapse Analytics and Azure Machine Learning.
• 3+ years developing data solutions with Python and Pandas.
• Experience with cloud-native analytics architectures.
• Strong data architecture, pipeline optimization, and operational support.

Responsibilities

• Design, implement, and maintain scalable Azure-based data architecture supporting audits and fraud analytics.
• Develop, optimize, and sustain ELT/ETL pipelines in Azure Synapse Analytics and Azure ML.
• Migrate and integrate large-scale datasets into Azure Data Lake Storage.
• Establish source control, version management, and development standards across data assets.
• Implement pipeline monitoring, validation, logging, and error-handling frameworks.
• Design and maintain data models, data dictionaries, ER diagrams, and architectural documentation.
• Optimize ingestion, transformation, storage, and retrieval across diverse data sources and formats.
• Develop self-service data access capabilities for analysts and investigators.
• Collaborate with Data Scientists to support ML initiatives.
• Author and maintain SOPs governing data pipeline development, deployment, and monitoring.
• Evaluate emerging AI-enabled engineering tools and automation capabilities.
• Recommend and implement architectural improvements for efficiency, reliability, security, and cost.

Skills

SQL

Cloud ELT/ETL

Azure

Data architecture

ETL pipelines

Python

Pandas

Data modeling

Education

Bachelor's degree or 5+ years experience in related field

Tools

Azure Synapse Analytics

Azure Data Lake Storage

Azure Machine Learning

Git/Source Control

Job description

Immersion Consulting, LLC seeks a Senior Data Engineer to design and operate a cloud-based data architecture on Azure, supporting audits, investigations, and fraud analytics.

You will build scalable ELT/ETL pipelines, maintain data models and dictionaries, and enable self-service access for analysts and investigators, while collaborating with data scientists to advance ML initiatives and AI-driven insights.