Senior Azure Data Engineer: ETL & Data Platform Lead

Vergence; Indianapolis (IN); On-site; USD 100,000 - 130,000; Full time

Job summary

Vergence is looking for a Senior Azure Data Engineer to design and operate a next-generation enterprise data platform on Microsoft Azure. Your role will involve building and delivering data pipelines that support analytics and operational dashboards.

The ideal candidate should possess deep expertise in Azure Data Factory, Data Bricks, and PySpark, alongside a solid understanding of Azure-based data solutions and methodologies.

Qualifications

• Deep hands-on expertise with Azure Data Factory and its components.
• Strong experience in Data Bricks and PySpark for data processing.
• Production knowledge of Azure Synapse and Azure Databricks.

Responsibilities

• Design and build ingestion and transformation pipelines.
• Implement CI/CD for data pipelines using Azure DevOps.
• Conduct legacy-to-cloud migrations and assess workloads.

Skills

Azure Data Factory

Data Bricks

PySpark

SQL optimization

Python for data engineering

T-SQL

Tools

Azure DevOps

Azure Synapse Analytics

Azure Data Lake Storage Gen2

Job description

Vergence is looking for a Senior Azure Data Engineer to design and operate a next-generation enterprise data platform on Microsoft Azure. Your role will involve building and delivering data pipelines that support analytics and operational dashboards.

The ideal candidate should possess deep expertise in Azure Data Factory, Data Bricks, and PySpark, alongside a solid understanding of Azure-based data solutions and methodologies.