Senior Azure Data Engineer: Cloud Data Platform Specialist

Datavail; Northern (KY); Hybrid; USD 120,000 - 160,000; Full time

Job summary

Datavail is seeking an Azure Data Engineer with 6+ years of experience to design, develop, and optimize enterprise-scale data platforms on Microsoft Azure and Snowflake. You will build scalable ETL/ELT pipelines using ADF, Databricks, and Snowflake to ingest, transform, and load data from various sources.

You will develop data warehouses and analytical datasets supporting reporting, BI, and analytics initiatives while implementing data governance and CI/CD practices.

Qualifications

• Strong experience designing enterprise-scale data platforms on Azure and Snowflake.
• Proficiency with ADF, Databricks, Synapse, Snowflake, Python and SQL.
• Experience in data modeling, ETL/ELT development, governance, and CI/CD.

Responsibilities

• Design, develop, and maintain scalable data solutions on Azure and Snowflake.
• Build and优化 ETL/ELT pipelines to ingest, transform, and load data from multiple sources.
• Develop enterprise data warehouses and analytical datasets for reporting and BI.
• Implement data quality, governance, and security controls.
• Collaborate with stakeholders, analysts, and architects to translate requirements.
• Automate deployments using Azure DevOps, Git, and CI/CD pipelines.
• Monitor performance and optimize pipelines for reliability and cost efficiency.
• Participate in Agile ceremonies and produce technical documentation.

Skills

Data modeling

ETL/ELT development

CI/CD practices

Agile & Scrum

Data governance & security

Collaboration with stakeholders

Tools

Azure Data Factory (ADF)

Azure Databricks

Azure Synapse Analytics

Snowflake Data Cloud

Python

PySpark

SQL

Azure Data Lake Storage (ADLS Gen2)

Azure Functions

Delta Lake

Power BI Integration

Azure DevOps

Git

Job description

Datavail is seeking an Azure Data Engineer with 6+ years of experience to design, develop, and optimize enterprise-scale data platforms on Microsoft Azure and Snowflake. You will build scalable ETL/ELT pipelines using ADF, Databricks, and Snowflake to ingest, transform, and load data from various sources.

You will develop data warehouses and analytical datasets supporting reporting, BI, and analytics initiatives while implementing data governance and CI/CD practices.