Azure Data Engineer: Pipelines & Analytics on Snowflake

Datavail; United States; On-site; USD 120,000 - 180,000; Full time

Job summary

Datavail is seeking an Azure Data Engineer with 6+ years of experience to design, build, and optimize enterprise-scale data platforms on Microsoft Azure and Snowflake. You will craft scalable ETL/ELT pipelines, data warehouses, and analytics datasets to enable BI, reporting, and advanced analytics for business users.

You will implement data governance, security, and CI/CD practices, collaborating with analysts and architects to deliver reliable, cost-efficient solutions.

Qualifications

• 6+ years of experience designing, developing, and optimizing enterprise-scale data platforms in Azure and Snowflake.
• Strong expertise building scalable data pipelines, data warehouses, and analytics solutions using ADF, Databricks, Synapse, Snowflake, Python, SQL, and Spark.
• Experience with data modeling, ETL/ELT development, cloud migration, performance tuning, governance, and CI/CD practices.

Responsibilities

• Design, develop, and maintain scalable data engineering solutions on Azure and Snowflake.
• Build and optimize ETL/ELT pipelines to ingest, transform, and load data from diverse sources.
• Develop enterprise data warehouses, marts, and analytics datasets for reporting and BI.
• Implement data transformation and orchestration with PySpark, SQL, Python, and Snowflake procedures.
• Design and manage cloud-based data lakes using ADLS Gen2 and Delta Lake.
• Collaborate with stakeholders to gather requirements and translate them into scalable data solutions.
• Monitor and optimize pipeline performance for reliability, scalability, and cost efficiency.
• Implement data quality frameworks, validation, and monitoring for trusted data.
• Manage Snowflake objects – databases, schemas, warehouses, tasks, and data sharing.
• Develop dimensional and normalized data models following best practices.
• Apply security controls, access management, encryption, and governance across Azure and Snowflake.
• Support cloud migration and modernization from on-premises to Azure/Snowflake.
• Automate deployments with Azure DevOps, Git, and CI/CD pipelines.
• Troubleshoot production issues and provide timely resolution.
• Participate in Agile ceremonies and technical design discussions.
• Create architecture diagrams, runbooks, and knowledge-transfer materials.

Skills

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Snowflake Data Cloud

Python

PySpark

SQL

ADLS Gen2

Delta Lake

Data Warehousing

ETL/ELT Development

CI/CD

Azure DevOps

Git

Performance Tuning

Data Governance

Power BI

Agile/Scrum

Tools

Azure Data Factory

Azure Databricks

Azure Synapse

Snowflake

Python

SQL

Spark

Power BI

ADLS Gen2

Delta Lake

Azure DevOps

Git

Job description

Datavail is seeking an Azure Data Engineer with 6+ years of experience to design, build, and optimize enterprise-scale data platforms on Microsoft Azure and Snowflake. You will craft scalable ETL/ELT pipelines, data warehouses, and analytics datasets to enable BI, reporting, and advanced analytics for business users.

You will implement data governance, security, and CI/CD practices, collaborating with analysts and architects to deliver reliable, cost-efficient solutions.