Lead Azure Data Engineer

Info Resume Edge; Phoenix (AZ); Remote; USD 90,000 - 120,000; Full time

Job summary

A leading data solutions provider is looking for a Data Engineer to participate in the migration and modernization of Azure data systems to the Databricks Lakehouse Platform. Responsibilities include developing and optimizing ETL/ELT pipelines, collaborating with cross-functional teams, and ensuring solutions meet security and data quality standards. Ideal candidates will possess a Bachelor's degree in a relevant field and have hands-on experience with cloud-based data engineering, particularly within Azure ecosystems.

Qualifications

• Proven experience with cloud-based data engineering solutions, preferably Azure.
• Experience supporting cloud migration or modernization initiatives is a plus.
• Strong understanding of distributed data processing.

Responsibilities

• Participate in the migration of Azure data and analytics systems to Databricks.
• Design, develop, and maintain ETL/ELT pipelines using Azure tools.
• Optimize ingestion and transformation processes for reliability and cost efficiency.

Skills

SQL / T-SQL

Cloud-based data engineering

ETL/ELT concepts

Data modeling

Analytical problem solving

Excellent communication

Education

Bachelor's degree in Computer Science, Data Engineering, Information Technology, or related field

Job description

Participate in the modernization and migration of current Azure data and analytics systems to the Databricks Lakehouse Platform.

Support Databricks platform enablement, configuration, and deployment activities.

Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory, Azure Functions, and Databricks.

Build scalable data integration solutions across Azure Data Lake, Azure SQL Database, Azure Storage (Blob/File), and Databricks.

Assist in optimizing ingestion and transformation processes for performance, reliability, and cost efficiency.

Migrate legacy data pipelines, workflows, and processing logic into Databricks notebooks or Delta pipelines.

Work with cross-functional teams to understand business requirements and translate them into technical solutions.

Ensure all solutions comply with Marsh MMA standards for security, governance, and data quality.

Perform data validation, unit testing, troubleshooting, and system performance tuning.

Document architecture, workflows, design decisions, and operational procedures.

Required Technical Skills

Strong hands-on experience with:

SQL / T-SQL

Qualifications

Bachelors degree in Computer Science, Data Engineering, Information Technology, or related field.

Proven experience working with cloud-based data engineering solutions, preferably in Azure ecosystems.

Experience supporting cloud migration or modernization initiatives is a plus.

Strong understanding of ETL/ELT concepts, data modeling, and distributed data processing.

Soft Skills

Strong analytical and problem-solving mindset.

Excellent communication and documentation abilities.

Ability to collaborate with cross-functional teams across technical and business domains.

Detail-oriented with a focus on quality and compliance.