Lead Data Engineer - Azure Databricks & Data Modernization

Globenet Consulting Corp; Bellevue (WA); On-site; USD 140,000 - 180,000; Full time

Benefits offered by this job

Competitive salary

Opportunity for advancement

Training & development

Job summary

The AES Group is seeking an experienced Lead Data Engineer to design, develop, and optimize scalable cloud data platforms for enterprise clients. You will establish engineering standards and mentor a team of data engineers.

The ideal candidate has hands-on Azure Databricks, Python, PySpark, SQL, ETL/ELT development, and modern data warehouse architecture experience, with a focus on governance and security practices.

Qualifications

• Bachelor's degree or equivalent experience in CS/IT.
• At least 3 years hands-on Azure Databricks experience.
• At least 5 years in data warehouse analysis, architecture and design.
• 5+ years ETL/ELT with Python/PySpark/SQL.
• Experience with Terraform, Git, CI/CD pipelines, and Azure DevOps.
• Experience leading/mentoring data engineering teams.

Responsibilities

• Design and optimize scalable data pipelines and ETL/ELT workflows using Azure Databricks, PySpark, SQL, and Delta Lake.
• Provide technical leadership and mentoring to data engineers.
• Improve CI/CD pipelines and deployment processes with Azure DevOps, Git, and Terraform.
• Establish development, testing, and release standards.
• Ensure data accuracy through integration, transformation, validation, and cleansing.

Skills

Azure Databricks

Data warehouse

ETL/ELT

Python

PySpark

SQL

CI/CD

Git

Terraform

Azure DevOps

Leadership

Stakeholder management

Education

Bachelor's degree in CS/IS/IT or equivalent

Tools

Terraform

Git

Azure DevOps

Job description

The AES Group is seeking an experienced Lead Data Engineer to design, develop, and optimize scalable cloud data platforms for enterprise clients. You will establish engineering standards and mentor a team of data engineers.

The ideal candidate has hands-on Azure Databricks, Python, PySpark, SQL, ETL/ELT development, and modern data warehouse architecture experience, with a focus on governance and security practices.