Lead Azure Databricks Data Engineering & Real-Time Pipelines

5 Star Recruitment; Seattle (WA); On-site; USD 130,000 - 170,000; Full time

Job summary

A recruitment agency is seeking an experienced Azure Databricks Data Engineering Lead in Seattle, WA. The ideal candidate will have over 7 years of expertise in Databricks, Microsoft Azure, PySpark, and Python. Responsibilities include leading projects, building automation frameworks, and collaborating with cross-functional teams to optimize data management and governance. This role involves direct interaction with stakeholders to enhance data capabilities and drive business performance metrics. Excellent leadership and technical skills are required for this position.

Qualifications

• 7+ years of experience in Databricks, Microsoft Azure, PySpark and Python.
• Ability to lead large-scale, complex projects.
• Experience in building automation and monitoring frameworks.

Responsibilities

• Lead cross-functional projects to build technical roadmaps.
• Build infrastructure for optimal data extraction, transformation, and loading.
• Collaborate with business partners to identify opportunities.

Skills

Databricks

Microsoft Azure

PySpark

Python

Data pipeline management

Project leadership

Job description

A recruitment agency is seeking an experienced Azure Databricks Data Engineering Lead in Seattle, WA. The ideal candidate will have over 7 years of expertise in Databricks, Microsoft Azure, PySpark, and Python. Responsibilities include leading projects, building automation frameworks, and collaborating with cross-functional teams to optimize data management and governance. This role involves direct interaction with stakeholders to enhance data capabilities and drive business performance metrics. Excellent leadership and technical skills are required for this position.