Azure Data Operations Lead – Databricks & ADF

IPolarity; Philadelphia (Philadelphia County); Hybrid; USD 120,000 - 180,000; Full time

Job summary

IPolarity in Philadelphia, PA is seeking an Azure Data Operations Lead to own onshore data operations on the Azure data platform, with a primary focus on Databricks and ADF. The role emphasizes security, compliance, and incident escalation to ensure reliable pipelines.

You will lead the onshore data operations, diagnose Databricks job failures, coordinate changes, and drive continuous improvement in data availability and performance. 8-10+ years of experience in data operations is required.

Qualifications

• 8-10+ years of experience in data operations with strong focus on Azure Databricks.

Responsibilities

• Lead onshore data operations (Azure data platform), accountable for security, and compliance, and serving as the escalation owner for P1/P2 incidents and change coordination.
• Understand the Databricks job failures/pipeline failures etc.

Skills

Azure Databricks

Job description

Job Title: Azure Data Operations Lead - Databricks & ADF

Work Location & Reporting Address: Philadelphia, PA 19113 (Onsite-Hybrd. Local candidates are highly preferred but will also consider candidates willing to relocate immediately and as long as they are able to join by Day 1)

Must Have Skills:

• 8-10+ years of experience in data operations with strong focus on Azure Databricks.

Nice to Have Skills:

Detailed Job Description:

• Lead onshore data operations (Azure data platform), accountable for, security, and compliance, and serving as the escalation owner for P1/P2 incidents and change coordination
• Understand the Databricks job failures/pipeline failures etc.

Minimum Years of Experience:

Certifications Needed:

Top 3 responsibilities you would expect the Subcon to shoulder and execute:

Interview Process (Is face to face required?)