Azure Databricks Data Platform Lead

Buchanan Ingersoll-Rooney

Pittsburgh (Allegheny County)

Hybrid

USD 150,000 - 210,000

Full time

4 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Hybrid Schedule

401K Program

Retirement Savings Program

Generous Paid Time Off

Paid Holidays with floating day

WorkWell wellness program

Gym access

Bright Horizons caregiving assistance

Emergency assistance fund

LinkedIn Learning access

Job summary

Buchanan Ingersoll & Rooney PC seeks a Data Platform Manager in Pittsburgh, PA to design, build, and optimize scalable data platforms on Azure Databricks. You will lead data engineers, collaborate with data scientists, and drive high‑performance data pipelines across the enterprise.

Requirements include 5–7+ years in data engineering/architecture, Azure Databricks expertise, and leadership experience. Hybrid schedule; generous benefits and continued learning opportunities are offered.

Qualifications

5-7+ years hands-on data engineering or architecture experience.
2-4 years leading a team of data engineers/scientists/analysts is preferred.
Bachelor's degree in CS, Eng, or related field.
Certifications in Azure/Data/Databricks are preferred.
Relational and NoSQL database experience; data modeling and schema design.

Responsibilities

Lead and mentor a team of data engineers; conduct code reviews and enforce standards.
Collaborate with stakeholders to translate requirements into technical specs.
Design, develop, and deploy scalable data pipelines using Azure Databricks; ensure data quality and lineage.
Optimize pipelines for performance, cost, and scalability in Azure.
Define end-to-end lakehouse architecture using Delta Lake with Bronze/Silver/Gold layers.
Implement Unity Catalog governance and RBAC; ensure data security and privacy.
Oversee batch and streaming ETL/ELT pipelines with PySpark/Scala/SQL.
Integrate real-time/batch data sources using Apache Kafka and ADF.
Support ML model deployment with data engineering support.