Data Platform Ops Lead — Azure & Databricks

Anblicks; Coppell (TX); On-site; USD 150,000 - 210,000; Full time

Job summary

Anblicks is seeking a Data Engineering Lead to manage and enhance a Data Platform built on Azure-ADF and Databricks. You will lead hands-on efforts to stabilize, optimize, and mature platform operations through structured processes and automation.

The role emphasizes incident management, proactive monitoring, and governance, with a focus on delivering reliable, scalable data services and clear communication with stakeholders.

Qualifications

• 8+ years in data engineering with Azure ADF and Databricks.
• Strong incident management, performance tuning, and data governance.
• Hands-on experience with SQL, Python, Spark, and CI/CD pipelines.
• Familiarity with monitoring tools (Azure Monitor etc.) and automation frameworks.
• Excellent communication and stakeholder management skills.

Responsibilities

• Incident & Communication Management – ensure quick resolution, RCA, and transparent updates.
• Proactive Monitoring & Optimization – improve performance, cost, and reliability.
• Data Quality & Governance – enforce data integrity, lineage, and compliance.
• Change & Release Management – streamline deployments and minimize disruptions.
• Reporting & Continuous Improvement – track KPIs and resolve recurring issues.
• Knowledge Management – maintain documentation, SOPs, and training for operations.
• Automation & Monitoring – implement self-healing mechanisms and reduce manual overhead.

Skills

Data engineering

Platform support

Incident management

Performance tuning

Data governance

SQL

Python

Spark

CI/CD pipelines

Stakeholder management

Tools

Azure Data Factory (ADF)

Databricks

Azure Monitor

Monitoring tools

Job description

Anblicks is seeking a Data Engineering Lead to manage and enhance a Data Platform built on Azure-ADF and Databricks. You will lead hands-on efforts to stabilize, optimize, and mature platform operations through structured processes and automation.

The role emphasizes incident management, proactive monitoring, and governance, with a focus on delivering reliable, scalable data services and clear communication with stakeholders.