Support Engagement Lead – Data Platform (Azure & Databricks)

Anblicks; Coppell (TX); On-site; USD 150,000 - 210,000; Full time

Job summary

Anblicks is seeking a Data Engineering Lead to manage and enhance a Data Platform built on Azure-ADF and Databricks. You will lead hands-on efforts to stabilize, optimize, and mature platform operations through structured processes and automation.

The role emphasizes incident management, proactive monitoring, and governance, with a focus on delivering reliable, scalable data services and clear communication with stakeholders.

Qualifications

• 8+ years in data engineering with Azure ADF and Databricks.
• Strong incident management, performance tuning, and data governance.
• Hands-on experience with SQL, Python, Spark, and CI/CD pipelines.
• Familiarity with monitoring tools (Azure Monitor etc.) and automation frameworks.
• Excellent communication and stakeholder management skills.

Responsibilities

• Incident & Communication Management – ensure quick resolution, RCA, and transparent updates.
• Proactive Monitoring & Optimization – improve performance, cost, and reliability.
• Data Quality & Governance – enforce data integrity, lineage, and compliance.
• Change & Release Management – streamline deployments and minimize disruptions.
• Reporting & Continuous Improvement – track KPIs and resolve recurring issues.
• Knowledge Management – maintain documentation, SOPs, and training for operations.
• Automation & Monitoring – implement self-healing mechanisms and reduce manual overhead.

Skills

Data engineering

Platform support

Incident management

Performance tuning

Data governance

SQL

Python

Spark

CI/CD pipelines

Stakeholder management

Tools

Azure Data Factory (ADF)

Databricks

Azure Monitor

Monitoring tools

Job description

We are seeking a strong Data Engineering Lead with support engagement experience to manage and enhance a Data Platform built on Azure-ADF and Databricks. This role requires a hands-on leader who can stabilize, optimize, and mature platform operations through structured processes and automation.

Key Responsibilities:

Incident & Communication Management – Ensure quick resolution, RCA, and transparent stakeholder updates.

Proactive Monitoring & Optimization – Improve performance, cost, and reliability.

Data Quality & Governance – Enforce data integrity, lineage, and compliance.

Change & Release Management – Streamline deployments and minimize disruptions.

Reporting & Continuous Improvement – Track KPIs, resolve recurring issues, and drive efficiency.

Knowledge Management – Maintain documentation, SOPs, and training for seamless operations.

Automation & Monitoring – Implement self-healing mechanisms and reduce manual overhead.

Qualifications:

8+ years in data engineering & platform support, with expertise in Azure (ADF) & Databricks.

Strong knowledge of incident management, performance tuning, and data governance.

Hands-on experience with SQL, Python, Spark, and CI/CD pipelines.

Familiarity with monitoring tools (Azure Monitor etc.) and automation frameworks.

Excellent communication and stakeholder management skills.