Technical Lead - Production Support (Databricks & ADF)

Anblicks Inc.; Dallas, Northern (TX, KY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Anblicks Inc. in Dallas seeks a strong Data Engineering Lead to oversee production support for a Databricks/Azure data platform. This hands-on leader will stabilize operations and drive automation.

Responsibilities include incident management, proactive performance tuning, data governance, and streamlined change/release processes. You will mentor teams and push continuous improvement through KPIs and documentation.

Qualifications

• 8+ years of data engineering & platform support experience.
• Expertise in Azure & Databricks.
• Hands-on with SQL, Python, Spark, and CI/CD pipelines.
• Familiarity with monitoring tools and automation frameworks.

Responsibilities

• Incident & Communication Management – Ensure quick resolution, RCA, and transparent stakeholder updates.
• Proactive Monitoring & Optimization – Improve performance, cost, and reliability.
• Data Quality & Governance – Enforce data integrity, lineage, and compliance.
• Change & Release Management – Streamline deployments and minimize disruptions.
• Reporting & Continuous Improvement – Track KPIs, resolve recurring issues, and drive efficiency.
• Knowledge Management – Maintain documentation, SOPs, and training for seamless operations.
• Automation & Monitoring – Implement self-healing mechanisms and reduce manual overhead.

Skills

Azure

Databricks

SQL

Python

CI/CD

Data Governance

Incident Management

Monitoring

Tools

Azure Monitor

Job description

Technical Lead - Production Support (Databricks & ADF)

10 years

Full-Time

Role Overview:

We are seeking a strong Data Engineering Lead with support engagement experience to manage and enhance a Data Platform built on Azure and Databricks. This role requires a hands-on leader who can stabilize, optimize, and mature platform operations through structured processes and automation.

Key Responsibilities:

• Incident & Communication Management – Ensure quick resolution, RCA, and transparent stakeholder updates.
• Proactive Monitoring & Optimization – Improve performance, cost, and reliability.
• Data Quality & Governance – Enforce data integrity, lineage, and compliance.
• Change & Release Management – Streamline deployments and minimize disruptions.
• Reporting & Continuous Improvement – Track KPIs, resolve recurring issues, and drive efficiency.
• Knowledge Management – Maintain documentation, SOPs, and training for seamless operations.
• Automation & Monitoring – Implement self-healing mechanisms and reduce manual overhead.

Qualifications:

• 8+ years in data engineering & platform support, with expertise in Azure & Databricks.
• Strong knowledge of incident management, performance tuning, and data governance.
• Hands-on experience with SQL, Python, Spark, and CI/CD pipelines.
• Familiarity with monitoring tools (Azure Monitor etc.) and automation frameworks.
• Excellent communication and stakeholder management skills.