Senior Azure Databricks Architect — Lead Data Platform

Zyntek; Houston (TX); Hybrid; USD 140,000 - 210,000; Full time

Job summary

Zyntek in Houston seeks a senior data engineer to lead the design, development, and optimization of enterprise-scale data platforms and analytics solutions on Azure Databricks. The role demands mentoring engineers and collaborating with business stakeholders to deliver scalable, secure data solutions.

You will drive data governance, security, and CI/CD practices, and optimize Spark workloads to support Chevron's Azure-based analytics ecosystem.

Qualifications

• 10+ years in data engineering and data platform delivery.

Responsibilities

• Lead the development of scalable data pipelines and ETL/ELT frameworks using Azure Databricks and PySpark.
• Architect and optimize data ingestion, transformation and consumption layers.
• Design data models, data dictionaries and reusable data products.
• Implement data governance, quality, security and compliance standards.
• Optimize Spark workloads, Databricks jobs and overall platform performance.
• Collaborate with business users, data scientists and cross-functional teams to translate requirements into technical solutions.
• Mentor and guide data engineers and junior team members.
• Drive CI/CD automation and DevOps practices for data platforms.
• Support Data Lakehouse architecture and enterprise analytics initiatives.

Skills

Data engineering

Azure cloud

Databricks

PySpark

Spark optimization

Leadership

Mentoring

CI/CD

Data governance

Stakeholder mgmt

Tools

Azure Databricks

PySpark

Apache Spark

Python

SQL

T-SQL

Azure Data Factory

Azure Data Lake Storage

ADLS

Azure Synapse Analytics

Delta Lake

Databricks Workflows

Data Modeling

Job description

Zyntek in Houston seeks a senior data engineer to lead the design, development, and optimization of enterprise-scale data platforms and analytics solutions on Azure Databricks. The role demands mentoring engineers and collaborating with business stakeholders to deliver scalable, secure data solutions.

You will drive data governance, security, and CI/CD practices, and optimize Spark workloads to support Chevron's Azure-based analytics ecosystem.