→ Azure Databricks Architect Houston TX - Onsite View & apply

Zyntek; Houston (TX); On-site; USD 140,000 - 210,000; Full time

Job summary

Zyntek in Houston seeks a senior data engineer to lead the design, development, and optimization of enterprise-scale data platforms and analytics solutions on Azure Databricks. The role demands mentoring engineers and collaborating with business stakeholders to deliver scalable, secure data solutions.

You will drive data governance, security, and CI/CD practices, and optimize Spark workloads to support Chevron's Azure-based analytics ecosystem.

Qualifications

• 10+ years in data engineering and data platform delivery.

Responsibilities

• Lead the development of scalable data pipelines and ETL/ELT frameworks using Azure Databricks and PySpark.
• Architect and optimize data ingestion, transformation and consumption layers.
• Design data models, data dictionaries and reusable data products.
• Implement data governance, quality, security and compliance standards.
• Optimize Spark workloads, Databricks jobs and overall platform performance.
• Collaborate with business users, data scientists and cross-functional teams to translate requirements into technical solutions.
• Mentor and guide data engineers and junior team members.
• Drive CI/CD automation and DevOps practices for data platforms.
• Support Data Lakehouse architecture and enterprise analytics initiatives.

Skills

Data engineering

Azure cloud

Databricks

PySpark

Spark optimization

Leadership

Mentoring

CI/CD

Data governance

Stakeholder mgmt

Tools

Azure Databricks

PySpark

Apache Spark

Python

SQL

T-SQL

Azure Data Factory

Azure Data Lake Storage

ADLS

Azure Synapse Analytics

Delta Lake

Databricks Workflows

Data Modeling

Job description

Role Summary:Lead the design development and optimization of enterprise scale data platforms and analytics solutions using Azure Databricks Drive data engineering best practices mentor team members and collaborate with business stakeholders to deliver scalable secure and high performance data solutions This aligns with Chevrons Azure based Data Analytics ecosystem.Key ResponsibilitiesLead the development of scalable data pipelines and ETLELT frameworks using Azure Databricks and PySparkArchitect and optimize data ingestion transformation and consumption layersDesign data models data dictionaries and reusable data productsImplement data governance quality security and compliance standardsOptimize Spark workloads Databricks jobs and overall platform performanceCollaborate with business users data scientists and cross-functional teams to translate requirements into technical solutionsMentor and guide data engineers and junior team membersDrive CICD automation and DevOps best practices for data platformsSupport Data Lakehouse architecture and enterprise analytics initiatives

Required skills

Required Skills:Azure DatabricksPySpark Apache SparkPythonSQL TSQLAzure Data Factory ADFAzure Data Lake Storage ADLSAzure Synapse AnalyticsDelta LakeDatabricks WorkflowsData Modeling Data WarehousingAzure DevOpsData Governance SecurityPerformance Tuning and OptimizationCICD and Automation FrameworksExperience10 years in Data Engineering Data Platform deliveryStrong experience leading Azurebased cloud data transformation programsProven expertise in enterprisescale Databricks implementationsExperience mentoring teams and driving technical governancePreferred SkillsUnity CatalogAirflowPower BILakehouse ArchitectureData-Ops, ML-Ops exposureStakeholder management and client facing communication