Principal Data Engineer | Azure, Databricks & Data Lake Architecture

Templeton & Partners - Innovative & Inclusive Hiring Solutions; Houston (TX); On-site; USD 150,000 - 190,000; Full time

Job summary

Templeton & Partners - Innovative & Inclusive Hiring Solutions is seeking a Principal Data Engineer to lead Azure, Databricks and Data Lake initiatives within a major enterprise transformation programme. You will drive architecture, mentoring and delivery of high-volume, cloud-native data solutions.

You will architect scalable Azure Data Lake solutions, lead Databricks-based pipelines with Delta Live Tables and Structured Streaming, and align engineering standards with business goals across a

Qualifications

• Experience leading Azure data initiatives and cloud-native data solutions.
• Strong stakeholder management and leadership experience.
• Ability to design scalable data lake architectures and ETL pipelines.

Responsibilities

• Architect and deliver scalable Azure Data Lake solutions.
• Lead development of modern data pipelines using Databricks, Delta Live Tables, and Structured Streaming.
• Drive cloud data strategy, best practices, and engineering standards.
• Optimise performance and cost-efficiency across large data platforms.
• Collaborate with cross-functional stakeholders to deliver business-critical data solutions.
• Mentor engineering teams and champion technical excellence.

Skills

Synapse Analytics

SQL

Python/Scala/Spark SQL

Data Lake Architecture

ETL Development

Leadership

Tools

Databricks

Delta Live Tables

Structured Streaming

Azure

Job description

Principal Data Engineer | Azure, Databricks & Data Lake Architecture

Join a major enterprise transformation programme building next-generation cloud data

Strong likelihood of extensions, with the programme expected to run 2-3 years

We are seeking an experienced Principal Data Engineer to provide technical leadership across large-scale Azure data initiatives, driving the design and delivery of high-volume, cloud-native data solutions.

What You'll Be Doing

• Architect and deliver scalable Azure Data Lake solutions
• Lead development of modern data pipelines using Databricks, Delta Live Tables, and Structured Streaming
• Drive cloud data strategy, best practices, and engineering standards
• Optimise performance and cost-efficiency across large data platforms
• Collaborate with cross-functional stakeholders to deliver business-critical data solutions
• Mentor engineering teams and champion technical excellence

Key Skills Required

• Synapse Analytics
• SQL, Python, Scala, or Spark SQL
• Data Lake Architecture & ETL Development
• Strong stakeholder management and leadership experience

Nice to Have

If you're a senior data engineering leader with strong Azure and Databricks expertise and are looking for a long-term contract opportunity, I'd be keen to speak with you.