Lead Data Engineer

Deeplight; United Arab Emirates; On-site; AED 300,000 - 560,000; Full time

Benefits offered by this job

Competitive salary

Comprehensive health insurance

Full visa sponsorship

Professional development & certs

Subscription reimbursement

Cutting-edge AI projects

Monthly incentive program

Career advancement opportunities

Job summary

DeepLight AI is seeking a Lead Data Engineer who combines hands-on engineering excellence with architectural vision and team leadership. You will design production-grade data platforms, mentor engineers, and collaborate directly with client stakeholders to deliver secure, scalable data solutions.

You will drive end-to-end data pipelines, lakehouses, and analytics-ready datasets, translating business needs into robust technical roadmaps while upholding best practices in governance, testing, and

Qualifications

• Advanced proficiency in Python and SQL.
• Experience delivering end-to-end ETL/ELT pipelines.
• Hands-on expertise with at least one major cloud provider (AWS/Azure/GCP).
• Experience with Databricks, Snowflake, or similar platforms.
• Strong communication skills for client interaction and leadership.

Responsibilities

• Drive end-to-end delivery architecture, build and deploy production-grade data pipelines, lakehouses, and analytics-ready datasets.
• Turn complex business problems into clear technical designs, roadmaps, and actionable tasks.
• Stay hands-on: solve tough technical challenges, review code, and resolve production issues.
• Raise engineering standards for code quality, testing, CI/CD, documentation, and data governance.
• Build secure, scalable data pipelines with enterprise-grade monitoring and governance.
• Lead and mentor mid and senior engineers, fostering high-performance teams.
• Collaborate with client architects, data scientists, and business leaders to translate technical choices into business value.

Skills

Python

SQL

ETL/ELT pipelines

Data architectures

Cloud platforms

Databricks

Snowflake

BigQuery

Redshift

Data privacy

Communication skills

Tools

Databricks

Snowflake

Microsoft Fabric

Synapse

BigQuery

Redshift

AWS

Azure

GCP

Job description

DeepLight AI is a specialist AI and data consultancy dedicated to helping organisations turn complex data into secure, scalable, and actionable business capability.

Based in the UAE, DeepLight partners with clients across a range of industries to design and deliver tailored data, analytics, and AI solutions.

DeepLight does not take a one-size-fits-all approach.

We work with clients to understand their business context, existing technology landscape, and strategic goals, then design solutions that integrate effectively into their enterprise architecture.

From building robust data foundations to enabling advanced analytics and AI platforms, we help clients create practical, high-impact intelligent systems that are secure, scalable, and aligned to business value.

We are looking for a Lead Data Engineer who thrives at the intersection of hands‑on technical excellence, architectural vision, and team leadership.

If you love solving complex data challenges, setting engineering benchmarks, and shaping real‑world solutions directly with clients, this is your stage.

The Opportunity

As a Lead Data Engineer, you will be the primary technical authority driving data engineering for high‑profile client engagements.

This is a high‑impact, hands‑on leadership role where you will design production‑grade platforms, elevate engineering quality, and mentor the next generation of talent.

You’ll be leading by example—balancing rapid delivery with long‑term engineering rigor, making pragmatic architectural decisions, and serving as a trusted technical advisor to client stakeholders.

What You’ll Do

• Drive End-to-End Delivery Architect, build, and deploy production-grade data pipelines, lakehouses, and analytics‑ready datasets.
• Turn complex business problems into clear technical designs, delivery roadmaps, and actionable engineering tasks.
• Stay hands‑on: solve tough technical challenges, perform code reviews, and jump in on production issue resolution.
• Raise the Engineering Bar Establish and champion best‑in‑class standards for code quality, testing, CI/CD, documentation, and data governance.
• Build resilient, monitored, and secure data pipelines designed for scale and enterprise compliance.
• Drive operational excellence across version control, automated testing, runbooks, and platform monitoring.
• Inspire & Influence Coach and Mentor mid and senior level engineers, fostering a high‑performance culture grounded in technical discipline and continuous growth.
• Partner directly with client architects, data scientists, and business leaders, translating complex technical choices into clear business value.
• As an AI consultancy, our greatest asset is the expertise of our people.
• While technical mastery is the foundation of what we do, the ability to bridge the gap between complex data science and actionable business value is what defines your success with Deeplight.
• We're looking for individuals who are not only world‑class in their fields of specialism, but also compelling communicators and persuasive advocates for their own skills.
• You will be the face of our firm, tasked with building trust, articulating the "why" behind your technical decisions, and effectively "selling" your vision to high‑level stakeholders.
• If you thrive on the challenge of presenting cutting‑edge solutions as much as you do on building them, you will fit right in.

The benefits you'll enjoy as part of this role include:

• Competitive salary.
• Comprehensive personal health insurance.
• Full Individual Visa Sponsorship.
• Professional development and certification support.
• Subscription reimbursement relating to your role.
• Opportunity to work on cutting‑edge AI projects.
• Monthly Employee Incentive program.
• Career advancement opportunities in a rapidly growing AI company.

What We’re Looking For

• Advanced proficiency in Python and SQL with a proven track record of delivering end‑to‑end ETL/ELT pipelines and scalable data architectures.
• Hands‑on expertise with at least one major cloud provider (AWS, Azure, GCP) and deep proficiency in platforms like Databricks, Snowflake, Microsoft Fabric, Synapse, BigQuery, or Redshift.
• Deep understanding of data lakes, lakehouses, warehouses, streaming vs batch processing, orchestration, and production monitoring.
• Solid grasp of data privacy, access control, encryption, schema management, and enterprise data quality frameworks.
• Excellent communication skills with the ability to navigate client environments, guide stakeholders, and balance delivery pace with technical quality.
• Strong understanding of how robust data engineering enables advanced analytics, machine learning, and Generative AI applications.

Why Join DeepLight AI?

• Lead critical, high‑visibility engineering initiatives across top‑tier client environments.
• Work with cutting‑edge cloud and AI technologies in a collaborative, fast‑evolving consultancy environment.
• Join a team that values technical mastery, pragmatic leadership, and continuous innovation.

At DeepLight AI, we recognise that diversity drives innovation.

We are committed to fostering an inclusive environment where individuals with different thinking styles can thrive and contribute their unique strengths to our specialised AI and data solutions.

Our goal is to ensure our application and interview process is accessible, predictable, and fair for all candidates.

If you require any specific adjustments to the application process, or if you require any reasonable adjustments should you be successful in being processed to the interview stage, please do let us know.

This information will be kept strictly confidential and will not impact hiring decisions.