Senior Databricks Lakehouse Engineer - Data Platform Lead

ExlService Holdings, Inc.

New York (NY)

On-site

USD 170,000 - 230,000

Full time

5 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

ExlService Holdings, Inc. is seeking a highly experienced Databricks Data Engineer to lead enterprise-scale data platforms using a Databricks Lakehouse architecture.

The ideal candidate will design, build, and modernize data ecosystems with cloud-native solutions across Azure, AWS, or GCP, while mentoring teams and guiding architecture decisions. You will collaborate with architects, product owners, data scientists, and business stakeholders to deliver high‑performance analytics, AI/ML, and BI

Qualifications

8-10 years of experience in Data Engineering, Big Data, and Cloud Data Platforms.
Hands-on experience with Databricks Lakehouse architecture and modern data platforms.
Experience defining data engineering standards and mentoring teams.
Strong leadership and solution architecture expertise.
Experience delivering analytics, AI/ML, and BI solutions across cloud platforms.

Responsibilities

Design and implement enterprise-scale data platforms using Databricks Lakehouse architecture.
Architect and develop scalable ETL/ELT data pipelines for batch and real-time processing.
Define enterprise data models, ingestion frameworks, and transformation strategies.
Lead the implementation of Delta Lake, Unity Catalog, and data governance frameworks.
Build and optimize Spark and PySpark solutions for large-volume datasets.
Drive cloud data platform modernization and migration initiatives.
Serve as the technical lead for Databricks and Data Engineering programs.
Establish engineering best practices, coding standards, and architecture guidelines.
Conduct architecture reviews, code reviews, and solution assessments.
Mentor and guide Data Engineers, Technical Leads, and junior team members.
Collaborate with Enterprise Architects, Product Owners, Data Scientists, and Business Stakeholders.
Design cloud-native data solutions on Azure, AWS, or GCP.
Implement secure, scalable, and resilient data architectures.
Optimize costs, performance, reliability, and availability of data platforms.
Lead CI/CD and Infrastructure-as-Code for data workloads.
Define monitoring, observability, and operational excellence practices.
Establish data governance, lineage, cataloging, and security controls.
Ensure compliance with organizational and regulatory requirements.
Implement data quality frameworks and monitoring solutions.
Collaborate with security and compliance teams to enforce data protection standards.
Partner with business leaders to understand strategic data requirements.
Translate business requirements into scalable technical solutions.
Drive delivery planning, risk management, and resource coordination.
Present architecture decisions and technical recommendations to leadership teams.

Skills

Technical leadership

Solution architecture

Stakeholder management

Mentoring

Program delivery

Communication

Problem solving

Education

Bachelor's or Master's Degree in Computer Science / Engineering

Tools

Databricks Lakehouse Platform

Databricks Workflows

Delta Lake

Unity Catalog

Structured Streaming

Databricks SQL

Delta Live Tables

Databricks Asset Bundles

Apache Spark

PySpark

Spark SQL

Kafka

Azure Databricks

Azure Data Factory

ADLS Gen2

Azure Synapse Analytics

Azure Key Vault

Event Hub

EMR

Glue

Redshift

Lambda

IAM

BigQuery

Dataflow

Pub/Sub

Composer

Python

SQL

Scala

Shell Scripting

Git

Terraform

Docker

Kubernetes

Data Warehousing

Job description

ExlService Holdings, Inc. is seeking a highly experienced Databricks Data Engineer to lead enterprise-scale data platforms using a Databricks Lakehouse architecture.

Get your free, confidential resume review.

or drag and drop your file here.