Senior Databricks Platform Engineer - AWS

EXL; New York (NY); On-site; USD 140,000 - 200,000; Full time

Job summary

EXL is seeking a Databricks Platform Manager/Engineer to design, administer, secure, and optimize our enterprise Databricks platform on AWS. You will own the platform lifecycle, ensuring scalability, governance, cost optimization, and operational excellence to enable data engineering, analytics, and AI teams.

This role focuses on platform engineering rather than data engineering or analytics development, with responsibilities spanning workspace design, security, RBAC, CI/CD, and monitoring.

Qualifications

• 5–10 years IT experience with 3–5+ years in Databricks on AWS.
• Hands-on administration of Databricks platforms in production.
• Experience designing, securing, and optimizing enterprise Databricks platforms.

Responsibilities

• Design, deploy, and manage Databricks workspaces across environments.
• Establish workspace standards, networking, and isolation.
• Manage DBR version planning, testing, rollout.
• Maintain availability, reliability, and performance.
• Create and manage cluster policies and resource configurations.
• Integrate Databricks with AWS IAM and manage authentication.
• Administer Unity Catalog and RBAC.
• Enable CI/CD pipelines and IaC using Terraform.
• Monitor workspace health, incidents, and dashboards.
• Cost optimization and governance of platform usage.

Skills

Databricks Platform

Workspace administration

Cluster management

Unity Catalog

AWS

IAM

Terraform

DevOps

CI/CD

Git

Monitoring

Security

Platform monitoring

Education

Bachelor's degree in Computer Science or related field

Tools

Terraform

Databricks Runtime

Unity Catalog

GitHub Actions

Jenkins

Azure DevOps

CloudWatch

Job description

EXL is seeking a Databricks Platform Manager/Engineer to design, administer, secure, and optimize our enterprise Databricks platform on AWS. You will own the platform lifecycle, ensuring scalability, governance, cost optimization, and operational excellence to enable data engineering, analytics, and AI teams.

This role focuses on platform engineering rather than data engineering or analytics development, with responsibilities spanning workspace design, security, RBAC, CI/CD, and monitoring.