Senior Databricks Platform Engineer – Mexico/India (Remote)

Digitalt3

United States

Remote

USD 150,000 - 210,000

Full time

10 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Digitalt3 is seeking a Databricks Platform Engineer to design, build, automate, and operate our enterprise Databricks Lakehouse on AWS in a 100% remote setup across Mexico, India, or Sri Lanka.

The role emphasizes infrastructure automation, security, governance, and standardization, leveraging Terraform and IaC to create scalable Databricks environments with enterprise Unity Catalog governance.

Qualifications

  • 5+ years in Platform/Cloud engineering or related roles.
  • Strong Databricks administration and Unity Catalog experience.
  • Proficient Terraform and IaC for multi-environment deployments.
  • Experience with AWS IAM, VPC, S3, KMS and security controls.
  • CI/CD automation with GitHub Actions, GitLab CI or Jenkins.
  • Python and SQL proficiency for automation and troubleshooting.
  • Knowledge of cloud security, least-privilege access, encryption.

Responsibilities

  • Design, build, and maintain Terraform modules for Databricks infrastructure.
  • Automate provisioning of Databricks workspaces, compute, and networking.
  • Manage AWS components: IAM roles, VPCs, security groups.
  • Develop CI/CD pipelines using GitHub Actions or GitLab CI.
  • Implement Databricks Asset Bundles, APIs, and Terraform automation.
  • Establish Unity Catalog architecture and data governance.
  • Define RBAC and least-privilege access controls.
  • Integrate Databricks access with enterprise IAM.
  • Develop platform runbooks and operational standards.

Skills

Platform engineering
Cloud engineering
DevOps
Data infrastructure
Data governance
IaC/Terraform
Python
SQL
Security

Tools

Terraform
Databricks
GitHub Actions
GitLab CI
Jenkins
AWS
IAM

Job description

Position Type: Full-Time Employment

Location: 100% Remote – Mexico, India or SriLanka

Experience: 5+ years of experience in Platform Engineering, Cloud Engineering, DevOps, Data Infrastructure, or related engineering roles.

Role Overview: We are seeking an experienced Databricks Platform Engineer to design, build, automate, and operate our enterprise Databricks Lakehouse platform on AWS. This role bridges Cloud Platform Engineering, Data Infrastructure, and Data Engineering, with a strong focus on infrastructure automation, security, governance, and standardization. The ideal candidate will use Terraform and Infrastructure as Code (IaC) to deliver scalable and secure Databricks environments while establishing enterprise data governance through Databricks Unity Catalog.

Key Responsibilities
  • Design, build, and maintain reusable Terraform modules for Databricks infrastructure across Development, Test, and Production environments.
  • Automate provisioning and lifecycle management of Databricks workspaces, compute resources, SQL warehouses, networking, security configurations, and storage integrations.
  • Manage IaC for AWS components including VPCs, security groups, IAM roles, private connectivity, and storage endpoints.
  • Develop and maintain CI/CD pipelines using GitHub Actions, GitLab CI, or similar platforms.
  • Implement deployment automation using Databricks Asset Bundles, Databricks APIs, Terraform, and related automation frameworks.
  • Establish reusable platform patterns and self-service “golden paths” for Data Engineering, Data Science, and Analytics teams.
  • Unity Catalog & Data Governance: Design and implement the enterprise Unity Catalog architecture, including catalogs, schemas, volumes, storage credentials, and external locations.
  • Define governance standards that provide appropriate workload and team isolation while enabling secure data sharing and discoverability.
  • Implement and manage Role‑Based Access Control (RBAC) and object‑level permissions based on least‑privilege principles.
  • Integrate Databricks access controls with enterprise identity and access management platforms.
  • Implement appropriate row‑level and column‑level security controls.
  • Establish data governance capabilities including lineage, auditing, classification, tagging, and access controls.
  • Automate governance policies through Terraform, APIs, and other platform automation mechanisms.
  • Platform Operations & Security: Design and maintain compute and cluster policies to ensure standardized and secure platform usage.
  • Manage platform configuration, upgrades, capacity, and operational support.
  • Partner with AWS Cloud and Security teams to implement IAM controls, encryption, KMS integration, network security, and vulnerability remediation.
  • Troubleshoot Databricks platform, infrastructure, networking, access, and configuration issues.
  • Develop operational standards, architectural documentation, troubleshooting procedures, and platform runbooks.
Required Skills & Qualifications
  • Experience: 5+ years of experience in Platform Engineering, Cloud Engineering, DevOps, Data Infrastructure, or related engineering roles.
  • Databricks: Strong hands‑on experience administering enterprise Databricks environments, including workspaces, compute, SQL warehouses, cluster policies, jobs, and platform security.
  • Unity Catalog: Practical experience designing and implementing Unity Catalog, including catalogs, schemas, external locations, storage credentials, permissions, and governance controls.
  • Terraform: Advanced experience developing reusable Terraform modules and managing Terraform state, providers, and multi‑environment deployment patterns.
  • AWS: Strong hands‑on experience with IAM, S3, VPC networking, security groups, KMS, and PrivateLink/private connectivity.
  • CI/CD: Experience developing automated deployment pipelines using GitHub Actions, GitLab CI, Jenkins, or equivalent platforms.
  • Automation: Experience with Databricks APIs, Databricks Asset Bundles, CLI tools, and infrastructure automation frameworks.
  • Programming: Proficiency in Python and SQL for automation, validation, and troubleshooting.
  • Security: Strong understanding of cloud security, identity management, least‑privilege access, encryption, and secrets management.
Preferred / Nice‑to‑Have Skills
  • Experience with additional AWS data services, such as DynamoDB, Redshift, Glue, Athena, and Kinesis.
  • Familiarity with Azure data services, such as Synapse Analytics, Data Factory, ADLS, Cosmos DB, and Microsoft Fabric.
  • Exposure to modern cloud data, streaming, analytics, and AI/ML services across AWS and Azure.

ID: P24

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Databricks Platform Engineer – Remote
Senior Databricks Platform Engineer – Remote

Digitalt3 • United States

Remote
USD 150,000 - 210,000
Databricks Data Platform Architect
Databricks Data Platform Architect

UsefulBI Corporation • Raleigh (NC)

On-site
USD 130,000 - 180,000
Senior Databricks Platform Administrator
Senior Databricks Platform Administrator

DHANU GLOBAL ENTERPRISES, INC. • Dallas (TX)

Remote
USD 130,000 - 170,000
Databricks Administrator / Platform Engineer
Databricks Administrator / Platform Engineer

Changeis • United States

Remote
USD 130,000 - 190,000
Data Platform Engineer
Data Platform Engineer

Volto Consulting • United States

Remote
USD 150,000 - 210,000
Job Opening - AWS Databricks Platform Engineer - Remote
Job Opening - AWS Databricks Platform Engineer - Remote

Tech Mahindra Limited • United States

Remote
USD 140,000 - 200,000
Databricks Platform Engineer
Databricks Platform Engineer

EXL Talent Acquisition Team • New York (NY)

On-site
USD 180,000 - 240,000
Senior Databricks Engineers
Senior Databricks Engineers

ExlService Holdings, Inc. • Austin (TX)

Remote
USD 120,000 - 180,000
Sr. Staff Platform/Data Reliability Engineer, Databricks (R5537)
Sr. Staff Platform/Data Reliability Engineer, Databricks (R5537)

Remote • San Francisco (CA)

On-site
USD 200,000 - 270,000
Cloud Engineer Azure Databricks
Cloud Engineer Azure Databricks

Turtle Trax S.A. • United States

Remote
USD 140,000 - 190,000