Senior Databricks Platform Engineer (AWS)

Modernizing Medicine, Inc.; Boca Raton (FL); On-site; USD 140,000 - 170,000; Full time

Benefits offered by this job

Medical/Dental/Vision

401(k) matching

Paid time off

Tuition reimbursement

Hybrid/onsite flexibility

Job summary

Modernizing Medicine, Inc. seeks a Senior/Staff Data Platform Engineer to own and evolve our Databricks platform on AWS, supporting mission-critical data, analytics, and AI workloads built on regulated healthcare data across multiple teams and products.

This role reports to the Director of Data Platform Engineering with no direct reports initially and focuses on platform engineering—creating shared foundations, guardrails, automation, observability, and self-service capabilities for Data

Qualifications

• Own Databricks on AWS in a multi-team production environment.
• Deep experience with Unity Catalog, identity federation, service principals, compute policies, secure data-access patterns, lineage, and auditability.
• Strong AWS knowledge across IAM, VPC networking, private connectivity, S3, KMS, security groups, logging, and cross-account access.
• Experience operating cloud data platforms containing regulated, confidential, or highly sensitive data.
• Experience leading platform migrations, workspace or metastore consolidations, runtime upgrades, or similar modernization under production load.

Responsibilities

• Databricks platform ownership across development, test, and production environments.
• Automate workspace provisioning and configuration, including identity federation, SSO/SCIM integration, service principals, and entitlements.
• Manage Unity Catalog, including metastores, bindings, storage credentials, and auditing.
• Define patterns for serverless and classic compute, jobs, interactive compute, and SQL warehouses.
• Maintain compute policies, tagging, auto-termination, and deprecation plans balancing security and cost.
• Develop IaC strategy with Terraform modules for Databricks and AWS providers.
• Build CI/CD workflows for platform changes with peer reviews and safe rollouts.
• Provide reusable deployment templates and secure deployment patterns.
• Ensure integration with AWS guardrails, networking, IAM, S3, KMS, DNS, and secrets management.

Skills

Python automation

Shell scripting

REST API integration

Databricks on AWS

Unity Catalog

Identity federation

Terraform IaC

AWS IAM and networking

Platform migration leadership

Tools

Terraform

Databricks

AWS

Job description

Modernizing Medicine, Inc. seeks a Senior/Staff Data Platform Engineer to own and evolve our Databricks platform on AWS, supporting mission-critical data, analytics, and AI workloads built on regulated healthcare data across multiple teams and products.

This role reports to the Director of Data Platform Engineering with no direct reports initially and focuses on platform engineering—creating shared foundations, guardrails, automation, observability, and self-service capabilities for Data