Senior Data Platform Engineer / Architect – AWS & Databricks

Novia Infotech; San Diego (CA); On-site; USD 140,000 - 180,000; Full time

Job summary

Novia Infotech seeks a senior cloud platform engineer with 8+ years building large-scale cloud platforms and 5+ years in Data Platform/DevOps/SRE/DataOps. You will lead Databricks architecture, Unity Catalog, MLflow, and multi-account AWS governance, and own CI/CD pipelines.

Deep hands-on with Terraform/Terramate, GitHub Actions, Jenkins, EKS, Helm, and Python/Bash scripting is required. US-based applicants with the ability to work across time zones are preferred.

Qualifications

• 8+ years building and operating large-scale cloud platforms.
• 5+ years in Data Platform, DevOps, SRE, or DataOps roles.
• Expert-level AWS experience including networking, IAM, security, and multi-account environments.
• Strong hands-on Databricks experience (Unity Catalog, MLflow).
• Terraform/Terramate or similar IaC, CI/CD pipelines, Python and Bash scripting.

Skills

Cloud platform engineering

Data Platform/DevOps/SRE/DataOps

Python

Bash scripting

CI/CD pipelines

Tools

Databricks Lakehouse Platform

Unity Catalog

MLflow

Terraform/Terramate

GitHub Actions

Jenkins

Amazon EKS

Helm

Job description

• 8+ years building and operating large‑scale cloud platforms
• 5+ years in Data Platform, DevOps, SRE, or DataOps roles
• Expert‑level experience with AWS, including networking, IAM, security, and multi‑account environments
• Strong hands‑on experience with Databricks Lakehouse Platform, including:
• Unity Catalog
• MLflow
• Experience owning Databricks workspace architecture and governance
• Deep experience with Terraform/Terramate (or similar IaC tools)
• Proven experience building CI/CD pipelines (GitHub Actions, Jenkins)
• Advanced Python and Bash scripting skills
• Hands‑on experience managing Amazon EKS clusters and Helm deployments