Databricks Data Platform Engineer on AWS & Terraform

First Orion; Arkansas; On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Open PTO

Company paid holidays

Flex Fridays

Flexible work arrangements

Fitness center access

Tuition reimbursement

Retirement plans

Bonus potential

Job summary

First Orion is seeking a senior data/platform engineer to implement and operate the Databricks platform on AWS. You will build Terraform modules for Databricks and Unity Catalog, develop Asset Bundles, and manage CI/CD pipelines for repeatable deployments across environments.

You will configure workspaces, compute policies, SQL warehouses, and service principals, while enforcing Unity Catalog governance and secure access.

Qualifications

• Bachelor’s degree in Computer Science or related field or equivalent practical experience.
• 5+ years in data engineering or platform engineering, cloud infrastructure, or DevOps.
• 3+ years hands-on with Databricks and Apache Spark in production.
• Strong Terraform experience with modules, state management, provider configuration, and CI/CD.
• Deep knowledge of Unity Catalog governance and securable objects.

Responsibilities

• Implement, operate, and improve the Databricks platform on AWS.
• Build Terraform modules for Databricks, AWS infrastructure, Unity Catalog, and integrations.
• Develop and maintain Databricks Asset Bundles and CI/CD pipelines.
• Configure and support workspaces, compute policies, SQL warehouses, workflows, and service principals.
• Implement Unity Catalog governance and group-based access.
• Build data pipelines using Python, SQL, Spark, Delta Lake, and Databricks workflows.
• Monitor platform health, troubleshoot incidents, and perform root-cause analysis.
• Create reusable patterns, automation, and self-service tools for engineers.
• Collaborate with Data Platform Architect on designs and production readiness.

Skills

Databricks

Apache Spark

Terraform

Unity Catalog

AWS

Git

CI/CD

Python

SQL

PySpark

Security

SaaS Platform

Education

Bachelor’s degree in Computer Science or related field

Tools

Databricks

Terraform modules

Git

CI/CD pipelines

Databricks Asset Bundles

Job description

First Orion is seeking a senior data/platform engineer to implement and operate the Databricks platform on AWS. You will build Terraform modules for Databricks and Unity Catalog, develop Asset Bundles, and manage CI/CD pipelines for repeatable deployments across environments.

You will configure workspaces, compute policies, SQL warehouses, and service principals, while enforcing Unity Catalog governance and secure access.