Senior Databricks Platform Engineer (Terraform)

Arrowhead Pharmaceuticals, Inc.; Los Angeles (CA); On-site; USD 150,000 - 190,000; Full time

Benefits offered by this job

Benefits package

Job summary

Arrowhead Pharmaceuticals, Inc. seeks a Senior Data Platform Engineer to own and operate the Databricks-based data lakehouse.

You will design, build, and manage Databricks workspaces, clusters, and Unity Catalog, while enforcing security and governance policies and driving data ingestion from internal and third‑party sources into the lakehouse. You will implement infrastructure-as-code with Terraform, develop CI/CD pipelines, and collaborate with AI, analytics, and cloud DevOps teams to deliver

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related field, or equivalent practical experience.
• 5+ years of experience in data engineering or platform engineering roles, including hands-on Databricks administration (clusters, jobs, Unity Catalog, Delta Lake).
• Experience managing Databricks infrastructure as code using Terraform.
• Strong Python and SQL skills for building and optimizing data pipelines.
• Experience building data ingestion pipelines from APIs, SFTP, batch, and streaming sources.
• Cloud experience (AWS, Azure) and related data/storage services.
• Experience supporting BI or NL dashboards (Databricks Genie).
• Experience implementing data governance, security, and access controls in Databricks (Unity Catalog).
• Ability to communicate design decisions to non-technical stakeholders.

Responsibilities

• Design, build, and manage Databricks environments (workspaces, clusters, Unity Catalog, SQL warehouses) supporting enterprise analytics and data science workloads.
• Develop and maintain Terraform modules and pipelines to provision and version-control Databricks infrastructure and cloud resources.
• Design and build data ingestion pipelines from internal systems and external providers into the lakehouse.
• Architect and maintain medallion data layers using Delta Lake with governance and data quality.
• Partner with business users to design and support Genie dashboards and enable self-service analytics.
• Implement platform security, access controls, and collaborate with data stewards.
• Collaborate with data engineers, analysts, data scientists, AI engineers, and DevOps to build CI/CD pipelines and Terraform infra-as-code.
• Document platform architecture, ingestion pipelines, and runbooks.
• Assist AI engineers by building MCP connectors and other data/tool integrations for agentic workflows.

Skills

Python

SQL

Databricks

Unity Catalog

Delta Lake

CI/CD

Terraform

Education

Bachelor's degree in CS/Engineering/Data-related field

Tools

Terraform

Databricks

GitHub Actions

Azure DevOps

GitLab CI

dbt

Job description

Arrowhead Pharmaceuticals, Inc. seeks a Senior Data Platform Engineer to own and operate the Databricks-based data lakehouse.

You will design, build, and manage Databricks workspaces, clusters, and Unity Catalog, while enforcing security and governance policies and driving data ingestion from internal and third‑party sources into the lakehouse. You will implement infrastructure-as-code with Terraform, develop CI/CD pipelines, and collaborate with AI, analytics, and cloud DevOps teams to deliver