Senior Data Platform Engineer (Databricks & Terraform)

Arrowhead Pharmaceuticals, Inc.; Pasadena (CA); On-site; USD 155,000 - 190,000; Full time

Job summary

Arrowhead Pharmaceuticals, Inc. in Pasadena, CA, seeks a Senior Data Platform Engineer to own the Databricks data platform end-to-end.

You will design and run workspaces, clusters, and Unity Catalog, while building Terraform-based infrastructure and data pipelines for enterprise analytics. You will collaborate with data scientists, engineers, and BI teams to deliver secure, governed data flowing into Genie dashboards, enabling self-service analytics.

Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, or related field, or equivalent practical experience.
• 5+ years of experience in data engineering or platform engineering roles, including hands-on Databricks administration.
• Proven experience managing Databricks infrastructure as code using Terraform.
• Strong proficiency in Python and SQL for building data pipelines.
• Experience designing data ingestion pipelines from APIs, SFTP, third-party feeds, and streaming sources.
• Working knowledge of cloud platforms (AWS, Azure) and data storage services.
• Experience supporting BI or natural-language dashboards (e.g., Databricks Genie).
• Ability to explain pipeline and dashboard design decisions to non-technical stakeholders.

Responsibilities

• Design, build, and manage Databricks environments (workspaces, clusters, Unity Catalog, SQL warehouses) for analytics workloads.
• Develop and maintain Terraform modules to provision and version-control Databricks infrastructure.
• Design and build data ingestion pipelines from internal and external sources into the lakehouse.
• Architect and maintain bronze/silver/gold data layers using Delta Lake with governance.
• Collaborate with stakeholders to design Genie dashboards and enable self-service analytics.
• Implement platform security, access controls, and data governance.
• Work with engineers to build CI/CD pipelines and IaC for the data platform.
• Document architecture, pipelines, and runbooks.
• Assist AI engineers with MCP connectors and data/tool integrations.

Skills

Databricks

Python

SQL

Terraform

Data governance

CI/CD

Delta Lake

Unity Catalog

APIs/SFTP

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Terraform

GitHub Actions

Azure DevOps

GitLab CI

dbt

Job description

Arrowhead Pharmaceuticals, Inc. in Pasadena, CA, seeks a Senior Data Platform Engineer to own the Databricks data platform end-to-end.

You will design and run workspaces, clusters, and Unity Catalog, while building Terraform-based infrastructure and data pipelines for enterprise analytics. You will collaborate with data scientists, engineers, and BI teams to deliver secure, governed data flowing into Genie dashboards, enabling self-service analytics.