Staff Data Platform Engineer – Observability & Security

Appfolio; San Francisco (CA); On-site; USD 152,000 - 190,000; Full time

Job summary

AppFolio in San Francisco is seeking a senior Data Engineer to own the operational backbone of our data infrastructure and lead governance across the platform. You will design observability, CI/CD for data pipelines, and collaborate with security and analytics teams to enable scalable, self-service data delivery for decision-making.

You will partner with data engineers, data scientists, and analysts to improve platform usability and self-service capabilities, ensuring strong data governance and

Qualifications

• 8+ years in DataOps, Data Platform Engineering, DevOps or related roles.
• Proficiency in SQL, Python, Airflow, Linux scripting and dbt.
• Strong experience with AWS stack (S3, EC2, EKS), Docker and Kubernetes.
• Experience with cloud data warehouse technologies such as Snowflake, including data security and governance.
• Advanced proficiency with Airflow.
• Knowledge of CI/CD pipelines, GitOps, and infrastructure-as-code (Terraform etc.).
• Experience building self-serve processes.
• Familiarity with data security, IAM, encryption, and audit logging.
• Familiar with Snowflake RBAC and masking policies.

Responsibilities

• Own the design, build, and maintenance of observability and testing for the Data Platform.
• Own the CI/CD architecture for Github repositories and deployment pipelines.
• Manage service accounts, roles, and permissions across Snowflake, dbt, and BI tools.
• Define and own Data Pipeline SLOs and data access controls.
• Partner with InfoSec and Compliance to ensure auditability and privacy.
• Maintain lineage and metadata documentation across data domains.
• Implement and manage infrastructure-as-code for data components.
• Drive automation of environment provisioning and credential rotation.
• Drive self-service usability improvements for data engineers and analysts.

Skills

DataOps

Data Platform

DevOps

SQL

Python

Airflow

dbt

Linux scripting

Terraform

Snowflake

CI/CD

Docker

Kubernetes

Tools

Snowflake

dbt

Docker

Kubernetes

Terraform

GitHub

Job description

AppFolio in San Francisco is seeking a senior Data Engineer to own the operational backbone of our data infrastructure and lead governance across the platform. You will design observability, CI/CD for data pipelines, and collaborate with security and analytics teams to enable scalable, self-service data delivery for decision-making.

You will partner with data engineers, data scientists, and analysts to improve platform usability and self-service capabilities, ensuring strong data governance and