Senior Security Data Platform Engineer

Adobe; San Jose (CA); On-site; USD 208,000 - 302,000; Full time

Job summary

Adobe’s Security Data Platform team seeks a Staff Security Data Engineer to own end-to-end architecture on Databricks and AWS. You will write production code, build pipelines for security telemetry, and mentor engineers, shaping the platform toward exabyte scale while ensuring reliability and cost-effectiveness.

You will partner with Security Operations, Threat Intelligence, Compliance, and infrastructure teams to resolve tradeoffs and deliver scalable capabilities, leading critical engineering

Qualifications

• 10+ years in data or software engineering with Staff-level scope.
• Proven delivery of complex distributed systems across team boundaries.
• Deep production expertise in Spark, Databricks, Delta Lake, and lakehouse architecture.
• Strong AWS experience plus production Terraform experience.

Responsibilities

• Design end-to-end architecture on Databricks and AWS, translating needs into proposals and production capabilities.
• Build and evolve distributed batch and streaming pipelines for EDR telemetry, network logs, and identity events.
• Write Python and SQL; lead code and design reviews; define test strategy and automation choices.

Skills

Python

SQL

Spark

Databricks

Terraform

Airflow

Communication

Tools

Databricks

Delta Lake

Unity Catalog

MWAA

Airflow

Job description

Adobe’s Security Data Platform team seeks a Staff Security Data Engineer to own end-to-end architecture on Databricks and AWS. You will write production code, build pipelines for security telemetry, and mentor engineers, shaping the platform toward exabyte scale while ensuring reliability and cost-effectiveness.

You will partner with Security Operations, Threat Intelligence, Compliance, and infrastructure teams to resolve tradeoffs and deliver scalable capabilities, leading critical engineering