Senior Data Engineer — AI-Driven Data Platform

Adobe; San Francisco (CA); On-site; USD 163,200 - 236,400; Full time

Job summary

Adobe’s Pro Design team in San Francisco seeks a Senior Data Engineer to build scalable data foundations for experimentation, AI features, and analytics across Illustrator, InDesign, and emerging experiences.

You will partner with Product, Engineering, and Data Science to implement data logging, governance with Unity Catalog, and cost-aware data pipelines at scale, while advancing privacy and data quality standards.

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, or a related technical field (or equivalent practical experience).
• 5+ years in data engineering with production pipelines at scale.
• Experience with high-volume event/telemetry data from client applications.
• Experience integrating AI tools to optimize workflows for efficiency, quality, or latency.
• Experience building multi-agent AI systems or agentic workflows.
• Knowledge of AI/ML data pipelines (feature stores, embeddings, retrieval) and modern BI/reporting tools.
• Track record partnering with Product, Engineering, and Data Science to translate questions into reliable data models.

Responsibilities

• Build, scale and optimize data architecture and ETL/pipelines on Databricks across Pro Design products.
• Partner with Product, Engineering, and Data Science to define data logging and instrumentation for experimentation, AI features, and analytics.
• Set and evolve governance standards for data quality, privacy, security, lineage, and SLAs in Unity Catalog.
• Build automated reporting and data foundations powering AI-driven insights across reporting stack.
• Maintain healthy production pipelines and queries at scale, optimizing for cost and latency.

Skills

SQL

Python

PySpark

Airflow

Databricks

Unity Catalog

Azure

AI/ML data pipelines

Telemetry data

Data modeling

Education

Bachelor's degree in Computer Science/Engineering or related field

MS or PhD in CS/Engineering (preferred)

Tools

Databricks

Azure

Unity Catalog

Airflow

BI/Reporting tools

Job description

Adobe’s Pro Design team in San Francisco seeks a Senior Data Engineer to build scalable data foundations for experimentation, AI features, and analytics across Illustrator, InDesign, and emerging experiences.

You will partner with Product, Engineering, and Data Science to implement data logging, governance with Unity Catalog, and cost-aware data pipelines at scale, while advancing privacy and data quality standards.