Senior Data Engineer

Adobe Inc.; San Francisco (CA); On-site; USD 163,200 - 236,400; Full time

Job summary

Adobe is seeking a Senior Data Engineer to build scalable data architectures and ETL pipelines on Databricks for the Pro Design team. You will partner with Product, Engineering, and Data Science to instrument data logging for experiments and AI features, while establishing governance on data quality, privacy, and lineage.

You will also develop automated reporting foundations powering AI-driven insights and ensure pipelines are efficient and cost-optimized at scale.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, or equivalent practical experience.
• Proficiency in SQL and Python, PySpark, Airflow, Databricks workflows.
• 5+ years in data engineering, including production pipelines at scale.
• Experience with high-volume event/telemetry data from a client application.
• Experience integrating AI tools to optimize workflows and latency.
• Experience building multi-agent AI systems or agentic workflows.
• Working knowledge of AI/ML data pipelines and modern BI tools.
• Proven ability to partner with Product, Engineering, and Data Science.

Responsibilities

• Build, scale and optimize the data architecture and ETL/pipeline on Databricks across Pro Design products, spanning shared platform data and in-app usage telemetry.
• Partner with Product, Engineering, and Data Science to define and implement data logging and instrumentation for product experimentation, AI/ML features, and analytics.
• Set and evolve governance standards regarding data quality, privacy, security, lineage, and SLAs in Unity Catalog.
• Build automated reporting and the data foundations that power AI-driven insights across our reporting stack.
• Keep production pipelines and queries healthy and performant at scale and drive optimization for cost and latency.

Skills

SQL

Python

PySpark

Airflow

Databricks workflows

Unity Catalog

Azure

Education

Bachelor's degree in CS/Engineering or related field

MS or PhD in CS/Engineering (preferred)

Tools

Databricks

Azure

Unity Catalog

Job description

The Opportunity

The world of design is changing rapidly and the Pro Design team is leading that transformation. We are the Adobe organization behind Illustrator, InDesign, and emerging experiences that connect creativity, collaboration, and AI. Our teams are reimagining what professional design looks like for the next decade - building intelligent, connected tools that empower creators and teams to move faster without sacrificing craft.

We are looking for a Senior Data Engineer who will build a strong and scalable foundation to support it. Join us and build Adobe's future products!

What you'll Do

• Build, scale and optimize the data architecture and ETL/pipeline on Databricks across Pro Design products, spanning shared platform data and in-app usage telemetry.
• Partner with Product, Engineering, and Data Science to define and implement data logging and instrumentation that enables product experimentation, AI/ML features, and analytics.
• Set and evolve governance standards regarding data quality, privacy, security, lineage, and SLAs in Unity Catalog.
• Build automated reporting and the data foundations that power conversational, AI-driven insights across our reporting stack.
• Keep production pipelines and queries healthy and performant at scale and drive optimization for cost and latency.

What you need to succeed

Minimum Requirements:

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• Proficiency in SQL and Python, PySpark, Airflow, Databricks workflows.
• 5+ years in data engineering, including production pipelines at scale.
• Experience with high-volume event/telemetry data from a client application, not just server-side data.
• Experience integrating AI tools to optimize/redesign workflows towards higher efficiency, quality, or latency.
• Experience building multi-agent AI systems or agentic workflows.
• Working knowledge of AI/ML data pipelines (feature stores, embeddings, or retrieval) and modern BI/reporting tools.
• A track record of partnering with Product, Engineering, and Data Science to turn ambiguous questions into reliable data models.

Preferred Requirements:

• MS or Ph.D. in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• Hands‑on experience with Databricks and Unity Catalog (or comparable Lakehouse and governance tooling).
• Experience deploying and managing services and applications on Azure and Azure Cloud platforms.
• Familiarity with Retrieval Augmented Generation (RAG) techniques working in conjunction with LLMs.
• Familiarity with data privacy and compliance for user‑behavior data (e.g., GDPR, CCPA).

About Adobe

Adobe empowers everyone to create through innovative platforms and tools that unleash creativity, productivity and personalized customer experiences. Adobe's industry‑leading offerings including Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud, Adobe Experience Platform, Adobe Experience Manager, and GenStudio enable people and businesses to turn ideas into impact, powered by AI and driven by human ingenuity.

Our 30,000+ employees worldwide are creating the future and raising the bar as we drive the next decade of growth. We're on a mission to hire the very best and believe in creating a company culture where all employees are empowered to make an impact. At Adobe, we believe that great ideas can come from anywhere in the organization. The next big idea could be yours.

Let's Adobe together

At Adobe, we believe in creating a company culture where all employees are empowered to make an impact. Learn more about Adobe life, including our values and culture, focus on people, purpose and community, Adobe for All, comprehensive benefits programs, the stories we tell, the customers we serve, and how you can help us advance our mission of empowering everyone to create.

Adobe is proud to be an Equal Employment Opportunity employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other protected characteristic. Learn more.

Adobe aims to make our Careers website and recruiting process accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email [e-mail] or call [phone].

AI Use Guidelines for Interviews

Our interviews are designed to reflect your own skills and thinking. The use of AI or recording tools during live interviews is not permitted unless explicitly invited by the interviewer or approved in advance as part of a reasonable accommodation. If these tools are used inappropriately or in a way that misrepresents your work, your application may not move forward in the process.

At Adobe, we empower employees to innovate with AI - and we look for candidates eager to do the same. As part of the hiring experience, we provide clear guidance on where AI is encouraged during the process and where it's restricted during live interviews. See how we think about AI in the hiring experience.

Expected Pay Range

Our compensation reflects the cost of labor across several U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this positionis $133,100 -- $236,400 annually. Paywithin this range varies by work locationand may also depend on job-related knowledge, skills,and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process. In California, the pay range for this position is $163,200 - $236,400

At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP).

In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award.

State‑Specific Notices

California

Fair Chance Ordinances

Adobe will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and "fair chance" ordinances.

Colorado

Application Window Notice

If this role is open to hiring in Colorado (as listed on the job posting), the application window will remain open until at least the date and time stated above in Pacific Time, in compliance with Colorado pay transparency regulations. If this role does not have Colorado listed as a hiring location, no specific application window applies, and the posting may close at any time based on hiring needs.

Massachusetts

Massachusetts Legal Notice

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.