Senior Software Engineer II, Ads Data Solutions Engineering

AI Chopping Block, Inc.; Northern (KY); Hybrid; USD 192,000 - 203,000; Full time

Job summary

Instacart is hiring a Senior Engineer II (L6) to co-own the technical roadmap for off-platform data solutions, cleanrooms, and AI-enabled initiatives. You will mentor engineers, drive architectural decisions, and partner with Product, Data Science, and Governance teams to deliver scalable, privacy-conscious systems.

You will lead cross-team collaboration, improve CI/CD and observability, and help define on-call and SLO best practices as the company expands its adaptable, AI-first engineering

Qualifications

• 8+ years of software engineering experience delivering and operating large-scale backend/data systems.
• Strong in Python and Ruby or Go; REST/gRPC services and third-party API integrations.
• Data pipelines with DBT and Airflow; Spark/Databricks; advanced SQL and performance tuning.
• Snowflake and AWS experience; cost-aware design; Temporal workflows and event-driven patterns.
• Experience with ad-tech/programmatic integrations; privacy and GDPR/CCPA practices.
• CI/CD, containers, observability with Datadog; SLO thinking and incident readiness.
• Hands-on AI-assisted development tools; building AI-enabled internal tools and workflows.
• Clear technical writing and ability to drive consensus across teams.

Responsibilities

• Lead architecture for scalable systems across off-platform workflows, cleanrooms, taxonomy automation, and the Ads Data Solutions Platform.
• Evolve abstractions, testing, CI/CD, observability, and cost efficiency; drive modernization.
• Drive initiatives on behalf of engineering management; align stakeholders and manage dependencies.
• Expand off-platform integrations; design privacy-forward activation and identity workflows.
• Develop reusable query templates and optimize pipelines for cost and performance.
• Lead taxonomy intake automation and release workflow improvements.
• Assist with platform modernization and developer tooling; contribute to on-call/SLO strategy.
• Mentor L4/L5 engineers; build cross-team partnerships.

Skills

Python

Ruby or Go

REST/gRPC

Third-party APIs

DBT

Airflow

Spark/Databricks

SQL optimization

Snowflake

AWS

Temporal

Data pipelines

Privacy/compliance

CI/CD

Datadog observability

AI-assisted development

Tools

Datadog

Temporal

Airflow

DBT

Spark

Databricks

Snowflake

AWS

Job description

We're transforming the grocery industry

At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers.

Instacart has become a lifeline for millions of people, and we’re building the team to help push our shopping cart forward. If you’re ready to do the best work of your life, come join our table.

Instacart is a Flex First team

There’s no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work—whether it’s from home, an office, or your favorite coffee shop—while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work.

Overview

The Ads DSE team builds the core capabilities that power Instacart's off-platform advertising, secure data collaboration (cleanrooms), automated taxonomy management, and their associated platform foundations. We are hiring a Senior Engineer II (L6) to co-own the technical roadmap, modernize our data solutions infrastructure, scale off-platform integrations and measurement capabilities, extend our cleanroom collaboration capabilities, and automate taxonomy change management workflows. This role is pivotal for cross-team collaboration, developer productivity, and AI-driven development initiatives.

You are a senior technical leader who designs and ships scalable, data‑intensive systems; drives cross‑team execution; and raises engineering standards. You’ll partner closely with Product, Data Science, Data Platform, and Governance teams to build reusable abstractions and deliver high‑impact features across our pillars: Off‑platform, Data collaboration (cleanrooms), Ads Taxonomy, Platform, and New Initiatives (AI). You will mentor L4/L5 engineers, act as an IC tech lead (no direct reports), and help define a future on‑call model and SLOs.

• Technical leadership and roadmap
  • Lead architecture for reusable, scalable systems across off‑platform workflows, cleanrooms, taxonomy automation, and the Ads Data Solutions Platform.
  • Evolve core abstractions, testing, CI/CD, observability, and cost efficiency; proactively drive modernization.
  • Propose and drive initiatives on behalf of engineering management; align stakeholders and manage dependencies.
• Pillar execution
  • Off‑platform: expand and harden integrations with external advertising platforms; design privacy-forward activation and identity workflows; reduce reliance on third‑party intermediaries; and build measurement ingestion pipelines for performance signals such as reach, frequency, and conversions.
  • Data collaboration (cleanrooms): extend our cleanroom orchestration and governance tooling (multi-cleanroom support, policy enforcement), develop reusable query templates and partner configurations, optimize pipelines for cost and performance, and scale secure data collaboration deployment and management.
  • Ads Taxonomy: lead intake automation (UI + backend) and release workflow improvements to reduce manual effort and cycle time.
  • Platform: assist with platform modernization and developer tooling improvements; contribute to an on‑call/SLO strategy as we mature operations.
• AI‑first engineering
  • Use AI‑assisted tools daily for design, coding, tests, and docs; define team prompt patterns and workflows; identify AI opportunities in internal tools and ops.
• Product quality, privacy, and security
  • Translate ambiguous requirements into pragmatic phases (POC, pilot, production) with clear SLAs/SLOs.
  • Champion security‑by‑design, data governance, and privacy compliance (e.g., GDPR/CCPA) across pipelines.
• Mentorship and collaboration
  • Mentor engineers up to L5; set code quality and review standards.
  • Build cross‑team partnerships (Ads Manager, Measurement Science, Data Platform, Privacy/Legal, and external platforms).

Minimum Qualifications

• Proven senior‑level impact
  • 8+ years of software engineering experience (typically 10+ for this level) delivering and operating large‑scale backend/data systems; led cross‑team projects and architectural decisions.
• Backend and data engineering
  • Strong in Python and one of Ruby or Go; services/APIs (REST/gRPC); integrations with third‑party APIs (e.g., Meta, Google, The Trade Desk).
  • Data pipelines with DBT and Airflow; Spark/Databricks; advanced SQL and performance tuning.
  • Snowflake and AWS experience; cost‑aware design; workflow orchestration (e.g., Temporal) and event‑driven patterns.
• Ads/cleanrooms/privacy
  • Experience with ad‑tech/programmatic and measurement integrations; cleanrooms (Snowflake DCR, shares/listings); identity/matching (UID2, RampID) and deconfliction.
  • Working knowledge of privacy and compliance practices (GDPR/CCPA) in data workflows.
• Platform excellence
  • CI/CD, containers, test strategy; observability (metrics/logs/tracing) with tools like Datadog; incident readiness and SLO thinking.
• AI fluency (must‑have)
  • Demonstrated, recent hands‑on use of AI‑assisted development tools (e.g., GitHub Copilot, Cursor, OpenAI‑based assistants) to improve speed and quality.
  • Experience defining reusable prompts/workflows for team use and contributing to AI‑enabled internal tools or automation.
  • Ability to evaluate when to apply AI vs. deterministic systems; familiarity with evaluation, guardrails, and security/privacy implications in AI usage.
• Collaboration and communication
  • Clear technical writing; stakeholder management; ability to drive consensus and unblock execution.

Preferred Qualifications

• Direct experience with UID2/TTD integrations, Roku/Pubmatic/NBCU, or Meta Advanced Analytics/Google ADH pipelines.
• Catalog/taxonomy, entity lineage, or custom hierarchy systems.
• Snowflake governance patterns, partner data collaboration at scale.
• Vendor/partner management and external API certification programs.
• Building AI‑powered internal tools (e.g., Slackbots, data assistants).

Why this role is a great opportunity....

• Lead foundational, high‑visibility initiatives and translate them into measurable impact on revenue, efficiency, and partner adoption.
• Co‑own the technical roadmap with scope to define abstractions, standards, and AI‑first workflows across multiple pillars.
• Ship impactful features end‑to‑end: direct UID2 activation, Share Manager extensions, taxonomy intake automation, and platform modernization.
• Collaborate with strong cross‑functional partners and enjoy occasional trips to our Toronto office to connect with the broader engineering community.
• Help define our future on‑call model and operational excellence standards as we scale.

#LI-Remote

Instacart provides highly market-competitive compensation and benefits in each location where our employees work. This role is remote and the base pay range for a successful candidate is dependent on their permanent work location. Please review our Flex First remote work policy here. Offers may vary based on many factors, such as candidate experience and skills required for the role. Additionally, this role is eligible for a new hire equity grant as well as annual refresh grants. Please read more about our benefits offerings here. For US based candidates, the base pay ranges for a successful candidate are listed below.

CA, NY, CT, NJ

$230,000 — $242,500 USD

WA

$220,000 — $232,000 USD

OR, DE, ME, MA, MD, NH, RI, VT, DC, PA, VA, CO, TX, IL, HI

$211,000 — $222,500 USD

All other states

$192,000 — $202,500 USD