Senior Software Engineer II, AI Labs & Foundations

OpenKrill; United States; Remote; USD 192,000 - 243,000; Full time

Benefits offered by this job

Equity grant

Annual refresh grants

Flex First remote work policy

Job summary

Instacart is hiring a Senior Software Engineer for AI Labs & Foundations to design, build, and operate high-scale production AI systems that power Cart Assistant, voice AI, and more. You will own projects end-to-end, from requirements and design to deployment and observability, collaborating with product, data science, and infrastructure teams.

You will contribute hands-on to AI-native products, leverage tools like embedding infrastructure, vector search, and RAG, and help define best practices

Qualifications

• Proven senior software engineer with experience building, shipping, and operating production systems at scale.
• Hands-on experience with AI or ML in production and integrating foundation model APIs into live products.
• Experience owning services end-to-end including CI/CD, automated testing, observability, and on-call participation.
• Strong ability to communicate across disciplines and drive to the right answer.

Responsibilities

• Design, build, and operate production AI-powered systems and agentic experiences (Cart Assistant, voice AI) impacting millions of shoppers.
• Develop foundational AI infrastructure from embedding infrastructure to client-facing components.
• Integrate foundation models via APIs and open-source frameworks; apply retrieval-augmented generation and vector search where applicable.
• Own projects end-to-end: requirements, design, implementation, testing, deployment, observability, and iterative improvement for reliability and cost efficiency.
• Collaborate with product, design, data science, and infrastructure to ship AI features end-to-end.
• Promote best practices for AI/ML production engineering and provide technical leadership across the team.

Skills

Go

Python

TypeScript

Strong communication

Production ML experience

CI/CD

Observability

Tools

Docker

Kubernetes

Kafka

Pinecone

Weaviate

FAISS

Elasticsearch

Job description

We're transforming the grocery industry

At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers.

Instacart has become a lifeline for millions of people, and we’re building the team to help push our shopping cart forward. If you’re ready to do the best work of your life, come join our table.

Instacart is a Flex First team

There’s no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work—whether it’s from home, an office, or your favorite coffee shop—while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work.

Overview

Join Instacart's mission to transform grocery shopping through frontier AI. As a Senior Software Engineer on AI Labs & Foundations, you will design, build, and operate the high-scale production systems that power our most ambitious AI experiences—from Cart Assistant, our conversational shopping agent, to voice AI interactions and beyond. This is a high-impact opportunity to work at the intersection of robust software engineering and cutting-edge production AI/ML, directly shaping products used by millions of customers every day.

We are hiring a Senior Software Engineer who will participate in the design and delivery of production AI systems, identify high-leverage technical opportunities, and contribute hands‑on to AI‑native products across Instacart's platform. We value bottom‑up ideas, high engineering quality, and close partnership with Product, Data Science, ML, and Infrastructure teams. If you enjoy inventing, navigating ambiguity, prototyping fast, and turning wild ideas into real, scalable products, this is the team for you.

AI Labs & Foundations sits at the intersection of frontier AI research and production engineering. Our portfolio spans the full stack of AI innovation at Instacart, including building and launching Cart Assistant, pioneering voice AI interactions, and constructing the foundational systems that power these cutting‑edge experiences. We are a fast‑moving, collaborative team that thrives on 0‑to‑1 thinking, shares learnings openly, and ships with urgency by prototyping fast and testing rigorously.

About the Job

• Design, build, and operate production AI-powered systems and agentic experiences (including Cart Assistant and voice AI) that directly impact how millions of customers shop.
• Build foundational systems for cutting‑edge AI experiences, ranging from embedding infrastructure and voice AI pipelines, to client facing components and integrations, by prototyping bold ideas and productizing what works.
• Integrate foundation models via APIs and open‑source frameworks; apply techniques like retrieval‑augmented generation and vector search where appropriate.
• Own projects end‑to‑end: requirements, technical design, implementation, testing, deployment, observability, and iterative improvement focused on reliability, latency, and cost efficiency.
• Collaborate with cross‑functional partners in product, design, data science, and infrastructure to ship AI features end‑to‑end.
• Drive engineering excellence, including thoughtful system design, rigorous code review, and technical leadership that includes defining and promoting best practices for AI/ML production engineering across the team.

About You

Minimum Qualifications:

• Proven senior software engineer who has built, shipped, and operated production systems at scale. You make architectural calls, own what you build, and deliver through ambiguity.
• Hands‑on experience with AI or ML in production. You've shipped LLM-powered features or integrated foundation model APIs into a live product, demonstrating the necessary expertise at the intersection of robust software engineering and deep production ML.
• Experience owning services end‑to‑end, including CI/CD, automated testing, observability (logging, metrics, tracing), and on‑call participation.
• Strong communicator who partners well across disciplines - you want to get to the right answer, not just defend the first one.
• Golang, Python, or Typescript language experience
• Excitement and ability to leverage cutting‑edge development tools, including AI assistance (e.g., Copilot, Cursor, Claude), to maximize velocity.

Preferred Qualifications:

• 5 to 8+ years of industry experience.
• A track record of 0‑to‑1 work taking unconventional ideas from prototype through rapid iteration to production.
• Experience building conversational agents, multi‑turn dialogue systems, or agentic LLM applications.
• Experience with STT/TTS or natural language interfaces, LLM fine tuning, ML transfer learning, model training and the vocabulary of measurement of model performance.
• Experience with embedding systems, vector search, or retrieval‑augmented generation (RAG) with vector databases (e.g., Pinecone, Weaviate, FAISS, or Elasticsearch).
• Experience with cloud platforms (AWS or GCP), containers (Docker), and orchestration (Kubernetes).
• Experience with event‑driven or distributed systems (e.g., Kafka).
• Demonstrated mentorship and technical leadership within cross‑functional teams.

#LI-RemoteInstacart provides highly market-competitive compensation and benefits in each location where our employees work. This role is remote and the base pay range for a successful candidate is dependent on their permanent work location. Please review our Flex First remote work policy here.

Offers may vary based on many factors, such as candidate experience and skills required for the role. Additionally, this role is eligible for a new hire equity grant as well as annual refresh grants. Please read more about our benefits offerings here.

For US based candidates, the base pay ranges for a successful candidate are listed below.

CA, NY, CT, NJ$230,000-$242,500 USD

WA$220,000-$232,000 USD

OR, DE, ME, MA, MD, NH, RI, VT, DC, PA, VA, CO, TX, IL, HI$211,000-$222,500 USD

All other states$192,000-$202,500 USD