Senior Software Engineer, AI Systems & Foundations (Remote)

OpenKrill; United States; Remote; USD 192,000 - 243,000; Full time

Benefits offered by this job

Equity grant

Annual refresh grants

Flex First remote work policy

Job summary

Instacart is hiring a Senior Software Engineer for AI Labs & Foundations to design, build, and operate high-scale production AI systems that power Cart Assistant, voice AI, and more. You will own projects end-to-end, from requirements and design to deployment and observability, collaborating with product, data science, and infrastructure teams.

You will contribute hands-on to AI-native products, leverage tools like embedding infrastructure, vector search, and RAG, and help define best practices

Qualifications

• Proven senior software engineer with experience building, shipping, and operating production systems at scale.
• Hands-on experience with AI or ML in production and integrating foundation model APIs into live products.
• Experience owning services end-to-end including CI/CD, automated testing, observability, and on-call participation.
• Strong ability to communicate across disciplines and drive to the right answer.

Responsibilities

• Design, build, and operate production AI-powered systems and agentic experiences (Cart Assistant, voice AI) impacting millions of shoppers.
• Develop foundational AI infrastructure from embedding infrastructure to client-facing components.
• Integrate foundation models via APIs and open-source frameworks; apply retrieval-augmented generation and vector search where applicable.
• Own projects end-to-end: requirements, design, implementation, testing, deployment, observability, and iterative improvement for reliability and cost efficiency.
• Collaborate with product, design, data science, and infrastructure to ship AI features end-to-end.
• Promote best practices for AI/ML production engineering and provide technical leadership across the team.

Skills

Go

Python

TypeScript

Strong communication

Production ML experience

CI/CD

Observability

Tools

Docker

Kubernetes

Kafka

Pinecone

Weaviate

FAISS

Elasticsearch

Job description

Instacart is hiring a Senior Software Engineer for AI Labs & Foundations to design, build, and operate high-scale production AI systems that power Cart Assistant, voice AI, and more. You will own projects end-to-end, from requirements and design to deployment and observability, collaborating with product, data science, and infrastructure teams.

You will contribute hands-on to AI-native products, leverage tools like embedding infrastructure, vector search, and RAG, and help define best practices