Sr. AI Engineer

MemVerge, Inc.; Milpitas (CA); On-site; USD 170,000 - 250,000; Full time

Job summary

MemVerge, Inc. is seeking a Senior AI Engineer to lead architecture and development of MemoryBox’s AI systems. You will tackle LLMs, AI agents, RAG, long-term memory, and personalization while shaping technical direction and turning research into scalable products.

This hands-on role requires strong software engineering experience and leadership to mentor engineers across the team. You will drive production-quality AI systems with a focus on accuracy, performance, and reliability.

Qualifications

• Extensive experience building and shipping production AI/ML and LLM systems.
• Deep expertise in LLMs, RAG, agents, embeddings, semantic search, memory, personalization, and evaluation.
• Strong programming skills in Python, Rust, and/or Go.
• Proficient use of AI coding agents as part of the development, testing, and shipping workflow.
• Strong foundation in distributed systems, cloud infrastructure, data pipelines, and production AI frameworks.
• Proven ability to lead complex technical initiatives, make architectural tradeoffs, and mentor engineers.

Responsibilities

• Lead the architecture and development of MemoryBox’s LLM and AI systems.
• Build persistent AI memory, RAG, semantic search, personalization, and agentic workflows.
• Develop and optimize AI systems for accuracy, performance, scalability, and reliability.
• Turn emerging AI research into production-ready capabilities and help shape the technical roadmap.
• Provide technical leadership and mentor engineers across the team.

Skills

AI/ML systems

LLMs

RAG

Agents

Personalization

Distributed systems

Cloud infrastructure

Python

Rust

Go

Embeddings

Semantic search

GPU inference

Model serving

Tools

Embeddings

Semantic search

GPU inference

Model serving

Job description

MemVerge is building next-generation AI infrastructure and personal AI software. Our MemoryBox platform gives AI systems persistent, portable, and user-controlled memory across applications, conversations, and AI models.

We are seeking a Sr. AI Engineer to lead the architecture and development of MemoryBox’s AI systems. This hands-on role will tackle LLMs, AI agents, RAG, long-term memory, and personalization, while helping shape our technical direction and turn emerging AI capabilities into scalable products. It's critical that you have strong software engineering experience as well.

What You'll Do

• Lead the architecture and development of MemoryBox’s LLM and AI systems.
• Build persistent AI memory, RAG, semantic search, personalization, and agentic workflows.
• Develop and optimize AI systems for accuracy, performance, scalability, and reliability.
• Turn emerging AI research into production-ready capabilities and help shape the technical roadmap.
• Provide technical leadership and mentor engineers across the team.

What We're Looking For

• Extensive experience building and shipping production AI/ML and LLM systems.
• Deep expertise in LLMs, RAG, agents, embeddings, semantic search, memory, personalization, and evaluation.
• Strong programming skills in Python, Rust, and/or Go.
• Proficient use of AI coding agents is required as part of the development, testing, and shipping workflow.
• Strong foundation in distributed systems, cloud infrastructure, data pipelines, and production AI frameworks.
• Proven ability to lead complex technical initiatives, make architectural tradeoffs, and mentor engineers.
• Experience with frontier or open-source LLMs, model serving, GPU/distributed inference, high-performance AI systems, privacy-preserving AI, relevant research or open-source contributions, or building products in fast-moving startup environments preferred.