Software Engineer, Model Capabilities - Production AI

Xapply; San Francisco, Northern (CA, KY); Hybrid; USD 255,000 - 300,000; Full time

Job summary

Notion is hiring for a role in the Model Capabilities team to own the model layer, integrate frontier models, and ensure reliable, economical inference at scale. You’ll help Notion adopt new capabilities while collaborating across AI teams to close gaps and push improvements.

You will work on production-grade AI systems, focusing on token economics, streaming, context management, and robust failovers, with an emphasis on observability and cost-aware performance.

Qualifications

• Comfort with a moving frontier: The model landscape changes monthly.
• AI fluency as a practitioner: You use AI tools seriously in your own work and have opinions about where they help and where they don't.
• Production AI systems experience: You've built and operated systems on top of LLM APIs, not just prototyped with them.
• Measurement before conviction: You define what "better" means, test it with data, and are willing to be proven wrong by your own data.
• Cost and performance instincts: You treat latency and dollars as product qualities and weigh them in decisions.

Responsibilities

• Bring new frontier models into production quickly, making them available for our users and our engineers.
• Make inference reliable: better error categorization, self-healing retries, and cross-provider failover.
• Own observability for the model layer, driving down both time to detection and time to fix.
• Build new model-level capabilities and help product teams adopt them.
• Act as connective tissue across Notion's AI teams: find the gaps, unblock people, and make sure fixes land with the right owner.

Skills

Model deployment

LLM APIs

Production AI systems

Observability

Cost optimization

Token economics

Streaming

Job description

Notion is hiring for a role in the Model Capabilities team to own the model layer, integrate frontier models, and ensure reliable, economical inference at scale. You’ll help Notion adopt new capabilities while collaborating across AI teams to close gaps and push improvements.

You will work on production-grade AI systems, focusing on token economics, streaming, context management, and robust failovers, with an emphasis on observability and cost-aware performance.