Staff Software Engineer, Core AI

Jobtailor; San Jose (CA); On-site; USD 170,000 - 250,000; Full time

Job summary

Jobtailor is hiring an Architect and technical lead to develop production AI products such as intelligent chatbots and document processing systems. You will design a centralized AI platform with model routing, provider management, vector search, and MCP integrations, while building scalable integrations across systems.

The role requires hands-on leadership, deep Python expertise, and substantial experience with AI application frameworks, cloud-native design, and complex data integrations.

Qualifications

• 10+ years of professional software engineering experience.
• 4+ years focused on building backend for production applications.
• Mastery of Python and familiarity with AI application frameworks.

Responsibilities

• Architect and lead development of production AI products, including intelligent chatbots and document processing systems.
• Design and implement a centralized AI platform with model routing, provider management, vector search, and MCP integrations.
• Build scalable AI products integrating accounting systems, document repositories, and external APIs.
• Maintain robust monitoring and observability; ensure governance and compliance.

Skills

Python Mastery

AI Frameworks

Scalable System Design

LLM APIs Experience

AWS Proficiency

Context Engineering

Tools

AWS

Job description

• Architect and lead development of production AI products, including intelligent chatbots, document processing systems, and agentic workflows
• Design and implement a centralized AI platform with model routing, provider management, vector search, AI application frameworks, and MCP integrations
• Build scalable AI products integrating accounting systems, document repositories, and external APIs
• Maintain robust monitoring and observability
• Apply context engineering and system design for information retrieval, context assembly, and multi-turn conversation management
• Collaborate with Product, Engineering, and Security teams on robust, compliant AI products
• Provide technical leadership and mentorship to the AI team
• Establish best practices for AI product development, deployment, and governance

Requirements

• 10+ years of professional software engineering experience
• 4+ years focused on building backend for production applications
• Mastery of Python
• Familiarity with AI application frameworks, context engineering, and scalable system design for AI products
• Expertise in designing products integrating multiple technologies, APIs, and data sources in cloud-native environments
• AWS preferred
• Hands-on experience with LLM APIs, retrieval-augmented generation (RAG), conversational AI, document processing, and MCP integrations
• Proven ability to lead technical product initiatives, establish technical standards, and communicate complex system designs to technical and business stakeholders

Core Competencies

Demonstrates expertise in architecting and leading the development of AI products, with a strong focus on scalable system design, integration of multiple technologies, and technical leadership. Proficient in Python and familiar with AI application frameworks, ensuring robust and compliant AI solutions.

Highest-signal resume keywords

• Python Mastery
• AI Application Frameworks
• Scalable System Design
• LLM APIs Experience
• AWS Proficiency

Hard Skills

• Software Engineering
• Backend Development
• Context Engineering
• Document Processing
• Multi-Turn Conversation Management
• Model Routing
• Provider Management
• Vector Search
• MCP Integrations
• API Integration

Soft Skills

• Technical Leadership
• Mentorship
• Collaboration
• Communication

Industry Keywords

• AI Products
• Conversational AI
• Retrieval-Augmented Generation
• Compliance
• Best Practices

Tools & Technologies

• Cloud-Native Environments
• AI Products
• Monitoring Tools
• Observability Tools