Senior AI Architect & Production Systems Lead

Robots and Pencils; United States; Remote; USD 180,000 - 280,000; Full time

Benefits offered by this job

20 days paid vacation

15 days unpaid vacation

All official public holidays off

5 paid sick days without a doctor’s证?

Medical insurance

Military draft deferment (reservation)

Job summary

Robots & Pencils is seeking a Principal AI Engineer to define and drive the technical direction of our AI/ML systems, leading architecture across the organization. You will shape the AI roadmap, solve complex integration challenges, and collaborate with leadership to scale AI work for clients.

You will mentor engineers, ensure production-grade reliability and security, and partner with product and data teams to deliver scalable AI solutions using AWS GenAI, Docker, Kubernetes, and modern tooling.

Qualifications

• 9+ years of professional software engineering experience with 5+ years focused on AI/ML systems in production.
• Strong software engineering background (Python or similar) with design sensibilities for distributed, scalable systems.
• Deep experience designing distributed systems and event-driven architectures for production AI workloads.
• Extensive cloud experience, especially AWS GenAI offerings.
• Proven track record shipping complex AI systems across multiple teams.
• Expertise with AI frameworks, orchestration tools, and observability for LLM apps.

Responsibilities

• Define AI architecture and technical strategy, leading end-to-end implementation from design to production.
• Build scalable ML platforms, pipelines, and workflow orchestration for model development at scale.
• Architect and build LLM-powered systems, including prompt engineering, function/tool calling, multi-agent orchestration, and retrieval techniques.
• Design and develop APIs and backend services that integrate AI into enterprise systems.
• Lead model development from research to production, ensuring production-ready results.
• Ensure AI reliability, security, and scalability with robust logging, monitoring and debugging.
• Mentor engineers, champion AI engineering standards, and drive technical vision across the organization.

Job description

Robots & Pencils is seeking a Principal AI Engineer to define and drive the technical direction of our AI/ML systems, leading architecture across the organization. You will shape the AI roadmap, solve complex integration challenges, and collaborate with leadership to scale AI work for clients.

You will mentor engineers, ensure production-grade reliability and security, and partner with product and data teams to deliver scalable AI solutions using AWS GenAI, Docker, Kubernetes, and modern tooling.