Senior AI Architect: Drive Enterprise AI & MLOps

Engg; Palo Alto (CA); On-site; USD 180,000 - 250,000; Full time

Job summary

Rubrik IT is seeking an AI Architect to lead design and deployment of AI-native solutions that bridge business problems and AI execution. You will shape scalable architectures, advocate for secure, observable systems, and mentor a growing team of AI/ML engineers in Palo Alto.

Ideal candidates have a decade in software architecture, strong GenAI expertise, and hands-on experience with enterprise AI platforms and data ecosystems.

Qualifications

• 10+ years of core Software/Systems Engineering architecture experience.
• Bachelor's degree in Computer Science, Engineering, or related field; Masters/PhD a plus.
• Hands-on experience with Generative AI technologies, including LLMs, RAG, context graphs, memory management, and agentic AI architectures.
• Strong programming skills in Python, Java, or Go.
• Deep proficiency with GenAI orchestration frameworks (e.g., LangGraph, LlamaIndex, AutoGen, Semantic Kernel) and knowledge of ML frameworks (PyTorch, TensorFlow).
• Experience with vector databases (Pinecone, Weaviate) and graph databases (Neo4j).
• Experience with distributed systems architecture, event-driven streaming, and cloud AI/ML platforms (GCP Vertex AI, AWS SageMaker, Azure OpenAI).
• Understanding of security principles in AI systems (prompt injection, data exfiltration, RBAC).
• Experience in enterprise environments with privacy/compliance constraints.
• Visible contributions to open-source AI projects or related publications.

Responsibilities

• Lead applied AI solution design and architecture, turning ambiguous problems into concrete AI designs.
• Contribute to large-scale, distributed AI/ML system designs for performance, reliability, and security.
• Design and improve retrieval, prompting, tool-calling, and orchestration patterns for internal AI use cases.
• Enforce design standards and best practices for scalable AI development across teams.
• Drive hands-on development of AI components and model deployment workflows.
• Build and deploy AI-enabled internal workflows connecting systems, data, models, and automation.
• Audit AI-generated code for reliability, security, and observability.
• Lead MLOps pipelines with training, versioning, deployment, and monitoring.
• Develop evaluation methods for output quality, latency, and failure modes.
• Identify human review and escalation needs for responsible AI deployment.
• Collaborate with executives, data science, engineering, and product teams to translate business use-cases into scalable AI solutions.
• Provide technical leadership and mentorship to AI/ML engineers and foster engineering excellence.
• Create reusable components, playbooks, and patterns to speed up delivery across the org.

Skills

Python

Java

Go

GenAI orchestration

Distributed systems

AI security

Education

Bachelor's in CS/Engineering

Tools

LangGraph

LlamaIndex

AutoGen

Semantic Kernel

PyTorch

TensorFlow

Pinecone

Weaviate

Neo4j

LangSmith

Datadog

Job description

Rubrik IT is seeking an AI Architect to lead design and deployment of AI-native solutions that bridge business problems and AI execution. You will shape scalable architectures, advocate for secure, observable systems, and mentor a growing team of AI/ML engineers in Palo Alto.

Ideal candidates have a decade in software architecture, strong GenAI expertise, and hands-on experience with enterprise AI platforms and data ecosystems.