Principal AI Architect

Fractal; California; On-site; USD 150,000 - 170,000; Full time

Benefits offered by this job

Health, dental, vision, life and disab

401(k) after 30 days

11 paid holidays

12 weeks parental leave

Free time PTO

Job summary

Fractal Analytics in the United States is seeking a Principal AI Architect to lead production GenAI and LLM systems, with emphasis on scalable architectures and data-driven decision support.

You will design multi-agent and RAG pipelines, work in fast-moving environments, and collaborate with data science and backend teams. Strong Python and containerized deployments are essential.

US-based; PST/MST timezone preferred (Sunnyvale / Bay Area). Master’s degree or higher preferred.

Qualifications

• 8+ years of overall experience with a minimum of 4 years in production GenAI / LLM systems (shipped, maintained, and scaled - not prototype or research)
• Deep expertise in LLM orchestration frameworks - LangChain, LangGraph, LlamaIndex, or equivalent agentic systems
• Proven track record designing and deploying RAG pipelines, multi-agent architectures, and LLM-powered analytics or decision-support workflows
• Strong Python proficiency; solid backend engineering fundamentals including REST API design, async patterns, and containerized deployment
• Sufficient fluency in data science, ML, and BI concepts to reason about analytical accuracy, data quality, and the reliability of model outputs

Responsibilities

• Lead design and deployment of GenAI/LLM systems in production environments
• Architect multi-agent and RAG pipelines for decision-support workflows
• Evaluate trade-offs and ensure modular, defensible system designs
• Collaborate with data scientists and engineers to ensure analytical reliability

Skills

LLM orchestration

RAG pipelines

Multi-agent architectures

Python

API design

Data science concepts

First-principles thinking

Education

Master's degree or higher

Tools

LangChain

LangGraph

LlamaIndex

LangSmith

MLflow

Weights and Biases

Job description

It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.

Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets; an ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite is the one who empowers imagination with intelligence. Fractal has been featured as a Great Place to Work by The Economic Times in partnership with the Great Place to Work® Institute and recognized as a 'Cool Vendor' and a 'Vendor to Watch' by Gartner.

Please visit Fractal | Intelligence for Imagination for more information about Fractal.

Job Title: Principal AI Architect

Key Responsibilities

• 8+ years of overall experience with a minimum of 4 years in production GenAI / LLM systems (shipped, maintained, and scaled - not prototype or research)
• Deep expertise in LLM orchestration frameworks - LangChain, LangGraph, LlamaIndex, or equivalent agentic systems
• Proven track record designing and deploying RAG pipelines, multi-agent architectures, and LLM-powered analytics or decision-support workflows
• Strong Python proficiency; solid backend engineering fundamentals including REST API design, async patterns, and containerized deployment
• Sufficient fluency in data science, ML, and BI concepts to reason about analytical accuracy, data quality, and the reliability of model outputs
• Demonstrated ability to work in fast-moving, ambiguous environments where requirements evolve and scope is not always fixed at the start
• Strong first-principles thinking - able to evaluate trade-offs, challenge assumptions, and design systems that are defensible and modular
• US-based; PST or MST timezone required (Sunnyvale / Bay Area strongly preferred)
• Master's degree or higher in Computer Science, Artificial Intelligence, Data Science, or a related technical field preferred

Preferred Qualifications

• Hands-on experience with Model Context Protocol (MCP) or building on agent-native enterprise platforms
• Background in analytics, BI, or data product development - understanding the domain where AI meets enterprise reporting and decision-making
• Prior experience in a consulting or client-embedded delivery model, operating in matrixed organizations with distributed teams
• Certifications in LLM or cloud AI platforms (AWS Bedrock, Azure OpenAI, Anthropic / Claude, Google Vertex AI, etc.)
• Experience with LLMOps tooling - LangSmith, MLflow, Weights and Biases, or equivalent

Why Join Fractal Analytics?

Opportunity to work on impactful projects and develop scalable solutions for our clients which are some of the world's most valuable companies

Learn and grow with a diverse, high-performing team building cutting edge AI, ML and Engineering solutions

Competitive compensation and benefits, with opportunities for professional growth and development.

Pay

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is: $150,000 to $170,000 Yearly. In addition, you may be eligible for a discretionary bonus for the current performance period.

Benefits

As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plan in accordance with the plan documents, which may be amended from time to time. You will be eligible for benefits on the first day of employment with the Company. In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms. The Company provides 11 paid holidays and 12 weeks of Parental Leave. We also follow a "free time" PTO policy, allowing you the flexibility to take the time needed for either sick time or vacation.

Fractal provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Hiring Related Queries

India: [e-mail]

Outside India: [e-mail]