Senior GenAI Architect for Production LLMs

Fractal

California

On-site

USD 150,000 - 170,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health, dental, vision, life and disab
401(k) after 30 days
11 paid holidays
12 weeks parental leave
Free time PTO

Job summary

Fractal Analytics in the United States is seeking a Principal AI Architect to lead production GenAI and LLM systems, with emphasis on scalable architectures and data-driven decision support.

You will design multi-agent and RAG pipelines, work in fast-moving environments, and collaborate with data science and backend teams. Strong Python and containerized deployments are essential.

US-based; PST/MST timezone preferred (Sunnyvale / Bay Area). Master’s degree or higher preferred.

Qualifications

  • 8+ years of overall experience with a minimum of 4 years in production GenAI / LLM systems (shipped, maintained, and scaled - not prototype or research)
  • Deep expertise in LLM orchestration frameworks - LangChain, LangGraph, LlamaIndex, or equivalent agentic systems
  • Proven track record designing and deploying RAG pipelines, multi-agent architectures, and LLM-powered analytics or decision-support workflows
  • Strong Python proficiency; solid backend engineering fundamentals including REST API design, async patterns, and containerized deployment
  • Sufficient fluency in data science, ML, and BI concepts to reason about analytical accuracy, data quality, and the reliability of model outputs

Responsibilities

  • Lead design and deployment of GenAI/LLM systems in production environments
  • Architect multi-agent and RAG pipelines for decision-support workflows
  • Evaluate trade-offs and ensure modular, defensible system designs
  • Collaborate with data scientists and engineers to ensure analytical reliability

Skills

LLM orchestration
RAG pipelines
Multi-agent architectures
Python
API design
Data science concepts
First-principles thinking

Education

Master's degree or higher

Tools

LangChain
LangGraph
LlamaIndex
LangSmith
MLflow
Weights and Biases

Job description

We're committed to bringing passion and customer focus to the business.

Key Responsibilities

It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.

Lead GenAI Engineer

Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets. An ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite is the one who empowers imagination with intelligence. Fractal has been featured as a Great Place to Work by The Economic Times in partnership with the Great Place to Work® Institute and recognized as a ‘Cool Vendor’ and a ‘Vendor to Watch’ by Gartner.

Please visit Fractal | Intelligence for Imagination for more information about Fractal

Location: Bay Area, California (Sunnyvale preferred)

Note: This position is not eligible for Immigration Sponsorship at this time.

Role Overview

You will be the hands-on technical lead for a GenAI product at the intersection of large language models and enterprise analytics. This is a builder's role. You will personally architect and ship production systems, own delivery quality, and set technical direction for a distributed engineering team. This is not an advisory or architecture-only position.

Key Responsibilities

Hands-on GenAI Engineering & Delivery

  • Design, build, and ship production GenAI systems end to end. Remain hands-on in the codebase rather than directing from a distance.
  • Own the architecture across LLM orchestration, retrieval, agentic workflows, evaluation, and the analytics delivery layer.
  • Rapidly prototype against evolving requirements and harden successful approaches into production-ready systems.


Technical Leadership & Quality

  • Set technical direction for a distributed offshore engineering team and own the quality of what ships.
  • Establish evaluation, observability, and guardrails so system quality is measurable and defensible.


Required Experience

Production GenAI & Agentic Systems

  • 8+ years of overall engineering experience, including 4+ years of hands-on experience building, shipping, scaling, and maintaining production GenAI or LLM systems. Experience limited to prototypes, proofs of concept, or research is not sufficient.
  • Demonstrated record of personally building RAG pipelines, multi-agent or agentic systems, and LLM-powered analytics or decision-support workflows, with concrete and quantified outcomes.
  • Deep hands-on expertise with agent orchestration frameworks such as LangGraph, LangChain, LlamaIndex, CrewAI, or the OpenAI or Anthropic agent SDKs.
  • Practical experience with modern GenAI patterns, including tool or function calling, structured outputs, hybrid and agentic retrieval, context engineering, prompt and evaluation optimization, and multi-agent coordination.
  • Hands-on experience using agentic coding harnesses and AI-assisted development tools such as Claude Code, Cursor, or equivalent as part of the build workflow.


Backend Engineering, Evaluation & Analytics

  • Strong Python skills and solid backend engineering fundamentals, including REST and streaming API design, asynchronous patterns, and containerized deployment with Docker and Kubernetes.
  • Production experience with LLM evaluation and observability, including offline and online evaluations, tracing, hallucination measurement, and quality measurement using RAGAS, LangSmith, or equivalent tools.
  • Sufficient fluency in data science, machine learning, and business intelligence to reason about analytical accuracy, data quality, and output reliability.


Leadership, Education & Location

  • Proven ability to operate in fast-moving, ambiguous environments where scope evolves.
  • Strong first-principles thinking, with the ability to evaluate trade-offs, challenge assumptions, and design modular and defensible systems.
  • US-based; PST or MST timezone required. Sunnyvale or the Bay Area is strongly preferred.
  • Bachelor's degree required. Master's degree in computer science, artificial intelligence, machine learning, or a related technical field preferred.


Preferred Experience

  • Hands-on experience with Model Context Protocol (MCP) or agent-native enterprise platforms.
  • Experience building and orchestrating custom agents, tools, and harnesses beyond off-the-shelf usage.
  • Background in analytics, business intelligence, or data products where AI intersects with enterprise reporting and decision-making.
  • Experience with Text-to-SQL or natural-language-to-analytics systems.
  • Consulting or client-embedded delivery experience in matrixed organizations with distributed teams.
  • Certifications across LLM or cloud AI platforms such as AWS Bedrock, Azure OpenAI, Anthropic Claude, or Google Vertex AI.
  • Experience with LLMOps tooling such as LangSmith, MLflow, Weights & Biases, or equivalent.


Pay

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions, including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is: Up to $185,000. In addition, you may be eligible for a discretionary bonus for the current performance period.

Benefits

As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time. You will be eligible for benefits on the first day of employment with the Company. In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms. The Company provides for 11 paid holidays and 12 weeks of Parental Leave. We also follow a “free time” PTO policy, allowing you the flexibility to take the time needed for either sick time or vacation.

Fractal provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Not the right fit? Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead GenAI Engineer
Lead GenAI Engineer

Fractal Analytics • California

On-site
USD 111,000 - 185,000
Senior Gen AI Engineer
Senior Gen AI Engineer

Fractal • Massachusetts

On-site
USD 120,000 - 150,000
401(k) Plan
Paid Holidays (11)
Parental Leave (12 weeks)
+1
Principal AI Architect
Principal AI Architect

Fractal • California

On-site
USD 150,000 - 170,000
Health, dental, vision, life and disab
401(k) after 30 days
11 paid holidays
+2
Senior Gen AI Engineer
Senior Gen AI Engineer

Fractal Analytics Inc • Massachusetts

On-site
USD 120,000 - 150,000
Health insurance
401(k) plan with company match
11 paid holidays
+2
Product Architect, Full Stack
Product Architect, Full Stack

Fractal • Seattle (WA)

On-site
USD 125,000 - 170,000
Senior AI/ML Engineer – GenAI, ML Platform & MLOps
Senior AI/ML Engineer – GenAI, ML Platform & MLOps

Fractal • United States

Remote
USD 130,000 - 150,000
Health insurance
Dental insurance
Vision insurance
+6
Lead GenAI Engineer
Lead GenAI Engineer

Fractal • United States

On-site
USD 120,000 - 145,000
Health insurance
Dental insurance
Vision insurance
+6
Full Stack GenAi Engineer
Full Stack GenAi Engineer

Fractal • United States

Remote
USD 130,000 - 160,000
Health insurance
Dental insurance
Vision insurance
+3
Senior Gen AI Engineer
Senior Gen AI Engineer

Fractal Group • Cambridge (MA)

On-site
USD 120,000 - 150,000
Health insurance
Dental insurance
Vision insurance
+6
Growth Leader, AI Engineering, Strategic Accounts
Growth Leader, AI Engineering, Strategic Accounts

Fractal • New York (NY)

On-site
USD 198,000 - 242,000
Health, dental, vision, life, and DIS
401(k) plan
Parental leave
+2