Principal GenAI Architect

Fractal; Sunnyvale (CA); On-site; USD 185,000 - 230,000; Full time

Benefits offered by this job

Health insurance

401(k) plan

Parental leave

Paid holidays

Job summary

Fractal is seeking a hands‑on technical lead for a GenAI product, responsible for architecting and shipping production systems at the intersection of LLMs and enterprise analytics. You willDirectly guide a distributed engineering team, own delivery quality, and set technical direction in a builder's role.

You will design end‑to‑end GenAI pipelines, manage LLM orchestration, retrieval, and analytics delivery, and prototype rapidly to evolve concepts into scalable production systems.

Qualifications

• 8+ years engineering experience with 4+ years building production GenAI/LLM systems.
• Proven record of building RAG pipelines and agentic workflows with measurable outcomes.
• Strong Python skills, backend fundamentals, REST and streaming APIs, and containerized deployment (Docker/Kubernetes).

Responsibilities

• Design, build, and ship production GenAI systems end to end, hands-on in codebase.
• Own architecture across LLM orchestration, retrieval, agentic workflows, analytics delivery.
• Prototype rapidly and harden approaches into production‑ready systems.

Skills

Python

Docker

Kubernetes

LangChain

LangGraph

LLM patterns

REST APIs

Streaming APIs

Education

Bachelor's degree

Master's degree

Tools

LangGraph

LangChain

LlamaIndex

CrewAI

OpenAI/Anthropic SDKs

LangSmith

Job description

Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets. An ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite is the one who empowers imagination with intelligence. Fractal has been featured as a Great Place to Work by The Economic Times in partnership with the Great Place to Work® Institute and recognized as a ‘Cool Vendor’ and a ‘Vendor to Watch’ by Gartner.

Please visit Fractal | Intelligence for more information about Fractal

Role Overview:

You will be the hands‑on technical lead for a GenAI product at the intersection of large language models and enterprise analytics. This is a builder's role. You will personally architect and ship production systems, own delivery quality, and set technical direction for a distributed engineering team. This is not an advisory or architecture-only position.

Key Responsibilities

• Design, build, and ship production GenAI systems end to end. Remain hands‑on in the codebase rather than directing from a distance.
• Own the architecture across LLM orchestration, retrieval, agentic workflows, evaluation, and the analytics delivery layer.
• Rapidly prototype against evolving requirements and harden successful approaches into production‑ready systems.

Technical Leadership & Quality

• Set technical direction for a distributed offshore engineering team and own the quality of what ships.
• Establish evaluation, observability, and guardrails so system quality is measurable and defensible.

Required Experience

Production GenAI & Agentic Systems

• 8+ years of overall engineering experience, including 4+ years of hands‑on experience building, shipping, scaling, and maintaining production GenAI or LLM systems. Experience limited to prototypes, proofs of concept, or research is not sufficient.
• Demonstrated record of personally building RAG pipelines, multi‑agent or agentic systems, and LLM‑powered analytics or decision‑support workflows, with concrete and quantified outcomes.
• Deep hands‑on expertise with agent orchestration frameworks such as LangGraph, LangChain, LlamaIndex, CrewAI, or the OpenAI or Anthropic agent SDKs.
• Practical experience with modern GenAI patterns, including tool or function calling, structured outputs, hybrid and agentic retrieval, context engineering, prompt and evaluation optimization, and multi‑agent coordination.
• Hands‑on experience using agentic coding harnesses and AI‑assisted development tools such as Claude Code, Cursor, or equivalent as part of the build workflow.
• Strong Python skills and solid backend engineering fundamentals, including REST and streaming API design, asynchronous patterns, and containerized deployment with Docker and Kubernetes.
• Production experience with LLM evaluation and observability, including offline and online evaluations, tracing, hallucination measurement, and quality measurement using RAGAS, LangSmith, or equivalent tools.
• Sufficient fluency in data science, machine learning, and business intelligence to reason about analytical accuracy, data quality, and output reliability.

Leadership, Education & Location

• Proven ability to operate in fast‑moving, ambiguous environments where scope evolves.
• Strong first‑principles thinking, with the ability to evaluate trade‑offs, challenge assumptions, and design modular and defensible systems.
• US‑based; PST or MST timezone required. Sunnyvale or the Bay Area is strongly preferred.
• Bachelor's degree required. Master's degree in computer science, artificial intelligence, machine learning, or a related technical field preferred.

Preferred Experience

• Hands‑on experience with Model Context Protocol (MCP) or agent‑native enterprise platforms.
• Experience building and orchestrating custom agents, tools, and harnesses beyond off‑the‑shelf usage.
• Background in analytics, business intelligence, or data products where AI intersects with enterprise reporting and decision‑making.
• Experience with Text‑to‑SQL or natural‑language‑to‑analytics systems.
• Consulting or client‑embedded delivery experience in matrixed organizations with distributed teams.
• Certifications across LLM or cloud AI platforms such as AWS Bedrock, Azure OpenAI, Anthropic Claude, or Google Vertex AI.
• Experience with LLMOps tooling such as LangSmith, MLflow, Weights & Biases, or equivalent.

Pay:

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the starting base salary for this role is $185,000, with the potential for a higher base depending on experience, skills, and overall fit for the position. This role is also eligible for a performance-based bonus tied to achieving sales goals related to new client acquisition and project growth.

As a full‑time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time. You will be eligible for benefits on the first day of employment with the Company. In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms. The Company provides for 11 paid holidays and 12 weeks of Parental Leave. We also follow a “free time” PTO policy, allowing you the flexibility to take the time needed for either sick time or vacation.

Fractal provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.