Generative AI Engineer

Fractal; Sunnyvale (CA); On-site; USD 140,000 - 150,000; Full time

Job summary

An innovative firm is seeking a GenAI Data Scientist to drive the development of cutting-edge AI applications. This role focuses on building production-grade Large Language Model (LLM) solutions, including chatbots and contextual assistants, to transform enterprise decision-making. The ideal candidate will possess deep technical expertise in LLM architecture and a strong understanding of NLP techniques. Join a dynamic team dedicated to empowering imagination with intelligence while working on impactful projects for Fortune 500 clients. This is a unique opportunity to grow in a collaborative environment that values creativity and technical excellence.

Benefits

Health Insurance

Dental Insurance

Vision Insurance

Life Insurance

Disability Insurance

401(k) Plan

Paid Holidays

Parental Leave

Flexible PTO Policy

Qualifications

• Hands-on expertise in building production-grade LLM applications.
• Strong foundation in LLM architecture and fine-tuning.
• Experience with cloud platforms and MLOps practices.

Responsibilities

• Design and develop LLM-powered applications like chatbots and search engines.
• Integrate AI assistants with internal systems for multi-step reasoning.
• Evaluate emerging GenAI tools and frameworks for scalable architectures.

Skills

Large Language Models (LLMs)

Python

Machine Learning Libraries (PyTorch, TensorFlow)

Natural Language Processing (NLP)

Cloud Platforms (AWS, GCP, Azure)

MLOps Practices

Agent-Based Architectures

Retrieval-Augmented Generation (RAG)

Education

Master’s/PhD in Computer Science

Bachelor’s in AI or Data Science

Tools

LangChain

Vertex AI

Docker

Kubernetes

Job description

Get AI-powered advice on this job and more exclusive features.

This range is provided by Fractal. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$140,000.00/yr - $150,000.00/yr

Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets. An ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite is the one who empowers imagination with intelligence. Fractal has been featured as a Great Place to Work by The Economic Times in partnership with the Great Place to Work Institute and recognized as a ‘Cool Vendor’ and a ‘Vendor to Watch’ by Gartner.

Please visit Fractal | Intelligence for Imagination for more information about Fractal

Position Overview:

Fractal Analytics is seeking a GenAI Data Scientist with hands-on expertise in building production-grade Large Language Model (LLM)-powered applications such as agentic chatbots, semantic search engines, and contextual assistants. The ideal candidate will be deeply technical with a strong foundation in LLM architecture and fine-tuning, strong understanding of Foundation Model capabilities, RAG design and performance evaluation frameworks. This role is central to driving the development of innovative generative AI experiences that empower users and transform enterprise decision-making.

Key Responsibilities

LLM-based Solution Development

• Design and develop LLM-powered applications such as agentic chatbots, smart search, contextual recommendation systems, and document summarizers.
• Fine-tune open-source and proprietary foundation models (e.g., Gemini, LLaMA, Other proprietary) for domain-specific tasks using best practices.
• Implement advanced Retrieval-Augmented Generation (RAG) design for enterprise-grade knowledge access.
• Integrate AI assistants with internal systems and APIs for multi-step reasoning and tool usage.

Technical Innovation & Applied Research

• Evaluate emerging GenAI tools and frameworks and incorporate them into scalable architectures.
• Experiment with techniques like few-shot learning, prompt tuning, instruction tuning, and tool use (e.g., LangChain, LlamaIndex).
• Contribute to IP and internal assets for reusable components and accelerators.
• Design robust benchmarking and evaluation pipelines for LLM outputs (e.g., factual accuracy, hallucination rates, usefulness).
• Ensure responsible AI practices—bias detection, safety constraints, and interpretability.
• Collaborate with AI Governance and MLOps teams to ensure scalable and auditable deployments.
• Work closely with solution architects, UI engineers, and domain experts to define end-to-end product flows.
• Translate business requirements into technical blueprints and iterate through prototypes to production.
• Provide technical mentorship to junior data scientists and AI engineers.

Required Qualifications & Skills

Generative AI Expertise

• Strong experience working with LLMs (e.g., GPT-4, Gemini, Claude) and frameworks such as LangChain, Vertex AI, LangGraph, Autogen.
• Experience implementing agent-based architectures for autonomous task execution.
• Solid grounding in NLP techniques including embeddings, vector databases, AI agents, QnA systems.
• Proficiency in Python and ML libraries like PyTorch, TensorFlow, scikit-learn.
• Experience with cloud platforms (AWS, GCP, or Azure) and containerization (Docker, Kubernetes).
• Familiarity with MLOps practices and tools for model deployment and monitoring.

Business Acumen & Communication

• Ability to understand user pain points and propose intuitive AI solutions.
• Strong problem-solving and communication skills to work across technical and business stakeholders.
• Proven track record of delivering scalable GenAI solutions in enterprise environments.

Preferred Qualifications

• Master’s/PhD in Computer Science, AI, Data Science, or a related field.
• Experience deploying GenAI solutions in a B2B enterprise or consulting environment.
• Familiarity with Agentic solutions and advanced RAG techniques.

Why Join Fractal Analytics?

• Opportunity to work on impactful projects and develop scalable solutions for our clients which are some of the world’s most valuable companies
• Learn and grow with a diverse, high-performing team building cutting edge AI, ML and Engineering solutions
• Competitive compensation and benefits, with opportunities for professional growth and development.

As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time. You will be eligible for benefits on the first day of employment with the Company. In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms. The Company provides for 11 paid holidays and 12 weeks of Parental Leave. We also follow a “free time” PTO policy, allowing you the flexibility to take the time needed for either sick time or vacation.

Fractal provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Business Consulting and Services

Referrals increase your chances of interviewing at Fractal by 2x

Get notified about new Generative AI Engineer jobs in Sunnyvale, CA.

Software Engineer 4 - TV & Web Player Platform

Software Engineer I (Full Time) United States

San Jose, CA $98,600.00-$125,900.00 3 weeks ago

Software Engineer, AI Platform - New Grad

Sunnyvale, CA $56.25-$173,000.00 4 days ago

New Grads 2025 - Software Engineer, Algorithm

San Jose, CA $120,000.00-$165,000.00 7 months ago

Sunnyvale, CA $117,000.00-$234,000.00 1 week ago

eCommerce Full Stack Developer (React / Shopify) - On Site

New Grads 2025 - General Software Engineer

San Jose, CA $120,000.00-$165,000.00 3 months ago

Jr. Software Development Engineer - Sunnyvale, CA

San Jose, CA $113,400.00-$206,300.00 10 hours ago

Full Stack Software Engineer - Post-training

Palo Alto, CA $180,000.00-$440,000.00 2 weeks ago

Palo Alto, CA $140,000.00-$185,000.00 2 weeks ago

Frontend Software Engineer - University Graduate 2025

San Mateo, CA $120,000.00-$280,000.00 6 days ago

(General Hire) Software Engineer Graduate (Advertisement Team) - 2025 Start (BS/MS)

San Jose, CA $113,500.00-$250,000.00 4 days ago

San Jose, CA $113,400.00-$206,300.00 4 days ago

San Jose, CA $113,400.00-$206,300.00 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.