Prompt Architect: AI Context & RAG Systems

BayOne Solutions; Mountain View (CA); On-site; USD 130,000 - 180,000; Full time

Job summary

BayOne Solutions in Mountain View, CA seeks an innovative Context / Prompt Engineer to bridge LLM capabilities with business applications. You will design, optimize, and maintain system prompts, context pipelines, and RAG architectures to ensure accurate and instruction-aligned outputs.

You will collaborate with Data/ML engineers and Product Managers to integrate prompts into core APIs, and help prepare datasets for fine-tuning. This is a long-term contract role on-site in Mountain View.

Qualifications

• Deep understanding of LLMs, context limits, and model behavior.
• Experience building evals, benchmarks, and testing pipelines.
• Ability to craft precise, instruction-aligned prompts.
• Excellent written English with clear technical exposition.

Responsibilities

• Design, test, and refine system prompts and context windows.
• Optimize context retrieval and injection for RAG workflows.
• Establish evals/benchmarks and monitoring pipelines.
• Implement guardrails and safety measures against prompts risks.
• Collaborate with Data/ML engineers and product managers.
• Assist in model fine-tuning and data preparation.

Skills

LLM Expertise

Prompting Mastery

Python

AI Frameworks

Eval Frameworks

Structured Thinking

Tools

LangChain

LlamaIndex

LiteLLM

Guidance

Job description

BayOne Solutions in Mountain View, CA seeks an innovative Context / Prompt Engineer to bridge LLM capabilities with business applications. You will design, optimize, and maintain system prompts, context pipelines, and RAG architectures to ensure accurate and instruction-aligned outputs.

You will collaborate with Data/ML engineers and Product Managers to integrate prompts into core APIs, and help prepare datasets for fine-tuning. This is a long-term contract role on-site in Mountain View.