Generative AI Engineer

Insight Global; United States; On-site; USD 96,432 - 110,208; Full time

Benefits offered by this job

Medical, dental, and vision insurance

HSA, FSA, and DCFSA account options

401k retirement account access with employer matching

Paid sick leave and time off

Job summary

A prominent staffing firm is seeking a GenAI Engineer with expertise in operationalizing and monitoring Generative AI applications. This full-time role focuses on leveraging LLMs to track and analyze metrics for AI systems while implementing vendor tools for robust guardrails and observability. Candidates should be equipped to build AI reliability dashboards and contribute to the evolution of autonomous workflows. Competitive pay ranges from $70 to $80 per hour.

Qualifications

• Proven expertise in operationalizing and monitoring GenAI applications.
• Ability to define, track, and analyze metrics related to LLMs and SMLs.
• Experience with deploying and scaling AI services.

Responsibilities

• Implement vendor tools for guardrails and observability in Generative AI.
• Leverage LLMs to measure and score various metrics.
• Build and manage observability dashboards for AI reliability.

Skills

Operationalizing guardrails and observability

GenAI Ops workflows

Track and analyze RAG guardrail metrics

Annotation and feedback loops

LangChain orchestration

OpenShift deployment

Observability dashboards (Grafana)

Agentic evaluation methods

Job description

This range is provided by Insight Global. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$70.00/hr - $80.00/hr

Desired Skills & Experience

• Operationalize guardrails and observability across vendor-based RAG and LLM applications.
• Set up GenAI Ops workflows to continuously monitor inference latency, throughput, quality, and safety metrics.
• Define, track, and analyze RAG guardrail metrics using LLMs as Judges and SMLs (e.g., attribution, grounding, prompt injection, tone, PII leakage).
• Implement annotation, structured feedback loops, fine-tuning, and alignment methods to calibrate judge models.
• Use LangChain to orchestrate guardrail checks, manage prompt versioning, and integrate judge model scoring workflows.
• Work with OpenShift to deploy, scale, and monitor containerized GenAI services.
• Build observability dashboards and alerts (Grafana or equivalent) for AI reliability.
• Contribute to emerging agentic evaluation and guardrails as autonomous AI workflows expand.

Job Description

Currently implementing vendor tools that provide Guardrails and Observability for Generative AI applications. We are seeking a GenAI Engineer with proven expertise in GenAI Ops — operationalizing, monitoring, and scaling LLM and RAG-powered applications with robust guardrails and observability. The role will focus on leveraging LLMs as Judges and Specialized Models (SMLs) to measure and score guardrail metrics such as chunk attribution, context adherence, prompt injection detection, tone, sexism, bias, and PII leakage.

Compensation

$70/hr to $80/hr

Exact compensation may vary based on several factors, including skills, experience, and education.

Benefits

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Engineering and Information Technology