Production AI Engineer - RAG & Secure Workflows

Cobalt Benefits Group, LLC; Atlanta (GA); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Fantastic medical, dental, and vision

Twice annual employer HSA contribution

Company provided Life and AD&D

Short-Term and Long-Term Disability

401(k) Retirement Plan with employer-m

6% employer-match

10+ paid holidays

Fully Paid half day Summer Fridays

Generous paid vacation and sick time

Annual Tuition Reimbursement

Annual Health and Wellness Reimburse

Job summary

Cobalt Benefits Group (CBG) is seeking an AI Developer to design, build, test, and deploy governed AI solutions to improve operational efficiency and member experience. You will create production-ready retrieval-augmented agents and AI-enabled workflows using a mix of custom development and low-code Microsoft tools.

Collaborate with business units, DevOps, IT Security, Compliance, and governance teams to ensure secure integration with core systems while establishing reusable patterns for

Qualifications

• Bachelor's degree or equivalent practical experience required.
• Hands-on generative AI development and evaluation experience including RAG and context engineering.
• Strong Python and/or C#/.NET development skills with production APIs and secure secrets management.
• Experience with HIPAA-regulated data handling and PHI masking.
• Ability to review, test, debug, and maintain AI-generated code; knowledge of SQL, data modeling, and data pipelines.

Responsibilities

• Design, prototype, build, test, and deploy AI applications and agents through production; select appropriate Copilot Studio or other approaches under Build-vs-Buy guidance.
• Develop retrieval-augmented generation (RAG) solutions including ingestion, chunking, indexing, and citations.
• Integrate with internal and third-party systems via REST and GraphQL APIs; collaborate on data pipelines.
• Apply least-privilege permissions, SSO, secrets management, PHI/PII protections, logging and retention controls with IT Security.
• Create evaluation harnesses with golden test sets and monitoring of accuracy, latency, and costs; ensure citation quality.
• Implement telemetry for prompts, tool calls, and outputs; maintain runbooks and cost controls.
• Advance solutions through AI governance gates and required artifacts; document decisions and transitions.

Skills

Python

C#/.NET

REST APIs

GraphQL

AI governance

Education

Bachelor's degree in Computer Science or related field

Tools

Copilot Studio

Azure OpenAI

Azure AI Search

Job description

Cobalt Benefits Group (CBG) is seeking an AI Developer to design, build, test, and deploy governed AI solutions to improve operational efficiency and member experience. You will create production-ready retrieval-augmented agents and AI-enabled workflows using a mix of custom development and low-code Microsoft tools.

Collaborate with business units, DevOps, IT Security, Compliance, and governance teams to ensure secure integration with core systems while establishing reusable patterns for