AI Developer

Cobalt Benefits Group

United States

Remote

USD 120,000 - 160,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical Insurance
401(k) Retirement Plan with match
Paid time off

Job summary

Cobalt Benefits Group seeks an AI Developer to design, build, test, and deploy governed AI solutions that improve operations and member experience. You will produce production-ready retrieval-augmented assistants and AI-enabled workflows using both custom development and low-code Microsoft tools.

Collaborate with IT security, compliance, and AI governance to ensure secure integration with core systems while delivering reusable patterns for Responsible AI delivery.

Qualifications

  • Bachelor's degree or equivalent practical experience.
  • Strong Python and/or C#/.NET development skills.
  • Experience with production APIs and REST integration.
  • Knowledge of OAuth or similar authorization methods.
  • Experience with secure secrets/configuration management.

Responsibilities

  • Design, prototype, build, test, and deploy AI applications and agents in production; select appropriate approaches.
  • Develop retrieval-augmented generation solutions including document ingestion and indexing.
  • Integrate with internal and external systems via REST/GraphQL APIs; assist data pipelines.
  • Apply least-privilege access, SSO, PHI/PII protections, and logging/retention controls.
  • Create evaluation harnesses, monitor accuracy, citations, latency, and cost.

Skills

Python
C#/.NET
REST APIs
OAuth
Secrets management

Education

Bachelor's degree in Computer Science or related field

Job description

Cobalt Benefits Group (CBG), a healthcare third-party administrator, seeks an AI Developer to design, build, test, and deploy governed AI solutions that improve operational efficiency and member experience. This hands‑on role turns approved use cases into production‑ready retrieval‑augmented assistants, document‑extraction agents, and AI‑enabled workflows, using both custom development and low‑code Microsoft tools. The developer partners with business owners, DevOps, IT Security, Compliance, and AI governance stakeholders to integrate solutions securely with core systems and establish reusable patterns for responsible AI delivery.

Responsibilities
  • Design, prototype, build, test, and deploy AI applications and agents through production; select appropriate Copilot Studio, workflow, agent, custom-service, vendor, or non‑AI approaches under Build‑vs‑Buy guidance.
  • Develop retrieval‑augmented generation (RAG) solutions, including document ingestion, chunking, indexing, metadata, retrieval tuning, and grounded responses with source citations.
  • Integrate with internal and third‑party systems through authenticated REST and GraphQL APIs; collaborate on data pipelines for documents and structured data.
  • Apply least‑privilege permissions, single sign‑on, secrets management, PHI/PII protections, output validation, and appropriate logging and retention controls with IT Security.
  • Create evaluation harnesses with golden test sets, subject‑matter expert rubrics, and production sampling; monitor accuracy, citation support and completeness, latency, and transaction cost, including results by plan type.
  • Implement telemetry for prompts, retrieval, tool calls, and outputs; maintain runbooks, hand‑off documentation, cost controls, and operational monitoring.
  • Advance solutions through CBG AI Solution Delivery Playbook decision gates and required artifacts, including risk assessments, requirements, evaluation plans, and transition documentation.
  • Partner with the AI Risk Manager, Compliance, Data Protection Officer, Security, and AI Ethics Committee as appropriate; share reusable components, templates, and approved prompt patterns.
  • Bachelor's degree in Computer Science, Information Systems, related field, or equivalent practical experience; 3+ years of professional software development experience.
  • Hands‑on generative AI development and evaluation experience, including RAG, context engineering, tool/function calling, and at least one production or production‑pilot solution.
  • Strong Python and/or C#/.NET development skills; experience with production APIs, REST integration, OAuth or similar authorization, and secure secrets/configuration management.
  • Ability to review, test, debug, and maintain AI‑generated code; working knowledge of SQL, data modeling, and data pipelines.
  • Experience handling HIPAA‑regulated information, PHI masking, and access controls.
  • Experience with AI regression testing, monitoring, model version management, release controls, cost optimization, and guarded multi‑step agents.
  • Ability to document technical decisions, follow governance and change control, conduct business requirements sessions, and recommend delaying or stopping solutions that fail evaluation thresholds.
Preferred
  • Microsoft Copilot Studio, Power Automate, Power Platform, Azure OpenAI, and Azure AI Search experience.
  • Demonstrated improvement of retrieval or extraction systems using before‑and‑after evaluation results.
  • Experience with AI coding agents and Model Context Protocol (MCP).
  • Familiarity with healthcare, third‑party administration, employee benefits, claims, eligibility, plan documents, or EDI.
Personal Attributes
  • Collaborative communicator able to translate business processes into technical requirements and partner across business, engineering, security, and compliance teams.
  • Analytical, detail‑oriented problem solver who values measurable quality, documentation, and continuous improvement.
  • Sound judgment and accountability in privacy, fairness, human oversight, and responsible AI delivery.
  • Adaptable, hands‑on builder comfortable selecting between low‑code and custom engineering approaches.
Technology Environment

Microsoft 365 Copilot, Copilot Studio, Power Automate, Power Apps, Teams; Azure OpenAI / Azure AI Foundry, Azure AI Search; Azure API Management, Entra ID, Key Vault; Azure SQL, Cosmos DB, Azure Data Lake Storage, Blob Storage, Dataverse; GitHub and CI/CD pipelines.

Specific technologies vary by project and risk tier.

Measures of Success
  • First 90 days: Complete AI governance onboarding, ship an enhancement through Production Readiness Review, and establish a golden-test-set evaluation harness.
  • First 6 months: Release a new approved AI solution, publish reusable components adopted by another project, and enable monitoring dashboards.
  • First 12 months: Meet approved business KPIs, demonstrate reusable delivery patterns, and maintain current inventory, risk classification, evaluation, and monitoring records.

Compliance and Responsible AI Solutions must meet CBG governance and technical security requirements, with privacy, security, and human oversight proportionate to risk. Automated claim denials without human review and use of PHI in public generative AI models are prohibited. Work aligns with HIPAA, HITRUST CSF, NIST AI Risk Management Framework, and applicable OWASP guidance.

Benefits

After successfully completing a waiting period, eligible Full‑time employees have access to our comprehensive benefits package, including:

  • Fantastic medical, dental, and vision insurance
  • Twice annual employer HSA contributions, covering 50% of the HDHP plan’s annual deductible!
  • Company provided Basic Life and AD&D
  • Company paid Short‑Term and Long‑Term Disability
  • Flexible Spending Accounts
  • 401(k) Retirement Plan with up to a 6% employer‑match
  • WOW! (100% fully vested after 3 years)
  • 10+ paid holidays
  • Fully Paid half day Summer Fridays
  • Generous paid vacation and sick time
  • Annual Paid Volunteer Day
  • Annual Tuition Reimbursement
  • Annual Health and Wellness Reimbursement
  • Lots of fun company events
  • 60 day waiting period
  • 90 day waiting period
Who We Are

Cobalt Benefits Group has been named one of the Best Companies to Work for in NH 2026 by NH Business Magazine! As a trusted third‑party administrator (TPA) specializing in self‑funded benefit plans, Cobalt Benefits Group (CBG) is committed to helping employers find high‑quality coverage at a cost they can afford. We administer self‑funded insurance benefits through our four lines of business: EBPA, Blue Benefit Administrators of Massachusetts, CBA Blue, and Great Bay Administrators. With over 30 years of experience and a dedicated team of more than 300 employees, we work collaboratively to build customized self‑funded health plans, manage claim payments and disputes, and administer other specialized programs such as FSAs, HSAs, COBRA, and retiree billing. Join us as we match employers across our region with the right solutions for their employee benefit needs. To learn more about working at CBG, visit https://www.cobaltbenefitsgroup.com/careers/.

Cobalt Benefits Group is an Equal Employment Opportunity employer Cobalt Benefits Group participates in E-Verify to confirm the employment eligibility of all new hires.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Developer
AI Developer

Cobalt Benefits Group, LLC • Atlanta (GA)

On-site
USD 120,000 - 180,000
Fantastic medical, dental, and vision
Twice annual employer HSA contribution
Company provided Life and AD&D
+8
AI Developer
AI Developer

Cobalt Benefits Group LLC • Richmond (VA)

On-site
USD 120,000 - 180,000
Medical Insurance
HSA contributions
401(k) employer match
+6
AI Developer
AI Developer

Cobalt Benefits Group, LLC • Boston (MA)

On-site
USD 120,000 - 180,000
Medical, dental, vision insurance
HSA contributions
Life and AD&D insurance
+8
Data Engineer, Reporting & Analytics
Data Engineer, Reporting & Analytics

Cobalt Benefits Group LLC • United States

Remote
USD 90,000 - 130,000
Medical, dental, vision insurance
HSA contributions
401(k) with company match
+3
Data Engineer, Reporting & Analytics
Data Engineer, Reporting & Analytics

Cobalt Benefits Group, LLC • New Hampshire

On-site
USD 90,000 - 130,000
Medical insurance
Dental and vision insurance
Retirement plan with match
+5
Senior Stop Loss Specialist
Senior Stop Loss Specialist

Cobalt Benefits Group, LLC • Boston (MA)

On-site
USD 120,000 - 170,000
Medical Insurance
HSA contributions
Life Insurance
+5
Account Manager, Core Business
Account Manager, Core Business

Cobalt Benefits Group Llc • Exeter (NE)

On-site
USD 55,000 - 90,000
Medical, dental, and vision insurance
Employer HSA contributions
Life and AD&D insurance
+7
Healthcare Claims Quality Assurance Specialist
Healthcare Claims Quality Assurance Specialist

Cobalt Benefits Group, LLC • Portsmouth (NH)

On-site
USD 65,000 - 90,000
Medical, dental, vision insurance
HSA contributions
Life and AD&D insurance
+5
Data Engineer, Reporting & Analytics
Data Engineer, Reporting & Analytics

Cobalt Benefits Group, LLC • Raleigh (NC)

On-site
USD 90,000 - 150,000
Medical insurance
HSA contributions
401(k) Retirement Plan with employer-m
+2
Data Engineer, Reporting & Analytics
Data Engineer, Reporting & Analytics

Cobalt Benefits Group, LLC • Bogart (GA)

On-site
USD 100,000 - 140,000
Fantastic medical, dental, and vision
HSA contributions
401(k) with employer match
+5