AI Engineer – LLMs, RAG & Healthcare Analytics

bpd

United States

On-site

USD 90,000 - 140,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

BPD is hiring a mid-level AI Engineer to build and scale AI systems behind Violet and ThirdBase. You will work hands-on with LLMs, retrieval systems, and healthcare data to turn a governed data warehouse into trustworthy analytics.

You will own end-to-end components, grow into larger systems, and collaborate with senior engineers for direction and quality in a healthcare-focused environment.

Qualifications

  • 2-4 years building production software with some hands-on LLM/GenAI experience (RAG, agents, or text-to-SQL).
  • Strong Python and SQL skills; comfortable querying Snowflake or similar cloud warehouses.
  • Working knowledge of AWS and deploying services in the cloud.
  • Experience with LangGraph, CrewAI, n8n or other agentic frameworks.
  • Experience in AI-assisted coding and CICD processes.
  • Familiarity with JavaScript frameworks (Node, React) and API-based integrations.
  • Exposure to retrieval systems, embeddings, or vector search.
  • Understanding of prompt engineering and LLM guardrails to ensure reliable outputs.

Responsibilities

  • Build and improve LLM-powered analytics features including agentic workflows, natural-language querying, retrieval-augmented generation, and tool-use over structured and unstructured data.
  • Contribute to text-to-SQL and semantic-layer systems enabling non-technical users to query healthcare datasets safely.
  • Develop retrieval pipelines over document stores (vector search, hybrid keyword + semantic).
  • Implement evaluation, guardrails, and hallucination checks with strict accuracy in healthcare data.
  • Help enforce data governance and compliance controls in the AI layer (derives insights only, no PHI/PII exposure).
  • Integrate multiple data sources and platforms into agent workflows.
  • Deploy and monitor services on AWS; track model performance, latency, and cost.
  • Collaborate with product, analytics, and engineers to ship features.

Skills

Python
SQL
AWS
LLM/GenAI
RAG
Prompt engineering
Data privacy
NLP
JavaScript

Education

Bachelor's in CS/Engineering/Data Science

Tools

Snowflake
OpenAI/Amazon Bedrock
LangGraph/n8n
React/Node

Job description

BPD is hiring a mid-level AI Engineer to build and scale AI systems behind Violet and ThirdBase. You will work hands-on with LLMs, retrieval systems, and healthcare data to turn a governed data warehouse into trustworthy analytics.

You will own end-to-end components, grow into larger systems, and collaborate with senior engineers for direction and quality in a healthcare-focused environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Engineer — LLM & Healthcare Analytics
Remote AI Engineer — LLM & Healthcare Analytics

BPD • Nashville (TN), Boca Raton (FL)

Hybrid
USD 120,000 - 170,000
AI Engineer
AI Engineer

bpd • United States

On-site
USD 90,000 - 140,000
AI Engineer
AI Engineer

BPD • Nashville (TN), Boca Raton (FL)

Hybrid
USD 120,000 - 170,000
Applied AI Engineer - LLMs, RAG & HealthTech
Applied AI Engineer - LLMs, RAG & HealthTech

CVS Health • New York (NY)

Hybrid
USD 79,000 - 159,000
Medical, dental, vision
Retirement savings options
Paid time off
AI Engineer - Health Tech, LLM & RAG Systems
AI Engineer - Health Tech, LLM & RAG Systems

9025 CVS Shared Services Resources LLC • New York (NY)

Hybrid
USD 79,000 - 159,000
Medical, dental, and vision coverage
Paid time off
Retirement savings options
+2
AI Engineer – LLMs for Health Impact
AI Engineer – LLMs for Health Impact

Excellus BCBS • City of Utica (NY)

Hybrid
USD 65,000 - 142,000
AI Engineer - LLMs & Generative AI for Health Outcomes
AI Engineer - LLMs & Generative AI for Health Outcomes

Lifetime Workforce Solutions, LLC • City of Rochester (NY)

Hybrid
USD 65,000 - 142,000
Remote work option
AI Engineer: Health AI & LLM Innovator
AI Engineer: Health AI & LLM Innovator

CDPHP in • City of Rochester (NY)

Hybrid
USD 65,000 - 142,000
Remote work option
AI Engineer
AI Engineer

Discover International • New York (NY)

On-site
USD 120,000 - 180,000
Production AI Engineer: LLMs, RAG & Scalable APIs
Production AI Engineer: LLMs, RAG & Scalable APIs

CVS Health • United States

Remote
USD 79,000 - 159,000