Generative AI Engineer for Secure Health Policy LLM

Magpie Health Analytics, Inc.; Baltimore (MD); On-site; USD 140,000 - 190,000; Full time

Job summary

Magpie Health Analytics, Inc. is seeking an experienced AI Engineer to design, build, and operate secure generative AI solutions that help healthcare clients access authoritative program guidance with faster, more consistent results.

You will design AI-enabled search over statutes, regulations, and guidance, grounding responses in source material and linking to documentation. Collaboration with PMs, data engineers, and stakeholders is essential to success.

Qualifications

• Master's degree in computer science, data science, engineering, or a related field.
• 5+ years of software development and cloud-based AI experience.
• Proficient in Python and modern LLM APIs, SDKs, orchestration tools, and AI/ML libraries.
• Experience deploying generative AI with embeddings, vector databases, and semantic search.
• Familiar with Agile methodologies and CI/CD pipelines.

Responsibilities

• Design, build, test, deploy, and maintain an AI-enabled decision-support capability with source citations.
• Develop document ingestion pipelines, including parsing, chunking, metadata tagging, embedding generation, and vector indexing.
• Collaborate with cross-functional teams to translate user needs into prompts and evaluation criteria.
• Implement guardrails, PII/PHI protections, and refusal handling for out-of-scope questions.
• Develop evaluation frameworks to measure retrieval quality, groundedness, and consistency; monitor performance.
• Deploy and operate solutions within AWS services with security controls and governance.

Skills

Python

LLM APIs

Embeddings

AWS

CI/CD

Agile

Prompt engineering

Security

Education

Master's degree in computer science, data science, engineering, or related field

Tools

HuggingFace

LangChain

LlamaIndex

AWS SageMaker

OpenAI API

Job description

Magpie Health Analytics, Inc. is seeking an experienced AI Engineer to design, build, and operate secure generative AI solutions that help healthcare clients access authoritative program guidance with faster, more consistent results.

You will design AI-enabled search over statutes, regulations, and guidance, grounding responses in source material and linking to documentation. Collaboration with PMs, data engineers, and stakeholders is essential to success.