Remote Production AI/ML Engineer for HIPAA LLM Systems

Certum Legal Solutions; Myrtle Point (OR); Remote; USD 175,000 - 250,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

Unlimited PTO

401(k) with employer matching

Remote or hybrid work schedule

Job summary

Certum Legal Solutions is building an AI-native platform and seeks an Applied AI/ML Engineer to own the intelligence layer, focusing on production LLM systems that operate at scale in a HIPAA-regulated environment, collaborating with the Lead Backend Engineer to integrate capabilities from day one.

You will design extraction pipelines, agent orchestration, RAG layers, and QA workflows, while ensuring security, reliability, and scalability across high-volume legal data.

Qualifications

• 5+ years of software engineering with 2–3 years in production LLM app development
• Expert Python; strong API integration; production-scale AI systems
• Deep familiarity with Claude, GPT, or equivalent LLM APIs beyond basic calls
• Experience with agent frameworks (LangChain, LlamaIndex, or custom orchestration)
• RAG architecture: vector databases, embeddings, retrieval optimization
• Prompt engineering discipline: evaluation, regression testing, version control for prompts
• Experience handling sensitive or regulated data (HIPAA, FERPA, or similar)

Responsibilities

• Own all AI/ML system design and implementation on the platform
• Design and maintain prompt engineering infrastructure: versioned prompts, A/B evaluation, regression tests
• Build and iterate on structured extraction pipelines for complex documents from parsing to multi-step reasoning
• Design the agent orchestration framework powering task, QA, and operational agents
• Establish AI quality standards: confidence thresholds, human escalation triggers, output validation
• Partner with Backend Engineer on model abstraction layer design and API integration
• Collaborate with domain experts on extraction schema design and workflow logic

Skills

Python

API integration

LLM APIs

Agent frameworks

RAG architecture

Prompt engineering

HIPAA data handling

Tools

LangChain

LlamaIndex

custom orchestration

vector databases

embedding models

retrieval optimization

Job description

Certum Legal Solutions is building an AI-native platform and seeks an Applied AI/ML Engineer to own the intelligence layer, focusing on production LLM systems that operate at scale in a HIPAA-regulated environment, collaborating with the Lead Backend Engineer to integrate capabilities from day one.

You will design extraction pipelines, agent orchestration, RAG layers, and QA workflows, while ensuring security, reliability, and scalability across high-volume legal data.