Senior AI/ML Engineer – Remote (Production LLMs)

Wiraa; United States; Hybrid; USD 175,000 - 250,000; Full time

Benefits offered by this job

Competitive base salary

Bonus based on deliverables

Comprehensive medical/dental/vision

Unlimited PTO

401(k) with matching

Flexible remote or hybrid work

Job summary

Certum Legal Solutions (CLS) seeks an Applied AI/ML Engineer to own the intelligence layer of Project Interstellar, building production-grade LLM systems in a HIPAA-regulated environment. You will work with the Lead Backend Engineer to integrate AI capabilities into platform architecture from the ground up.

Key projects include a structured data extraction pipeline for complex legal documents, a model abstraction layer to optimize inference costs, and an agent orchestration framework with QA and

Qualifications

• 5+ years of software engineering, with 2–3 years in production LLM apps.
• Expert Python programming and strong API integration skills.
• Experience deploying AI systems at production scale with reliability and security.
• Deep familiarity with LLM APIs such as Claude, GPT, or equivalents.
• Experience with LangChain, LlamaIndex, or custom orchestration solutions.
• Knowledge of Retrieval-Augmented Generation (RAG) architectures, including vector databases, embedding models, and retrieval optimization.
• Strong prompt engineering discipline, including version control, A/B testing, and regression testing.
• Experience handling sensitive or regulated data (HIPAA, FERPA, or similar).
• Preferred: document/text extraction from unstructured sources, OCR post-processing, or information extraction from clinical or legal documents.
• Preferred: conversational AI/voice AI systems, including NLU and dialog management.
• Preferred: experience in legal or healthcare AI applications.
• Preferred: multi-agent orchestration patterns and evaluating LLM outputs at scale.

Responsibilities

• Own the design and implementation of all AI/ML systems on the CLS platform.
• Design and maintain prompt engineering infrastructure, including versioned prompts, A/B evaluation, and regression testing.
• Build and iterate on structured data extraction pipelines for complex, regulated documents, covering parsing, multi-step reasoning, and output validation.
• Design and develop the agent orchestration framework powering task, quality assurance, and operational agents.
• Establish AI quality standards such as confidence thresholds and escalation triggers.
• Collaborate with the Lead Backend Engineer on model abstraction layer design and API integration.
• Partner with domain experts to define extraction schemas and workflow logic.
• Ensure AI systems comply with regulatory requirements and maintain data security and privacy.

Skills

Python programming

Production LLM apps

API integration

Prompt engineering

Regulatory compliance

Tools

LangChain

LlamaIndex

LLM APIs (Claude, GPT)

Vector databases

OCR/post-processing

Job description

Certum Legal Solutions (CLS) seeks an Applied AI/ML Engineer to own the intelligence layer of Project Interstellar, building production-grade LLM systems in a HIPAA-regulated environment. You will work with the Lead Backend Engineer to integrate AI capabilities into platform architecture from the ground up.

Key projects include a structured data extraction pipeline for complex legal documents, a model abstraction layer to optimize inference costs, and an agent orchestration framework with QA and