AI/ML Engineer - Remote

Wiraa; United States; Hybrid; USD 175,000 - 250,000; Full time

Benefits offered by this job

Competitive base salary

Bonus based on deliverables

Comprehensive medical/dental/vision

Unlimited PTO

401(k) with matching

Flexible remote or hybrid work

Job summary

Certum Legal Solutions (CLS) seeks an Applied AI/ML Engineer to own the intelligence layer of Project Interstellar, building production-grade LLM systems in a HIPAA-regulated environment. You will work with the Lead Backend Engineer to integrate AI capabilities into platform architecture from the ground up.

Key projects include a structured data extraction pipeline for complex legal documents, a model abstraction layer to optimize inference costs, and an agent orchestration framework with QA and

Qualifications

• 5+ years of software engineering, with 2–3 years in production LLM apps.
• Expert Python programming and strong API integration skills.
• Experience deploying AI systems at production scale with reliability and security.
• Deep familiarity with LLM APIs such as Claude, GPT, or equivalents.
• Experience with LangChain, LlamaIndex, or custom orchestration solutions.
• Knowledge of Retrieval-Augmented Generation (RAG) architectures, including vector databases, embedding models, and retrieval optimization.
• Strong prompt engineering discipline, including version control, A/B testing, and regression testing.
• Experience handling sensitive or regulated data (HIPAA, FERPA, or similar).
• Preferred: document/text extraction from unstructured sources, OCR post-processing, or information extraction from clinical or legal documents.
• Preferred: conversational AI/voice AI systems, including NLU and dialog management.
• Preferred: experience in legal or healthcare AI applications.
• Preferred: multi-agent orchestration patterns and evaluating LLM outputs at scale.

Responsibilities

• Own the design and implementation of all AI/ML systems on the CLS platform.
• Design and maintain prompt engineering infrastructure, including versioned prompts, A/B evaluation, and regression testing.
• Build and iterate on structured data extraction pipelines for complex, regulated documents, covering parsing, multi-step reasoning, and output validation.
• Design and develop the agent orchestration framework powering task, quality assurance, and operational agents.
• Establish AI quality standards such as confidence thresholds and escalation triggers.
• Collaborate with the Lead Backend Engineer on model abstraction layer design and API integration.
• Partner with domain experts to define extraction schemas and workflow logic.
• Ensure AI systems comply with regulatory requirements and maintain data security and privacy.

Skills

Python programming

Production LLM apps

API integration

Prompt engineering

Regulatory compliance

Tools

LangChain

LlamaIndex

LLM APIs (Claude, GPT)

Vector databases

OCR/post-processing

Job description

About The Company

Certum Legal Solutions (CLS) is a pioneering legal managed services organization (MSO) dedicated to supporting mass-tort and single-event personal injury law firms. Our mission is to provide the operational infrastructure, technology, and back-office solutions that empower the firms on our platform to grow and scale efficiently while delivering industry-leading results for their clients. At CLS, we are innovating the legal services industry by building a proprietary, AI-native system designed to revolutionize how legal operations are conducted. This system integrates AI-powered agents to manage end-to-end workflows across the lifecycle of litigation matters, including critical back-office functions such as human resources, accounting, finance, and IT. Our greenfield build leverages a modern technology stack, designed from inception to be extensible and eventually productized for the broader legal services market. We are assembling a high-caliber team to create a unique solution that does not currently exist in the legal industry. If you are passionate about AI's transformative potential in professional services and want your work to have a direct business impact, CLS offers an exceptional opportunity.

About The Company

Certum Legal Solutions (CLS) is a pioneering legal managed services organization (MSO) dedicated to supporting mass-tort and single-event personal injury law firms. Our mission is to provide the operational infrastructure, technology, and back-office solutions that empower the firms on our platform to grow and scale efficiently while delivering industry-leading results for their clients. At CLS, we are innovating the legal services industry by building a proprietary, AI-native system designed to revolutionize how legal operations are conducted. This system integrates AI-powered agents to manage end-to-end workflows across the lifecycle of litigation matters, including critical back-office functions such as human resources, accounting, finance, and IT. Our greenfield build leverages a modern technology stack, designed from inception to be extensible and eventually productized for the broader legal services market. We are assembling a high-caliber team to create a unique solution that does not currently exist in the legal industry. If you are passionate about AI's transformative potential in professional services and want your work to have a direct business impact, CLS offers an exceptional opportunity.

About The Role

The Applied AI/ML Engineer will own the intelligence layer of Project Interstellar, the core infrastructure that powers advanced document intelligence, conversational voice agents, multi-step task orchestration, and a variety of operational workflows. This role is focused on applied AI/ML engineering not research, and requires building production-grade large language model (LLM) systems that operate reliably at scale within a HIPAA-regulated environment. You will collaborate closely with the Lead Backend Engineer to integrate AI capabilities into the platform architecture from the ground up. Key projects include developing a structured data extraction pipeline for complex legal documents, designing a model abstraction layer to optimize inference costs, creating an agent orchestration framework, and implementing quality assurance and training systems for AI outputs. This role offers the opportunity to build cutting-edge AI solutions that directly enhance operational efficiency and accuracy in the legal domain.

Qualifications

• 5+ years of software engineering experience, including 2-3 years focused on production LLM application development
• Expert proficiency in Python programming and strong skills in API integration
• Experience deploying AI systems at production scale with a focus on reliability and security
• Deep familiarity with building reliable systems around LLM APIs such as Claude, GPT, or equivalents
• Experience with agent frameworks such as LangChain, LlamaIndex, or custom orchestration solutions
• Knowledge of Retrieval-Augmented Generation (RAG) architectures, including vector databases, embedding models, and retrieval optimization
• Strong prompt engineering discipline, including version control, systematic evaluation, A/B testing, and regression testing
• Experience handling sensitive or regulated data (HIPAA, FERPA, or similar compliance environments)
• Preferred: experience with document and text extraction from unstructured sources, OCR post-processing, or information extraction from clinical or legal documents
• Preferred: experience with conversational AI or voice AI systems, including natural language understanding (NLU), dialog management, and conversation evaluation
• Preferred: experience in legal or healthcare AI applications
• Preferred: multi-agent orchestration patterns and experience evaluating/scoring LLM outputs at scale

Responsibilities

• Own the design and implementation of all AI/ML systems on the CLS platform
• Design and maintain prompt engineering infrastructure, including versioned prompts, A/B evaluation, and regression testing
• Build and iterate on structured data extraction pipelines for complex, regulated documents, covering parsing, multi-step reasoning, and output validation
• Design and develop the agent orchestration framework that powers task agents, quality assurance agents, and operational agents
• Establish AI quality standards such as confidence thresholds, human escalation triggers, and output validation protocols
• Collaborate with the Lead Backend Engineer on model abstraction layer design and API integration
• Partner with domain experts to define extraction schemas and workflow logic
• Ensure AI systems comply with regulatory requirements and maintain data security and privacy standards

Benefits

• Competitive base salary ranging from $175,000 to $250,000 annually, based on experience and skillset
• Performance bonuses based on deliverables and KPIs, ranging from 10% to 20% of base salary
• Comprehensive medical, dental, and vision insurance plans
• Unlimited paid time off (PTO) plus company holidays
• 401(k) plan eligibility from day one with employer matching contributions
• Flexible remote or hybrid work schedule to support work-life balance

Equal Opportunity

Certum Legal Solutions is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status, or any other characteristic protected by law.