AI Quality Engineer — RAG Architect for Healthcare Ops

Maria Health; Manila; On-site; PHP 1,339,000 - 1,786,000; Full time

Job summary

Maria Health is building an AI-powered operating system for HMO brokerage in the Philippines. The AI Engineer will own AI accuracy and reliability across all workflows, design the RAG architecture, curate knowledge bases, and craft prompts that guide reasoning.

Collaboration with platform engineers ensures guardrails are in place and AI decisions are auditable. You will shape how AI learns, evaluates, and evolves with product decisions, regulator scrutiny, and insurer interactions, all while

Qualifications

• 3+ years in software engineering with 2+ years building production LLM apps.
• Hands-on work on AWS Bedrock: knowledge bases, guardrails, evaluations, prompts and agents.
• Designing and operating production-grade RAG systems with chunking, embedding, retrieval and context windows.
• Curating AI knowledge bases, content lifecycle, and adapting to policy changes.
• Prompt engineering, versioning, and structured output across environments.
• Agent logic design for multi-step workflows with tool use and state management.
• Building evaluation systems with golden data, accuracy thresholds, regression detection, and reviews.
• Handling sensitive data: PII redaction, prompt injection defense and data leakage prevention.

Responsibilities

• Own AI quality across the platform end to end; design and iterate AI logic for workflows.
• Design RAG architecture, curate knowledge bases, write prompts and agent logic, collaborate on guardrails.
• Tune AI outputs for accuracy, monitor quality, and troubleshoot regressions across workflows.
• Define correctness for each workflow with Platform Engineer and Product Lead; monitor improvements over time.
• Maintain auditable AI decisions with versioned prompts, knowledge bases, and model versions.
• Document AI layer: versioned prompt library, knowledge maps, evaluation suites, and guardrails.

Skills

AWS Bedrock

RAG systems

Prompt management

Agent workflows

Evaluation pipelines

Python

Vector stores

Embedding models

Guardrails

Knowledge bases

Quality metrics

PII redaction

Tools

AWS Bedrock

Vector databases

Job description

Maria Health is building an AI-powered operating system for HMO brokerage in the Philippines. The AI Engineer will own AI accuracy and reliability across all workflows, design the RAG architecture, curate knowledge bases, and craft prompts that guide reasoning.

Collaboration with platform engineers ensures guardrails are in place and AI decisions are auditable. You will shape how AI learns, evaluates, and evolves with product decisions, regulator scrutiny, and insurer interactions, all while