Remote Principal AI Observability Engineer

Inspira Financial Trust, LLC; Oak Brook (IL); Remote; USD 153,000 - 220,000; Full time

Job summary

Inspira Financial Trust, LLC is seeking a Principal AI Operations Engineer (Remote) to define how AI systems are instrumented, measured, and governed across the enterprise. You will lead the telemetry standard, establish guardrails, and drive evidence collection for audit and compliance.

The role focuses on building a unified AI observability stack, fabricating references and starter kits, and partnering with Risk, Compliance, Legal, and Security to ensure robust controls and cost visibility.

Qualifications

• Bachelor of Science in Engineering or Computer Science is required.
• Production-grade proficiency in Python and SQL is essential.
• Experience with AI evaluation and observability, including drift detection and guardrails.

Responsibilities

• Define enterprise telemetry standards for AI systems and prompts.
• Build the logging and observability layer for AI activity across applications.
• Integrate AI telemetry with log aggregation, APM, security monitoring, and incident platforms.
• Establish data retention, redaction, and access patterns for AI conversations.
• Publish reference implementations and starter kits for teams adopting telemetry.
• Design evaluation frameworks for AI systems, including datasets and CI gates.
• Define drift criteria and build detection for model changes and output quality.
• Build runtime guardrails and boundary enforcement for agents and actions.
• Establish an AI incident model with escalation, rollback, and postmortem processes.
• Translate NIST AI RMF, ISO 42001, and risk practices into operational controls.

Skills

Python

SQL

AI evaluation

Observability

Education

Bachelor of Science in Engineering or Computer Science

Tools

Datadog

Google Cloud Professional Data Engineer for BigQuery ML

PagerDuty’s AI Ops

Job description

Inspira Financial Trust, LLC is seeking a Principal AI Operations Engineer (Remote) to define how AI systems are instrumented, measured, and governed across the enterprise. You will lead the telemetry standard, establish guardrails, and drive evidence collection for audit and compliance.

The role focuses on building a unified AI observability stack, fabricating references and starter kits, and partnering with Risk, Compliance, Legal, and Security to ensure robust controls and cost visibility.