AI Observability & Compliance Operations Lead

Inspira Financial; Oak Brook (IL); À distance; USD 180 000 - 240 000; Plein temps

Résumé du poste

Inspira Financial seeks a Principal AI Operations Engineer to define instrumenting and measuring AI systems across the enterprise. You will drive adoption of telemetry, observability, and governance standards, working with vendor and in-house AI capabilities to ensure audit-ready evidence and controlled operation.

The role focuses on building enterprise-wide telemetry, evaluation frameworks, drift detection, guardrails, and incident management, partnering with Risk, Compliance, Legal, and

Responsabilités

• Define the enterprise telemetry standard for AI systems, including traces, prompts, tool calls, retrieval, tokens, latency, and cost.
• Build the logging and observability layer to provide a single view of AI activity across custom apps, agent platforms, and vendor-embedded AI.
• Integrate AI telemetry with enterprise logging, APM, security monitoring, alerting, and incident response platforms for visibility and audit retention.
• Establish retention, redaction, masking, and access patterns for AI conversation and trace data to meet privacy and legal obligations.
• Publish reference implementations and starter kits for teams adopting the telemetry standard.
• Design the evaluation framework for AI systems with golden datasets, offline evaluation, and CI regression gates.
• Define drift criteria and build detection for output quality, retrieval decay, input distribution shift, and silent model updates.
• Build runtime guardrails for agents, including tool access, spend limits, escalation paths, and human-in-the-loop triggers.
• Establish the AI incident model with severity taxonomy, detection, alerting, rollback, and postmortem processes.
• Translate NIST AI RMF, ISO/IEC 42001, and related obligations into operational controls.
• Build the evidence layer for internal audit, external examination, and client due diligence.
• Integrate AI operational data with governance, risk, and compliance platforms for continuous control monitoring.
• Maintain the operational AI inventory with owners, risk classifications, and control coverage.
• Define the assurance pattern for vendor AI, including telemetry attestations and monitoring.
• Build metrics linking AI usage, quality, cost, and risk to business outcomes for leadership reporting.
• Own token and platform cost visibility by team and use case to drive optimization.
• Run working sessions, document patterns, and coach teams through their first fully instrumented AI deployment.
• Collaborate with Risk, Compliance, Legal, Privacy, and Security to incorporate risk-triad feedback.
• Perform other duties as assigned.

Description du poste

Inspira Financial seeks a Principal AI Operations Engineer to define instrumenting and measuring AI systems across the enterprise. You will drive adoption of telemetry, observability, and governance standards, working with vendor and in-house AI capabilities to ensure audit-ready evidence and controlled operation.

The role focuses on building enterprise-wide telemetry, evaluation frameworks, drift detection, guardrails, and incident management, partnering with Risk, Compliance, Legal, and