Audit & Traceability Engineer – AI/Agentic Automation

Arkhya Tech Inc.; United States; On-site; USD 140,000 - 210,000; Full time

Job summary

Arkhya Tech Inc. seeks a hands-on Audit & Traceability Engineer to design end-to-end auditability, data lineage, observability, and evidence management for AI/agentic workflows supporting Medicaid R2R processes.

The role emphasizes strong skills in Python, SQL, data lineage, provenance, and audit logging; distributed tracing, telemetry, monitoring, and traceability for AI/LLM agents; REST APIs, workflow orchestration, state management, and automated testing/reconciliation.

Qualifications

• Strong expertise in Python, SQL, data lineage, metadata, provenance, and audit logging.
• Experience implementing distributed tracing, telemetry, monitoring, and traceability for AI/LLM agents, APIs, and workflows.
• Hands‑on knowledge of REST APIs, workflow orchestration, state management, and automated testing/reconciliation.

Responsibilities

• Capture agent execution details, prompt/model versions, tool calls, decisions, exceptions, and human approvals with historical replay capabilities.
• Knowledge of IAM/RBAC, encryption, secure logging, HIPAA, and PHI/PII protection.

Skills

Python

SQL

data lineage

metadata

provenance

audit logging

Distributed tracing

Telemetry

Monitoring

Traceability

AI/LLM tracing

APIs

Workflow orchestration

State management

Automated testing

Reconciliation

REST APIs

Agent workflows

Human approvals

IAM/RBAC

Encryption

HIPAA

PHI/PII protection

Azure

Databricks

Delta Lake

Unity Catalog

MLflow

Azure OpenAI

LangChain

LangGraph

MCP

Medicaid knowledge

Enrollment

Eligibility

Claims

834/820/837/835

R2R processes

Tools

Azure

Databricks

Delta Lake

Unity Catalog

MLflow

Azure OpenAI

LangChain

LangGraph

MCP

Job description

We are seeking a hands-on Audit & Traceability Engineer to build end-to-end auditability, data lineage, observability, and evidence management for AI/agentic workflows supporting Medicaid Record-to-Report (R2R) processes.

• Strong expertise in Python, SQL, data lineage, metadata, provenance, and audit logging.
• Experience implementing distributed tracing, telemetry, monitoring, and traceability for AI/LLM agents, APIs, and workflows.
• Hands‑on knowledge of REST APIs, workflow orchestration, state management, and automated testing/reconciliation.
• Ability to capture agent execution details, prompt/model versions, tool calls, decisions, exceptions, and human approvals with historical replay capabilities.
• Strong understanding of IAM/RBAC, encryption, secure logging, HIPAA, and PHI/PII protection.
• Preferred: Azure, Databricks, Delta Lake, Unity Catalog, MLflow, Azure OpenAI, LangChain/LangGraph, and MCP.
• Healthcare/Medicaid knowledge covering enrollment, eligibility, claims, capitation, 834/820/837/835 transactions, and financial/R2R processes is highly desirable.