AI Platform Engineer: Delivery, Observability & FinOps

EY; Boston (MA); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Medical and dental coverage

Pension and 401(k)

Paid time off

Job summary

EY is hiring an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will shape AI workloads end-to-end across cloud, on-prem, edge, and air-gapped environments while collaborating with senior engineers.

The role emphasizes CI/CD/CV pipelines, secure model execution, governance, cost visibility, and telemetry-driven deployment decisions. Hybrid work model offered in the US.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with ownership of AI or high-throughput services.
• Hands-on CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI).
• Experience with inference/model-serving frameworks on GPU infrastructure (Ray Serve, vLLM, Triton, NIM).
• Strong observability stack knowledge (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy) including streaming responses.
• Experience with FinOps tooling (OpenCost, Kubecost) and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and governance (Harbor, MLflow, Trivy/SBOM).

Responsibilities

• Build and operate CI/CD/CV pipelines delivering AI services and runtime components.
• Own governance and discovery for AI assets and model metadata.
• Manage resource usage and cost attribution per tenant and workload.
• Oversee the full observability stack: metrics, logs, traces, dashboards, and LangSmith/Langfuse for evaluation.
• Handle OpenTelemetry collection layer and multi-tenant telemetry routing.
• Automate GitOps-based delivery with policy gates.
• Link delivery with observability to drive deployment decisions and automated rollbacks.
• Ensure compliant consumption signals per workload for FinOps and governance.

Skills

DevOps

Model-serving

Observability

FinOps

Governance & Registries

Multi-env/edge

Communication

Education

Bachelor’s or Master’s in CS or related

Tools

Ray Serve

vLLM

Triton

NIM

Job description

EY is hiring an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will shape AI workloads end-to-end across cloud, on-prem, edge, and air-gapped environments while collaborating with senior engineers.

The role emphasizes CI/CD/CV pipelines, secure model execution, governance, cost visibility, and telemetry-driven deployment decisions. Hybrid work model offered in the US.