Data AI Engineer: Streaming LLM Platform & Guardrails

RV Soft; Chicago (IL); Hybrid; USD 76,000 - 83,000; Full time

Job summary

RV Soft is seeking a Data AI Engineer to build and operate LLM platform capabilities alongside production data pipelines in a Chicago-based hybrid role.

The position focuses on streaming, observability, and infrastructure guardrails within a regulated enterprise environment, with extensive use of Kafka, Snowflake, and monitoring tools. You will shape data pipelines for audit and consumption use cases while ensuring strong runtime observability.

Qualifications

• Data Engineering: 10 years (Required).
• AI: 2 years (Required).
• Kafka: 10 years (Required).
• OpenTelemetry: 6 years (Required).

Responsibilities

• Build and operate an API gateway, reverse proxy, or multi-tenant platform.
• Implement LLM delivery features such as streaming and server-sent events, plus token accounting.
• Apply prompt and response guardrails and support model evaluation.
• Use Kafka and Snowflake for audit and consumption data pipelines.
• Deliver strong observability using Prometheus and PromQL, Grafana, Loki, and OpenTelemetry.
• Operate effectively in a regulated enterprise environment with proxies and private networking.

Skills

Data Engineering

AI

Kafka

OpenTelemetry

Tools

API gateway

Reverse proxy

Multi-tenant platform

Kafka

Snowflake

Prometheus

PromQL

Grafana

Loki

OpenTelemetry

Redis

Valkey

Job description

RV Soft is seeking a Data AI Engineer to build and operate LLM platform capabilities alongside production data pipelines in a Chicago-based hybrid role.

The position focuses on streaming, observability, and infrastructure guardrails within a regulated enterprise environment, with extensive use of Kafka, Snowflake, and monitoring tools. You will shape data pipelines for audit and consumption use cases while ensuring strong runtime observability.