A complete application in a minute
Tailored resume and cover letter, ready to send.
Robotic Technologies Automation in Dallas, TX seeks a Senior AI Observability & Evaluation Engineer to lead observability for Generative AI apps. You will monitor LLM performance, latency, token usage, and costs, and develop evaluation frameworks for RAG and agentic AI workflows in production.
The role requires hands‑on experience with OpenTelemetry, LangSmith/Langfuse/MLflow, Prometheus, Grafana, and cloud platforms.
Senior AI Observability & Evaluation Engineer
Dallas, TX
15 Months + Extension
$78/hour (C2C)
W-2, 1099, C2C
To Be Discussed Later
US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other
Manufacturing
We are looking for an experienced AI Observability and Evaluation Engineer with strong expertise in Python, Generative AI, LLM monitoring, and production AI systems. The ideal candidate should have hands‑on experience implementing observability frameworks, evaluating LLM outputs, monitoring RAG pipelines, and improving the reliability and performance of AI‑powered applications. The candidate should understand how to measure AI quality, identify hallucinations, and monitor agentic AI workflows in production environments.
Recent / Modern Skills (2025-2026)
We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.