Agentic AI Engineer - Observability & Automation

Stellar IT Solutions LLC; Santa Clara (CA); On-site; USD 120,000 - 180,000; Full time

Job summary

Stellar IT Solutions LLC in Santa Clara, CA seeks an AI Engineer to design, develop, and deploy agentic AI systems that automate engineering workflows, with a focus on evaluation frameworks, telemetry pipelines, and observability standards.

You will ensure AI agents operate efficiently, reliably, and transparently, combining strong software engineering with AI observability, anomaly detection, and performance optimization to deliver scalable tooling.

Responsibilities

• Design, develop, and deploy AI agents that automate engineering workflows, including experiment configuration, results analysis, regression detection, and recommendations.
• Build and maintain evaluation harnesses for agentic systems (regression suites, golden sets, scoring rubrics) integrated into release pipelines.
• Architect ingestion and storage pipelines for agent telemetry at scale, ensuring fast and actionable queries during live incidents.

Job description

Stellar IT Solutions LLC in Santa Clara, CA seeks an AI Engineer to design, develop, and deploy agentic AI systems that automate engineering workflows, with a focus on evaluation frameworks, telemetry pipelines, and observability standards.

You will ensure AI agents operate efficiently, reliably, and transparently, combining strong software engineering with AI observability, anomaly detection, and performance optimization to deliver scalable tooling.