On-Site AI Engineer II: Agentic AI & LLM Ops

System One; Pittsburgh (Allegheny County); On-site; USD 110,000 - 150,000; Full time

Job summary

System One is seeking an AI Engineer II (Mid-Level) to design, build, and ship agentic AI tools in Azure within its enterprise environment. You will work under the direction of an AI architect, owning the codebase and day-to-day decisions in a hands-on role with mentorship.

The position emphasizes production-grade orchestration, security controls, and end-to-end delivery of enterprise AI workflows, with a focus on accuracy, auditability, and integration across corporate systems.

Qualifications

• BS in Computer Science, Engineering, or related field; MS preferred
• 3–6 years of software, ML, or data engineering experience, with at least 1 year building LLM applications in production
• Expert Python; strong API design and SQL; familiarity with C#/.NET applications and Microsoft SQL Server/Azure SQL
• Shipped at least one agentic or RAG system to real users
• Experience using AI coding assistants or AI development agents in professional software development, including reviewing, testing, and validating AI-generated code before deployment
• Experience developing and deploying applications in Microsoft Azure, including cloud identity, networking, containers, and serverless technologies
• Experience with infrastructure as code and CI/CD using Azure DevOps or comparable enterprise development practices
• Experience designing evaluation methods for LLM outputs

Responsibilities

• Turn complex business processes into working agent designs with the architect: agent roles, tool schemas, memory, and human-in-the-loop review points
• Build production-grade orchestration with LangGraph and Microsoft Agent Framework; integrate tools through MCP and enterprise APIs
• Integrate agents with System One business platforms and data flows; enforce output accuracy with validation rules and reconciliation checks
• Design retrieval over business documents with hybrid search, reranking, metadata filtering, and document-level access control
• Build and maintain application infrastructure in Microsoft Azure using infrastructure as code and approved CI/CD pipelines
• Establish LLMOps: automated evaluation suites, guardrails, tracing, and cost and latency budgets
• Implement security controls: least-privilege identity, secrets handling, audit logging, protection of sensitive business data
• Write design and support documentation, manage work through Azure DevOps Boards, report progress to stakeholders

Skills

Python

API design

SQL

C#/.NET

Azure

LLMs

DevOps

Security

Education

B.S. CS or related

M.S. preferred

Tools

LangGraph

Microsoft Agent Framework

Azure DevOps

MCP

Job description

System One is seeking an AI Engineer II (Mid-Level) to design, build, and ship agentic AI tools in Azure within its enterprise environment. You will work under the direction of an AI architect, owning the codebase and day-to-day decisions in a hands-on role with mentorship.

The position emphasizes production-grade orchestration, security controls, and end-to-end delivery of enterprise AI workflows, with a focus on accuracy, auditability, and integration across corporate systems.