Enterprise AI Engineer: Production-Grade & Explainable

Vizient, Inc.; Chicago (IL); Vor Ort; USD 102.000 - 179.000; Vollzeit

Benefits dieser Stelle

Incentive eligible

Comprehensive benefits plan

Zusammenfassung

Vizient, Inc. designs, builds and supports production AI capabilities for complex enterprise workflows.

You will develop AI-enabled applications combining large language models, retrieval, and structured data to deliver reliable, explainable results. You will partner with domain experts, architects, and software engineers to translate specialized knowledge into maintainable software while establishing evaluation, testing, and observability practices to operate AI applications within quality

Qualifikationen

• 5+ years of relevant experience required.
• Strong experience developing production applications using Python.
• Hands-on experience building, deploying, and supporting generative AI in production.
• Experience integrating large language models via APIs or managed AI platforms.
• Experience with prompt engineering, structured model outputs, tool/function calling, retrieval-augmented generation, or agentic workflows.
• Experience building data-driven APIs and distributed application services using FastAPI or comparable frameworks.
• Experience developing automated tests and evaluation methods for nondeterministic AI behavior.
• Experience with embeddings, semantic search, vector retrieval, reranking, or knowledge-retrieval techniques.
• Experience with Microsoft Azure, Azure AI Foundry, Azure AI Search, Databricks, or Azure Service Bus preferred.
• Experience with AI evaluation, tracing, observability tooling, SQL, NoSQL databases, or agent‑orchestration frameworks preferred.
• Experience developing applications involving sensitive, regulated, or high‑consequence enterprise data preferred.

Aufgaben

• Design and implement production AI-enabled application services and workflow components.
• Build modular large language model and agentic capabilities with defined inputs, outputs, and evaluation criteria.
• Develop retrieval and grounding solutions using structured data, semantic search, vector retrieval, and enterprise knowledge sources.
• Combine deterministic processing, rules, retrieval, and model inference within workflows.
• Build APIs, services, orchestration components, and asynchronous processing for production AI workloads.
• Develop automated evaluation and regression testing for LLM and AI behavior.
• Instrument applications to trace inputs, results, model interactions, decisions, errors, latency, and observability.
• Investigate AI failure modes and use evidence to improve prompts, retrieval, and design.
• Evaluate models and approaches based on quality, performance, security, maintainability and cost.
• Collaborate with domain experts to translate complex decisions into maintainable software behavior.
• Participate in architecture reviews, design sessions, code reviews, and continuous improvement.
• Develop reusable AI engineering patterns, components, documentation, and evaluation practices.
• Support deployed AI applications through monitoring, troubleshooting, and performance optimization.

Kenntnisse

Python

Generative AI

APIs

FastAPI

Prompt engineering

Embeddings

Semantic search

Vector retrieval

Reranking

Azure

Databricks

Observability tooling

SQL/NoSQL

Ausbildung

Relevant degree preferred

Jobbeschreibung

Vizient, Inc. designs, builds and supports production AI capabilities for complex enterprise workflows.

You will develop AI-enabled applications combining large language models, retrieval, and structured data to deliver reliable, explainable results. You will partner with domain experts, architects, and software engineers to translate specialized knowledge into maintainable software while establishing evaluation, testing, and observability practices to operate AI applications within quality