AI/ML Engineer Team Lead

Vizient; Centennial (CO); Vor Ort; USD 118.000 - 206.000; Vollzeit

Zusammenfassung

Vizient is seeking a senior AI/ML architect to lead the design, deployment, and operation of enterprise AI solutions across knowledge-intensive workflows. You will combine generative AI, deterministic processing, and retrieval with hands-on architecture leadership to deliver secure, explainable applications.

In this role you will collaborate with domain experts, product leaders, and data/platform teams to translate complex challenges into scalable systems while mentoring engineers and

Qualifikationen

• 7 or more years of relevant experience in software or AI systems.
• Experience leading complex production-grade AI projects.
• Hands-on with architecture, design, and implementation of AI systems.
• Strong Python and API development experience (FastAPI or equivalent).
• Experience with LLMs, prompting, and retrieval-augmented generation.
• Experience in cloud-native architectures and production observability.

Aufgaben

• Lead architecture, development, deployment, and operation of AI/ML solutions.
• Design solutions combining LLMs, retrieval, and deterministic processing.
• Translate expert workflows into modular, testable software components.
• Determine optimal use of AI inference vs rules and data processing.
• Establish evaluation strategies and quality metrics.
• Design observability to capture decision traces and performance.
• Investigate grounding failures, hallucinations, retrieval quality, and cost.
• Evaluate tradeoffs across performance, security, and maintainability.
• Develop APIs, services, and production components; participate in code reviews.
• Implement security, privacy, and production-readiness practices.
• Mentor engineers and drive continuous improvement with real-world metrics.

Kenntnisse

AI leadership

Python API

LLM prompting

Evaluation strategies

Cloud-native architecture

Security & compliance

Azure AI

Databricks

Vector databases

Production ML systems

Ausbildung

Relevant degree preferred

Jobbeschreibung

When you're the best, we're the best. We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authentic selves. We provide extensive opportunities for personal and professional development, building both employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future.

Summary

In this role, you will lead the technical design, development, deployment, and operation of enterprise-grade AI solutions for complex, knowledge-intensive workflows. You will combine generative AI, agentic workflows, retrieval, structured and unstructured data, deterministic processing, and human expertise to create accurate, secure, explainable, and reliable production applications. You will remain hands-on with architecture and implementation while leading engineers, establishing evaluation and observability practices, and partnering with domain experts, product leaders, architects, data teams, and platform teams to translate ambiguous business challenges into scalable technical solutions.

Responsibilities

• Lead the architecture, development, deployment, and operation of enterprise-grade AI and machine learning solutions.
• Design solutions that combine large language models, agentic workflows, retrieval, structured data, APIs, and deterministic processing.
• Translate complex expert workflows into modular, testable, and maintainable software components.
• Determine where AI inference, deterministic logic, retrieval, rules, or traditional data processing will produce the most reliable outcome.
• Establish evaluation strategies using representative test sets, expert-reviewed outcomes, regression testing, quality measurements, and stage-level analysis.
• Design observability capabilities that capture intermediate outputs, decision traces, evaluation results, performance measures, and failure modes.
• Lead investigations into grounding failures, hallucinations, retrieval quality, prompt behavior, model selection, orchestration, latency, accuracy, and cost.
• Evaluate architectural tradeoffs across performance, maintainability, extensibility, security, reliability, supportability, and operating cost.
• Develop APIs, services, prototypes, and production components while contributing to design reviews, code reviews, and complex technical problem-solving.
• Implement security, privacy, auditability, monitoring, and production-readiness practices for AI-enabled applications.
• Partner with domain experts, product leaders, architects, data teams, and platform teams to convert specialized knowledge into scalable system behavior.
• Develop reusable AI capabilities, engineering patterns, evaluation frameworks, and platform components that support multiple solutions.
• Mentor engineers and strengthen team practices across AI engineering, software design, testing, observability, and production operations.
• Drive continuous improvement by incorporating production metrics, evaluation results, expert feedback, and real-world user outcomes.

Qualifications

• Relevant degree preferred.
• 7 or more years of relevant experience required.
• Experience providing technical leadership for complex, production-grade software or AI systems required.
• Demonstrated experience personally designing, building, deploying, and operating generative AI or machine learning applications in enterprise production environments required.
• Strong experience with Python and modern API and service development, including FastAPI or comparable frameworks required.
• Experience with large language models, prompt engineering, structured outputs, tool or function calling, retrieval-augmented generation, and agentic workflows required.
• Experience establishing evaluation strategies for nondeterministic AI systems, including test datasets, regression evaluation, grounding, quality measurement, and failure analysis required.
• Strong understanding of the appropriate boundaries between probabilistic AI behavior and deterministic software, rules, retrieval, and data processing required.
• Experience with cloud-native architecture, asynchronous processing, APIs, events or queues, persistence, monitoring, and production observability required.
• Experience addressing enterprise security, privacy, reliability, auditability, supportability, performance, and cost requirements required.
• Experience with Microsoft Azure, Azure AI Foundry, Azure AI Search, or comparable cloud AI and semantic-retrieval technologies preferred.
• Experience with Databricks, vector databases, embeddings, reranking, semantic search, or enterprise knowledge-retrieval platforms preferred.
• Experience developing AI solutions involving sensitive, regulated, or high-consequence data and decisions preferred.
• Strong technical leadership, mentoring, communication, problem-solving, architecture, and cross-functional collaboration skills.

Estimated Hiring Range

At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $117,600.00 to $206,000.00.

This position is also incentive eligible.

Vizient has a comprehensive benefits plan! Please view our benefits here:

http://www.vizientinc.com/about-us/careers

Equal Opportunity Employer: Females/Minorities/Veterans/Individuals with Disabilities

The Company is committed to equal employment opportunity to all employees and applicants without regard to race, religion, color, gender identity, ethnicity, age, national origin, sexual orientation, disability status, veteran status or any other category protected by applicable law.