Lead AI/ML Engineer — Production RAG & On-Prem LLMs

Tenth Revolution Group; North Carolina; Hybrid; USD 150.000 - 230.000; Vollzeit

Zusammenfassung

Tenth Revolution Group is seeking a Lead AI/ML Engineer for a growing technology consultancy focused on secure, production-grade AI solutions for the banking industry.

This hands-on role emphasizes production LLM applications, RAG, retrieval, model serving, tool orchestration, and evaluation in highly regulated environments. You will collaborate with data, platform, and product teams to build auditable AI systems that operate securely in bank environments.

Qualifikationen

• 6+ years of software/ML engineering experience with production LLM/RAG systems.
• Proven experience taking AI systems from prototype to production and real users.
• Strong Python skills and solid software engineering fundamentals.
• Hands-on experience building production RAG/retrieval pipelines.

Aufgaben

• Design and build production-grade RAG and retrieval systems with verifiable sources and citations.
• Develop retrieval and verification workflows across structured and unstructured banking data.
• Deploy and operate self-hosted open-weight LLMs and embedding models in bank environments.
• Build and evolve standardized RAG architecture and patterns.
• Design and implement an MCP/tooling layer for secure data interaction.
• Build tool/function-calling workflows with auditing and access controls.
• Develop and own an AI evaluation framework for regression testing and groundedness.
• Make evaluation a formal release gate for production AI systems.
• Implement LLM guardrails including PII redaction and prompt-injection defenses.
• Partner with data engineering to ensure governed semantic-layer metrics are used.
• Work with platform and security engineering to deploy reliable AI infrastructure.
• Monitor latency, cost, and model performance across deployments.
• Document architecture, evaluation methodology, and guardrails for security reviews.
• Provide technical leadership while remaining hands-on.

Kenntnisse

Python

Production LLMs

RAG pipelines

Retrieval systems

Security controls

Tooling

Tools

vLLM

Ollama

NVIDIA GPUs

CUDA

dbt

Jobbeschreibung

Tenth Revolution Group is seeking a Lead AI/ML Engineer for a growing technology consultancy focused on secure, production-grade AI solutions for the banking industry.

This hands-on role emphasizes production LLM applications, RAG, retrieval, model serving, tool orchestration, and evaluation in highly regulated environments. You will collaborate with data, platform, and product teams to build auditable AI systems that operate securely in bank environments.