Senior GenAI & LLM Platform Engineer

Able Too Work; Columbus (OH); On-site; USD 122,000 - 241,000; Full time

Job summary

Deloitte's HC Forward team seeks an AI Engineer III to design, build, and operate governed data, features, and retrieval layers powering AI/GenAI products and analytics. You will collaborate with AI Data Engineers and Architects to deliver secure, scalable solutions and production pipelines for model training, inference, and LLM apps.

The role emphasizes governance, cost-performance discipline, and strong security controls across data and AI workflows, with travel up to 25% and a focus on

Qualifications

• Bachelor's degree in a STEM field.
• 4+ years building and delivering LLM/GenAI solutions with Claude/GPT/Gemini-class models.
• 4+ years implementing RAG, document processing, embeddings, vector/hybrid search.
• 4+ years of data and AI engineering with pipelines, feature serving, and real-time inference.
• 4+ years leading platform/integration engineering with REST, GraphQL, microservices.
• 4+ years DevOps/DevSecOps with CI/CD, Terraform/CloudFormation, Docker/Kubernetes, observability.
• 4+ years leading security/compliance with IAM, encryption, audit logging, and data/privacy controls.
• Ability to travel 0-25%.
• Limited immigration sponsorship may be available.

Responsibilities

• Design, build, and run the governed data, feature, and retrieval layer for AI/ML and GenAI solutions.
• Deliver reproducible datasets and features, enable secure consumption patterns.
• Implement LLM-enabled capabilities using Claude/GPT/Gemini, with secure endpoints and tooling.
• Apply RAG, document ingestion, embeddings, and vector/hybrid search patterns.
• Provide governed datasets and feature engineering for ML training and real-time inference.
• Ensure data/model reliability, cost-performance discipline, and CI/CD, observability, and runbooks.

Skills

LLM deployment

API design

Docker/Kubernetes

CI/CD

MLOps

Data governance

Security/compliance

Python

Cloud platforms

Team collaboration

Education

Bachelor's in STEM

MS/PhD in AI

Tools

Terraform

CloudFormation

Docker

Kubernetes

Job description

Deloitte's HC Forward team seeks an AI Engineer III to design, build, and operate governed data, features, and retrieval layers powering AI/GenAI products and analytics. You will collaborate with AI Data Engineers and Architects to deliver secure, scalable solutions and production pipelines for model training, inference, and LLM apps.

The role emphasizes governance, cost-performance discipline, and strong security controls across data and AI workflows, with travel up to 25% and a focus on