AI Platform Engineer

The Judge Group; Charlotte (NC); On-site; USD 140,000 - 220,000; Full time

Job summary

The Judge Group seeks a hands-on Technical Lead - AI Platform to architect, build, and scale next-generation AI products. This role blends technical vision with execution, guiding the development of AI/ML platforms, GenAI solutions, intelligent applications, and cloud-native architectures.

You will lead a team of AI engineers, partnering with Product and Data Science to deliver impactful AI solutions on GCP and OCI, with emphasis on MLOps, observability, and cost optimization.

Qualifications

• 10+ years of software engineering and AI/ML experience, including 5+ years in technical leadership roles.
• Strong experience with Python, Java, TensorFlow, PyTorch, Scikit-learn, and modern cloud platforms.
• Expertise in GenAI, LLMs, RAG frameworks, AI agents, and MLOps.
• Experience with Vertex AI, OpenAI, LangChain, Pinecone, Kubeflow, Kubernetes, Docker, and CI/CD pipelines.
• Proven track record of delivering production-scale AI products and leading engineering teams.

Responsibilities

• Design and deploy end-to-end AI/ML solutions, including data pipelines, model training, inference services, and monitoring.
• Build AI-powered applications leveraging LLMs, RAG architectures, AI agents, copilots, and semantic search capabilities.
• Develop scalable solutions on Google Cloud Platform (GCP) and/or Oracle Cloud Infrastructure (OCI).
• Lead MLOps initiatives, ensuring reliable model deployment, automation, observability, and cost optimization.
• Drive technical strategy and mentor a high-performing team of AI engineers and developers.
• Partner with Product, Data Science, and business leaders to deliver impactful AI solutions.

Skills

Python

Java

TensorFlow

PyTorch

Scikit-learn

GenAI

LLMs

RAG

MLOps

Kubernetes

Docker

CI/CD

Cloud platforms

Tools

Vertex AI

OpenAI

LangChain

Pinecone

Kubeflow

Kubernetes

Docker

Job description

We’re seeking a hands-on Technical Lead - AI Platform to architect, build, and scale next-generation AI products. This role is ideal for an experienced engineering leader who can combine technical vision with execution, leading the development of AI/ML platforms, GenAI solutions, intelligent applications, and cloud-native architectures.

DESCRIPTION:

• Design and deploy end-to-end AI/ML solutions, including data pipelines, model training, inference services, and monitoring.
• Build AI-powered applications leveraging LLMs, RAG architectures, AI agents, copilots, and semantic search capabilities.
• Develop scalable solutions on Google Cloud Platform (GCP) and/or Oracle Cloud Infrastructure (OCI).
• Lead MLOps initiatives, ensuring reliable model deployment, automation, observability, and cost optimization.
• Drive technical strategy and mentor a high-performing team of AI engineers and developers.
• Partner with Product, Data Science, and business leaders to deliver impactful AI solutions.

QUALIFICATIONS:

• 10+ years of software engineering and AI/ML experience, including 5+ years in technical leadership roles.
• Strong experience with Python, Java, TensorFlow, PyTorch, Scikit-learn, and modern cloud platforms.
• Expertise in GenAI, LLMs, RAG frameworks, AI agents, and MLOps.
• Experience with Vertex AI, OpenAI, LangChain, Pinecone, Kubeflow, Kubernetes, Docker, and CI/CD pipelines.
• Proven track record of delivering production-scale AI products and leading engineering teams.