Remote ML Platform Engineer (AI) - Scale LLM Infra

BairesDev; United States; Remote; USD 120,000 - 190,000; Full time

Benefits offered by this job

100% remote work

Competitive USD compensation

Home office setup support

Flexible hours

Job summary

BairesDev is seeking an ML Platform Engineer (AI) to build and maintain internal infrastructure for AI-enabled applications, bridging research and production to ensure robust model gateways and evaluation pipelines.

You will design scalable vector stores for retrieval-augmented generation, deploy high-performance LLM serving with vLLM or TGI, and implement observability to monitor model health and performance.

Qualifications

• 4+ years of experience in ML Platform Engineering, DevOps, or Infrastructure Engineering.
• Proven expertise in building and managing internal AI infrastructure, including model gateways and evaluation pipelines.
• Strong proficiency with Kubernetes and Docker for orchestrating containerized workloads.
• Hands-on experience with LLM serving frameworks like vLLM or TGI and cloud AI services such as AWS Bedrock or Azure OpenAI.
• Advanced proficiency in Python and observability tools like Langfuse or LangSmith.
• Advanced proficiency in English.

Responsibilities

• Architect and manage production-grade internal AI infrastructure, including model gateways and agent deployment platforms.
• Design and implement automated evaluation pipelines to ensure the quality and reliability of LLM outputs.
• Build and optimize scalable vector stores to support retrieval-augmented generation and efficient data retrieval.
• Deploy and manage high-performance LLM serving solutions using technologies like vLLM and TGI.
• Implement comprehensive observability and monitoring frameworks to track model performance and system health.
• Collaborate with application teams to standardize workflows for continuous model training, inference, and security.

Skills

Python

English

DevOps / Infrastructure

Tools

Kubernetes

Docker

LLM serving (vLLM/TGI)

Langfuse

LangSmith

AWS Bedrock

Azure OpenAI

Job description

BairesDev is seeking an ML Platform Engineer (AI) to build and maintain internal infrastructure for AI-enabled applications, bridging research and production to ensure robust model gateways and evaluation pipelines.

You will design scalable vector stores for retrieval-augmented generation, deploy high-performance LLM serving with vLLM or TGI, and implement observability to monitor model health and performance.