Remote AI Infrastructure Engineer (LLM & Vector Tech)

BairesDev

United States

Remote

USD 140,000 - 210,000

Full time

2 hours ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote work

USD payment

Hardware provided

Flexible hours

Parental leave

Career growth

Mentorship

Job summary

BairesDev is seeking an AI Infrastructure Engineer to design and build the core systems powering internal AI capabilities. You will enable model serving, agent deployment, and scalable vector stores to support AI-driven applications.

The role emphasizes Python, containerization with Kubernetes and Docker, cloud AI services, observability, and collaboration with global teams. Remote friendly, with competitive USD compensation and flexible scheduling.

Qualifications

4+ years in AI Infrastructure, DevOps, or Platform Engineering.
Proven experience building and managing internal AI infrastructure.
Proficiency in Python and containerization (Kubernetes, Docker).
Hands-on with LLM serving frameworks (vLLM, TGI) and cloud AI services (AWS Bedrock, Azure OpenAI).
Experience with observability and evaluation tools (Langfuse, LangSmith).
Advanced English proficiency.

Responsibilities

Architect and maintain internal AI infrastructure, incl. model gateways and agent deployment platforms.
Implement and optimize LLM serving with vLLM and TGI.
Design and manage scalable vector stores and eval pipelines.
Build and maintain production-grade containers with Kubernetes and Docker.
Integrate AWS Bedrock or Azure OpenAI into the core infrastructure.
Add observability for AI workflows using Langfuse and LangSmith.