Remote ML Engineer for Production LLMs & MLOps

Vertex Agility; United States; On-site; USD 140,000 - 210,000; Full time

Job summary

Vertex Agility is a remote-first digital transformation consultancy that partners with global enterprises to deploy AI, cloud, and security solutions. We seek an ML Engineer to help build production AI systems using hosted and open-source models.

You will design and deploy LLM-powered applications, scalable inference pipelines, and reusable MLOps infrastructure, collaborating with Engineering and Data teams to deliver reliable AI solutions at scale.

Qualifications

• Strong hands-on experience with Python and production software engineering practices.
• Proven experience building and deploying LLM-powered applications.
• Experience with OpenAI and Anthropic Claude APIs in production environments.
• Hands-on experience implementing Agentic AI, Function Calling, Tool Use, or MCP (Model Context Protocol).
• Experience deploying and serving open-source LLMs (Hugging Face or similar).
• Strong understanding of GPU acceleration, scalable inference, and ML performance optimization.
• Experience with AWS services (Batch, ECS, Lambda, SQS, or similar).
• Strong SQL skills and experience working with data warehouses.
• Experience building and maintaining CI/CD pipelines for ML workloads; knowledge of observability, logging, monitoring, and alerting for production ML systems.

Responsibilities

• Design, develop, and maintain production-grade LLM-powered applications, including chat interfaces and MCP servers
• Build and optimize AI systems using OpenAI, Anthropic Claude, and open-source LLMs
• Develop agentic AI workflows including function calling, tool use, and multi-step reasoning pipelines
• Deploy, optimize, and maintain ML classification models for scalable production environments
• Build reliable inference pipelines with efficient GPU/CPU utilization and performance optimization
• Develop and maintain reusable MLOps infrastructure across AI workload

Skills

Python

LLM-powered applications

OpenAI APIs

Anthropic Claude APIs

Agentic AI

Function Calling

Tool Use

MCP (Model Context Protocol)

Open-source LLMs

GPU acceleration

AWS

SQL

CI/CD for ML

Observability/Monitoring

Tools

Hugging Face

Job description

Vertex Agility is a remote-first digital transformation consultancy that partners with global enterprises to deploy AI, cloud, and security solutions. We seek an ML Engineer to help build production AI systems using hosted and open-source models.

You will design and deploy LLM-powered applications, scalable inference pipelines, and reusable MLOps infrastructure, collaborating with Engineering and Data teams to deliver reliable AI solutions at scale.