Senior ML Platform Engineer - Production Systems & LLMs

Invoca; New York (NY); Remote; USD 152,000 - 228,000; Full time

Benefits offered by this job

Flexible Time Off

Health Benefits

Job summary

Invoca is seeking a Senior ML Engineer to own the production ML stack, turn trained models into scalable services, and partner with product teams to ship AI-driven features. You will drive CI/CD for ML artifacts, manage latency and cost, and optimize inference at scale.

The role emphasizes hands-on deployment, collaboration with data scientists and engineers, and improving the platform to accelerate AI product delivery across Invoca’s customer experiences.

Qualifications

• 5+ years of ML Engineering experience with a strong production focus.
• Advanced Python and deep learning proficiency (PyTorch, HuggingFace Transformers, spaCy).
• Demonstrated track record deploying and maintaining transformer-based NLP models in production.
• Hands-on experience fine-tuning SLMs/LLMs (LoRA, QLoRA, PEFT) and optimizing models via quantization, batching, and throughput tuning.
• Proficiency with inference infrastructure: Triton, Baseten, vLLM, TGI, SageMaker, Vertex AI, or similar.

Responsibilities

• Architect, implement, and maintain CI/CD pipelines for ML artifacts, including automated evaluation, versioning, and deployment.
• Serve as the primary SME for operational excellence across the Invoca ML stack: uptime, latency, throughput, and cost.
• Own inference infrastructure end to end: model serving on Triton Inference Server, Baseten, and Kubernetes-based GPU infrastructure.
• Profile and tune for low latency and high throughput; build robust, scalable APIs for internal and external model access.
• Contribute to model training infrastructure, data pipelines, and data lake foundations.

Skills

Python

Deep Learning

Transformer NLP

LoRA/PEFT

MLOps

APIs

Inference Infra

Triton/Baseten

PyTorch

HuggingFace

Education

B.S. in Computer Science

Advanced degree preferred

Tools

Triton

Baseten

Kubernetes

vLLM

SageMaker

MLflow

Job description

Invoca is seeking a Senior ML Engineer to own the production ML stack, turn trained models into scalable services, and partner with product teams to ship AI-driven features. You will drive CI/CD for ML artifacts, manage latency and cost, and optimize inference at scale.

The role emphasizes hands-on deployment, collaboration with data scientists and engineers, and improving the platform to accelerate AI product delivery across Invoca’s customer experiences.