Senior ML Engineer III - Hybrid, Scale Production LLMs

Remitly; Raleigh (NC); Hybrid; USD 118,000 - 220,000; Full time

Job summary

Remitly in Raleigh, NC is seeking a Consultant-level Machine Learning Engineer to lead the implementation and scaling of AI systems for legal products. You will own system architecture, infrastructure, and productionization of ML/LLM solutions.

You will partner with Data Scientists to turn validated models into reliable, high-performance, customer-facing systems, guiding cross-functional teams in deployment, monitoring, and optimization.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Experience implementing and scaling production ML/LLM systems.
• LLM application development, including RAG and prompt orchestration.
• Agentic systems using agent frameworks (e.g., LangChain, LangGraph, AutoGen, Google ADK) with multi-step production workflows.
• Hybrid search (semantic + lexical), embeddings, and search platforms (Solr, OpenSearch).
• Distributed systems and cloud-native development, including AWS (S3, DynamoDB).
• Streaming/messaging systems (Kafka, SQS) and caching (Redis).
• Python proficiency and systems languages (Rust, Go, Scala).
• Experience building scalable APIs (REST/GraphQL).
• Containerization/orchestration (Docker, Kubernetes).
• Strong software engineering fundamentals (system design, CI/CD).

Responsibilities

• Architect and implement scalable ML/LLM systems in production.
• Build and deploy LLM applications, including RAG pipelines and agentic systems.
• Implement hybrid search systems (semantic + lexical) using embeddings and search platforms.
• Develop and maintain APIs, microservices, and model serving infrastructure.
• Build data pipelines and streaming systems for large-scale data processing.
• Define reusable frameworks, libraries, and infrastructure for AI/ML across teams.
• Optimize systems for latency, scalability, reliability, and cost.
• Establish best practices for deployment, monitoring, observability, and CI/CD.
• Collaborate with Data Scientists to productionize models and integrate into products.
• Provide technical leadership in system design and engineering standards.

Skills

ML/LLM systems

Prompt orchestration

Agentic systems

Hybrid search

Python

REST GraphQL

System design

CI/CD

Distributed systems

Writ large - architecture

Education

Bachelor's degree in CS/Engineering

Tools

LangChain

LangGraph

AutoGen

Google ADK

Solr

OpenSearch

AWS

Kafka

Redis

Docker

Kubernetes

Job description

Remitly in Raleigh, NC is seeking a Consultant-level Machine Learning Engineer to lead the implementation and scaling of AI systems for legal products. You will own system architecture, infrastructure, and productionization of ML/LLM solutions.

You will partner with Data Scientists to turn validated models into reliable, high-performance, customer-facing systems, guiding cross-functional teams in deployment, monitoring, and optimization.