Senior ML Engineer: Lead Scalable LLM Systems (Hybrid - Raleigh)

Archer; Raleigh (NC); Hybrid; USD 118,000 - 220,000; Full time

Job summary

Archer in Raleigh, NC, is seeking a Consultant-level Machine Learning Engineer to lead production ML/LLM systems for legal products. This full-time role is hybrid—3 days in office—and focuses on scalable architecture and deployment.

You will collaborate with Data Scientists to transform validated models into reliable customer-facing systems, build RAG pipelines, and drive best practices in CI/CD and observability.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• Strong experience implementing and scaling production ML/LLM systems.
• Deep experience with LLM application development, including RAG and prompt orchestration.
• Strong experience designing and implementing agentic systems using agent frameworks (e.g., LangChain, LangGraph, AutoGen, Google ADK), including orchestration of multi-step workflows in production environments.
• Strong experience with hybrid search (semantic + lexical), embeddings, and search platforms (e.g., Solr, OpenSearch).
• Expertise in distributed systems and cloud-native development, including AWS (S3, DynamoDB).
• Experience with streaming and messaging systems (e.g., Kafka, SQS) and caching (e.g., Redis).
• Proficiency in Python and experience with systems languages (e.g., Rust, Go, Scala).
• Experience building scalable APIs (REST/GraphQL).
• Experience with containerization and orchestration (Docker, Kubernetes).
• Strong software engineering fundamentals (system design, testing, CI/CD).

Responsibilities

• Architect and implement scalable ML/LLM systems in production.
• Build and deploy LLM applications, including RAG pipelines and agentic systems.
• Implement hybrid search systems (semantic + lexical) using embeddings and search platforms.
• Develop and maintain APIs, microservices, and model serving infrastructure.
• Build data pipelines and streaming systems for large-scale data processing.
• Define and develop reusable frameworks, libraries, and infrastructure for AI/ML across teams.
• Optimize systems for latency, scalability, reliability, and cost efficiency.
• Establish best practices for deployment, monitoring, observability, and CI/CD.
• Collaborate with Data Scientists to productionize models and integrate into products.
• Provide technical leadership in system design and engineering standards.

Skills

ML systems

RAG pipelines

LangChain

Python

Distributed systems

AWS

Kubernetes

Docker

REST/GraphQL

CI/CD

LangGraph

AutoGen

Google ADK

Education

Bachelor’s degree in CS/Engineering

Tools

Solr

OpenSearch

Kafka

SQS

Redis

DynamoDB

Terraform

CloudFormation

Jenkins

Docker

Job description

Archer in Raleigh, NC, is seeking a Consultant-level Machine Learning Engineer to lead production ML/LLM systems for legal products. This full-time role is hybrid—3 days in office—and focuses on scalable architecture and deployment.

You will collaborate with Data Scientists to transform validated models into reliable customer-facing systems, build RAG pipelines, and drive best practices in CI/CD and observability.