Senior Machine Learning Engineer III ***Raleigh, NC***

RELX

Raleigh (NC)

Hybrid

USD 118,300 - 219,800

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Country-specific benefits
Hybrid work arrangement

Job summary

RELX in Raleigh, NC is seeking a Consultant-level Machine Learning Engineer to lead the implementation and scaling of AI systems for legal products. You will own system architecture, infrastructure, and productionization of ML/LLM solutions, collaborating with Data Scientists to turn validated models into reliable customer-facing systems.

The role requires experience building scalable ML/LLM applications, RAG pipelines, and distributed systems. Hybrid work: 3 days in office.

Qualifications

  • Bachelor’s degree in CS/Engineering required.
  • Proven experience scaling production ML/LLM systems.
  • Deep experience with LLM application development, including RAG and prompt orchestration.
  • Experience designing agentic systems using agent frameworks and multi-step workflow orchestration.
  • Strong experience with hybrid search (semantic + lexical), embeddings, and search platforms (Solr/OpenSearch).
  • Expertise in distributed systems and cloud-native development on AWS (S3, DynamoDB).
  • Experience with streaming/messaging (Kafka/SQS) and caching (Redis).
  • Proficiency in Python and systems languages (Rust/Go/Scala).
  • Experience building scalable APIs (REST/GraphQL).
  • Experience with Docker and Kubernetes in production.

Responsibilities

  • Architect and implement scalable ML/LLM systems in production.
  • Build and deploy LLM applications, including RAG pipelines and agentic systems.
  • Implement hybrid search systems using embeddings and search platforms.
  • Develop and maintain APIs, microservices, and model serving infra.
  • Build data pipelines and streaming systems for large-scale data processing.
  • Define reusable frameworks, libraries, and infra for AI/ML across teams.
  • Optimize systems for latency, scalability, reliability, and cost.
  • Establish best practices for deployment, monitoring, and CI/CD.
  • Collaborate with Data Scientists to productionize models.
  • Provide technical leadership in system design and engineering standards.

Skills

System architecture
Production ML/LLM
Cross-functional collaboration
Python
CI/CD / DevOps

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

LangChain
LangGraph
AutoGen
Google ADK
Solr
OpenSearch
AWS (S3, DynamoDB)
Kafka
SQS
Redis
Python
Rust
Go
Scala
REST/GraphQL
Docker
Kubernetes
Terraform
CloudFormation

Job description

Are you looking to develop your Machine Learning Engineer career?

Do you enjoy coaching others to achieve high standards?

This is a full-time position based in Raleigh, NC.

(Hybrid - 3 days in office)

About The Role

We are seeking a Consultant-level Machine Learning Engineer to lead the implementation and scaling of AI systems for legal products. This role focuses on how to build and scale—owning system architecture, infrastructure, and productionization of ML/LLM solutions.

You will partner with Data Scientists to turn validated models and prototypes into reliable, high-performance, customer-facing systems.

Key Responsibilities
  • Architect and implement scalable ML/LLM systems in production.
  • Build and deploy LLM applications, including RAG pipelines and agentic systems.
  • Implement hybrid search systems (semantic + lexical) using embeddings and search platforms.
  • Develop and maintain APIs, microservices, and model serving infrastructure.
  • Build data pipelines and streaming systems for large-scale data processing.
  • Define and develop reusable frameworks, libraries, and infrastructure for AI/ML across teams.
  • Optimize systems for latency, scalability, reliability, and cost efficiency.
  • Establish best practices for deployment, monitoring, observability, and CI/CD.
  • Collaborate with Data Scientists to productionize models and integrate into products.
  • Provide technical leadership in system design and engineering standards.
Required Qualifications
  • Bachelor’s degree in Computer Science, Engineering, or a related field.
  • Strong experience implementing and scaling production ML/LLM systems.
  • Deep experience with LLM application development, including RAG and prompt orchestration.
  • Strong experience designing and implementing agentic systems using agent frameworks (e.g., LangChain, LangGraph, AutoGen, Google ADK), including orchestration of multi-step workflows in production environments.
  • Strong experience with hybrid search (semantic + lexical), embeddings, and search platforms (e.g., Solr, OpenSearch).
  • Expertise in distributed systems and cloud-native development, including AWS (S3, DynamoDB).
  • Experience with streaming and messaging systems (e.g., Kafka, SQS) and caching (e.g., Redis).
  • Proficiency in Python and experience with systems languages (e.g., Rust, Go, Scala).
  • Experience building scalable APIs (REST/GraphQL).
  • Experience with containerization and orchestration (Docker, Kubernetes).
  • Strong software engineering fundamentals (system design, testing, CI/CD).
Preferred Qualifications
  • Experience with LLM platforms (e.g., ChatGPT/OpenAI, Claude, Gemini, LangChain, Google ADK).
  • Experience with DevOps and infrastructure as code (e.g., Terraform, CloudFormation, Jenkins).
  • Experience with big data technologies (e.g., Spark, Hadoop).
  • Familiarity with graph databases (e.g., Dgraph, Neo4j, Neptune).
  • Experience building high-availability, low-latency systems.
  • Experience in legal or regulatory domains.
Key Competencies
  • Strong system architecture and scalability mindset.
  • Ownership of implementation, performance, and reliability.
  • Ability to translate data science solutions into production systems.
  • Cross-functional collaboration with DS, product, and platform teams.
  • Excellent debugging, optimization, and operational skills.
  • Clear communication of technical designs and trade-offs.

#AIFluent

U.S. National Base Pay Range: $118,300 - $219,800. Geographic differentials may apply in some locations to better reflect local market rates. This job is eligible for an annual incentive bonus.

We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Machine Learning Engineer III ***Raleigh, NC***
Senior Machine Learning Engineer III ***Raleigh, NC***

LexisNexis • Raleigh (NC)

Hybrid
USD 118,000 - 220,000
Senior Machine Learning Engineer – Ai/LLm/Raleigh, Nc
Senior Machine Learning Engineer – Ai/LLm/Raleigh, Nc

NLP PEOPLE • Raleigh (NC)

On-site
USD 140,000 - 200,000
Bonus or Commission eligible
Medical Insurance
Dental Benefits
+3
Principal Machine Learning Engineer I
Principal Machine Learning Engineer I

LexisNexis • Raleigh (NC)

On-site
USD 136,000 - 253,000
Principal Machine Learning Engineer I
Principal Machine Learning Engineer I

RELX • Raleigh (NC)

On-site
USD 136,000 - 253,000
Country-specific benefits
Principal Machine Learning Engineer I *** Hybrid in Raleigh, NC
Principal Machine Learning Engineer I *** Hybrid in Raleigh, NC

RELX • Raleigh (NC)

On-site
USD 136,000 - 253,000
Comprehensive health benefits
401(k) retirement plan
Wellness platform
+1
Machine Learning Engineer Lead
Machine Learning Engineer Lead

LexisNexis • Raleigh (NC)

On-site
USD 115,000 - 193,000
Annual incentive bonus
Country-specific benefits
Lead Machine Learning Engineer
Lead Machine Learning Engineer

Motion Recruitment • Raleigh (NC)

On-site
USD 180,000 - 240,000
Machine Learning Engineer Lead
Machine Learning Engineer Lead

RELX • Raleigh (NC)

On-site
USD 115,000 - 192,000
Annual incentive bonus
Country-specific benefits
Lead ML Engineer — LLM AI Systems Architect (Hybrid)
Lead ML Engineer — LLM AI Systems Architect (Hybrid)

RELX • Raleigh (NC)

Hybrid
USD 118,000 - 220,000
Country-specific benefits
Hybrid work arrangement
Senior Machine Learning Engineer
Senior Machine Learning Engineer

Motion Recruitment • Charlotte (NC)

Hybrid
USD 140,000 - 190,000
Medical Insurance
Dental Benefits
Vision Benefits
+3