Senior AI Systems Engineer - Production ML & RAG Pipelines

RELX International; Oklahoma City (OK); On-site; USD 95,000 - 159,000; Full time

Benefits offered by this job

Health benefits

401(k) with match

Wellbeing platform and Headspace

Disability & life insurance

Family benefits

Commuter spending accounts

Job summary

RELX International is seeking a senior software engineer to design, build, and deliver production AI systems, including agentic workflows, LLM-powered pipelines, RAG, and structured extraction services across multiple business units.

You will mentor junior engineers, translate ambiguous problems into measurable AI solutions, and collaborate with stakeholders to define requirements, success metrics, and scalable architectures.

Qualifications

• 5+ years of software engineering experience, including 2+ years building and shipping LLM-based or ML-based systems to production
• BS in Engineering/Computer Science or equivalent experience required
• Demonstrated track record of owning an AI feature or service end to end: design, evaluation, deployment, and monitoring
• Expert proficiency in TypeScript/Node.js and/or Python; working knowledge of C#/.NET is a plus
• Hands-on experience with LLM platforms and APIs (Azure OpenAI or equivalent)
• Experience building RAG pipelines: chunking, embedding, hybrid retrieval, reranking, grounding/citation
• Strong understanding of schema-driven structured extraction from unstructured data (Zod, Pydantic, JSON Schema) and validation strategies
• Experience with evaluation frameworks for AI systems: golden datasets, LLM-as-judge, precision/recall on extraction tasks
• Strong SQL proficiency and understanding of relational and vector data storage
• Working experience with both AWS and Azure, including compute, storage, networking, IAM, and managed AI services; containerized deployment (Docker, Kubernetes or equivalent)
• Strong knowledge of software development best practices, test-driven development, and code review

Responsibilities

• Design, build, and deploy production AI systems including agentic workflows, RAG services, and extraction pipelines across multiple business units
• Interface with business stakeholders and technical team members to scope AI use cases, define success metrics, and finalize requirements
• Write and review detailed technical specifications and architecture documents for complex AI system components
• Build and maintain evaluation harnesses; establish accuracy, latency, and cost baselines and monitor them in production
• Implement responsible AI practices: data handling, PII controls, hallucination mitigation, auditability, and human review where required
• Own cost and performance of LLM workloads, including model selection, caching, and usage attribution
• Build and maintain CI/CD pipelines and deployment automation for AI services across AWS and Azure environments
• Operate in Agile development environments while collaborating with key stakeholders across engineering, product, and business functions
• Mentor less-senior engineers on AI system design, evaluation methodology, and production readiness

Skills

LLM-based systems

RAG pipelines

Structured extraction

SQL proficiency

AWS & Azure experience

Mentoring

Agile

Education

BS in Engineering/Computer Science or equivalent experience

Tools

TypeScript/Node.js

Python

C#/.NET

Docker

Kubernetes

Job description

RELX International is seeking a senior software engineer to design, build, and deliver production AI systems, including agentic workflows, LLM-powered pipelines, RAG, and structured extraction services across multiple business units.

You will mentor junior engineers, translate ambiguous problems into measurable AI solutions, and collaborate with stakeholders to define requirements, success metrics, and scalable architectures.