Remote AI Platform Engineer II: Build Scalable LLM Infra

MeridianLink; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Fully remote company

Mentorship from Senior/Staff engineers

AI/ML training

Monthly soft-skill sessions

Career development

Executive access

Job summary

MeridianLink is seeking an AI Platform Engineer II to advance the AI platform that powers MeridianLink’s product suite. You will implement model serving layers, retrieval infrastructure, prompt management, and evaluation services under guidance from senior staff, while developing APIs for product teams to integrate AI features.

You will also build observability, participate in design discussions, and mentor junior engineers to grow their AI systems and platform design expertise.

Qualifications

• 3–5 years of professional software engineering experience.
• Strong proficiency in backend engineering using Python, C#/.NET, Java, or Node.js.
• Solid understanding of algorithms, data structures, and system design principles.
• Hands‑on experience integrating large language models or ML models into production applications.
• Working knowledge of retrieval‑augmented generation (RAG) concepts, vector databases, and embedding pipelines.
• Experience building or contributing to shared services or platform components.
• Familiarity with cloud‑managed AI services (AWS Bedrock, Azure OpenAI, or equivalent).
• Experience with APIs, asynchronous processing, and event‑driven architectures.
• Bachelor's degree in Computer Science, Software Engineering, or equivalent professional experience.

Responsibilities

• Implement AI platform components — including model serving layers, retrieval infrastructure, prompt management, and output evaluation services — under the guidance of Senior and Staff engineers.
• Develop and maintain APIs that product teams use to integrate AI capabilities into their applications.
• Build observability and monitoring into platform services to track output quality, latency, cost, and system health.
• Contribute to design discussions and provide input on trade-offs between simplicity, reliability, and scalability.
• Work with product engineering teams to understand how they want to use AI capabilities and translate requirements into platform features.
• Participate in technical design sessions and code reviews with product teams building on the AI platform.
• Help identify patterns where multiple product teams are solving the same AI integration problem and consolidate that work.
• Contribute to documentation, reference implementations, and runbooks that help product teams adopt AI platform services.
• Participate in defining and enforcing integration standards — API contracts, error handling patterns, cost attribution.
• Mentor junior engineers (Engineer I) and help them grow their understanding of AI systems and platform design.
• Implement evaluation and monitoring pipelines that give teams visibility into AI output quality and model behavior.
• Contribute to content safety standards and compliance guardrails appropriate for a regulated financial services environment.
• Help design systems that properly handle PII, maintain audit trails, and meet data residency requirements in AI pipelines.

Skills

Backend development

LLM integration

Algorithms & data structures

RAG concepts

Vector databases

Embedding pipelines

Shared services

Cloud AI services

APIs / asynchronous / event-driven

Bachelor's degree

RESTful APIs

SQL

Git / CI‑CD

Education

Bachelor's degree in CS or equivalent

Tools

Docker

Kubernetes

Job description

MeridianLink is seeking an AI Platform Engineer II to advance the AI platform that powers MeridianLink’s product suite. You will implement model serving layers, retrieval infrastructure, prompt management, and evaluation services under guidance from senior staff, while developing APIs for product teams to integrate AI features.

You will also build observability, participate in design discussions, and mentor junior engineers to grow their AI systems and platform design expertise.