AI Engineer II ( AI Platform)

MeridianLink

United States

Remote

USD 140,000 - 190,000

Full time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Fully remote company
Mentorship from Senior/Staff engineers
AI/ML training
Monthly soft-skill sessions
Career development
Executive access

Job summary

MeridianLink is seeking an AI Platform Engineer II to advance the AI platform that powers MeridianLink’s product suite. You will implement model serving layers, retrieval infrastructure, prompt management, and evaluation services under guidance from senior staff, while developing APIs for product teams to integrate AI features.

You will also build observability, participate in design discussions, and mentor junior engineers to grow their AI systems and platform design expertise.

Qualifications

  • 3–5 years of professional software engineering experience.
  • Strong proficiency in backend engineering using Python, C#/.NET, Java, or Node.js.
  • Solid understanding of algorithms, data structures, and system design principles.
  • Hands‑on experience integrating large language models or ML models into production applications.
  • Working knowledge of retrieval‑augmented generation (RAG) concepts, vector databases, and embedding pipelines.
  • Experience building or contributing to shared services or platform components.
  • Familiarity with cloud‑managed AI services (AWS Bedrock, Azure OpenAI, or equivalent).
  • Experience with APIs, asynchronous processing, and event‑driven architectures.
  • Bachelor's degree in Computer Science, Software Engineering, or equivalent professional experience.

Responsibilities

  • Implement AI platform components — including model serving layers, retrieval infrastructure, prompt management, and output evaluation services — under the guidance of Senior and Staff engineers.
  • Develop and maintain APIs that product teams use to integrate AI capabilities into their applications.
  • Build observability and monitoring into platform services to track output quality, latency, cost, and system health.
  • Contribute to design discussions and provide input on trade-offs between simplicity, reliability, and scalability.
  • Work with product engineering teams to understand how they want to use AI capabilities and translate requirements into platform features.
  • Participate in technical design sessions and code reviews with product teams building on the AI platform.
  • Help identify patterns where multiple product teams are solving the same AI integration problem and consolidate that work.
  • Contribute to documentation, reference implementations, and runbooks that help product teams adopt AI platform services.
  • Participate in defining and enforcing integration standards — API contracts, error handling patterns, cost attribution.
  • Mentor junior engineers (Engineer I) and help them grow their understanding of AI systems and platform design.
  • Implement evaluation and monitoring pipelines that give teams visibility into AI output quality and model behavior.
  • Contribute to content safety standards and compliance guardrails appropriate for a regulated financial services environment.
  • Help design systems that properly handle PII, maintain audit trails, and meet data residency requirements in AI pipelines.

Skills

Backend development
LLM integration
Algorithms & data structures
RAG concepts
Vector databases
Embedding pipelines
Shared services
Cloud AI services
APIs / asynchronous / event-driven
Bachelor's degree
RESTful APIs
SQL
Git / CI‑CD

Education

Bachelor's degree in CS or equivalent

Tools

Docker
Kubernetes

Job description

WHAT YOU'LL DO
Core Platform Development
  • Implement AI platform components — including model serving layers, retrieval infrastructure, prompt management, and output evaluation services — under the guidance of Senior and Staff engineers

  • Develop and maintain APIs that product teams use to integrate AI capabilities into their applications

  • Build observability and monitoring into platform services to track output quality, latency, cost, and system health

  • Contribute to design discussions and provide input on trade-offs between simplicity, reliability, and scalability

Integration & Collaboration
  • Work with product engineering teams to understand how they want to use AI capabilities and translate requirements into platform features

  • Participate in technical design sessions and code reviews with product teams building on the AI platform

  • Help identify patterns where multiple product teams are solving the same AI integration problem and consolidate that work

Standards, Documentation & Knowledge Sharing
  • Contribute to documentation, reference implementations, and runbooks that help product teams adopt AI platform services

  • Participate in defining and enforcing integration standards — API contracts, error handling patterns, cost attribution

  • Mentor junior engineers (Engineer I) and help them grow their understanding of AI systems and platform design

AI Reliability & Safety
  • Implement evaluation and monitoring pipelines that give teams visibility into AI output quality and model behavior

  • Contribute to content safety standards and compliance guardrails appropriate for a regulated financial services environment

  • Help design systems that properly handle PII, maintain audit trails, and meet data residency requirements in AI pipelines

REQUIRED QUALIFICATIONS
  • 3–5 years of professional software engineering experience

  • Strong proficiency in backend engineering using Python, C#/.NET, Java, or Node.js

  • Solid understanding of algorithms, data structures, and system design principles

  • Hands‑on experience integrating large language models or ML models into production applications

  • Working knowledge of retrieval‑augmented generation (RAG) concepts, vector databases, and embedding pipelines

  • Experience building or contributing to shared services or platform components

  • Familiarity with cloud‑managed AI services (AWS Bedrock, Azure OpenAI, or equivalent)

  • Experience with APIs, asynchronous processing, and event‑driven architectures

  • Bachelor's degree in Computer Science, Software Engineering, or equivalent professional experience

PREFERRED QUALIFICATIONS
  • Experience with LLM frameworks (LangChain, LlamaIndex, etc.) or prompt engineering

  • Familiarity with vector databases (Pinecone, Weaviate, Milvus, or similar)

  • Knowledge of containerization and orchestration (Docker, Kubernetes)

  • Experience with observability tools and designing monitoring for ML/AI systems

  • Prior work in regulated industries with data handling, compliance or audit requirements

  • Experience with fintech, banking or other financial services environments

  • Active daily use of AI‑assisted development tools and understanding of their benefits and limitations

TECHNICAL SKILLS
  • In‑depth knowledge of one or more programming languages (Python, C#, Java, Node.js, etc.)

  • Strong understanding of RESTful API design and web service architecture

  • Proficiency with SQL and relational databases

  • Experience with version control (Git) and CI/CD pipelines

  • Ability to write well‑tested, maintainable code and participate effectively in code reviews

YOUR GROWTH PATH

As an AI Platform Engineer II, you'll deepen your expertise in AI systems and platform design. You'll take on increasingly complex components within the AI platform, participate more actively in architectural decisions with guidance from Senior engineers, and develop a strong understanding of how AI capabilities are reliably integrated across products. Your path toward Senior Engineer (L3) involves demonstrating the ability to lead the design and implementation of significant platform components, mentor engineers effectively, and think strategically about system‑wide tradeoffs and long-term maintainability.

WHY JOIN MERIDIANLINK
  • Build the AI Platform: Work on critical infrastructure that powers AI across all of MeridianLink's products. Your work directly enables product teams to deliver AI‑powered features faster and more reliably.

  • Collaborative Culture: We encourage an open, collaborative work culture where every idea is valued. As a fully remote company, we're intentional about creating meaningful opportunities to connect with your team.

  • Continuous Learning: We're committed to helping you grow professionally. You'll have access to AI/ML training, job-specific technical development, monthly soft‑skill sessions, and mentorship from experienced Senior and Staff engineers.

  • Work on Meaningful Problems: Your work goes beyond code. You'll help create reliable, safe, and compliant AI systems that empower financial institutions to serve their communities better.

  • Career Development: We promote from within and believe in developing our employees for long‑term growth toward Staff and Principal roles.

  • Accessible Leadership: Our open‑door policy gives you direct access to executives. We want to hear your ideas and feedback.

  • Work‑Life Balance: We understand that you have a full life outside work. We honor your personal commitments while maintaining productivity.

  • Great Place to Work for 2026.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Remote AI Platform Engineer II - Build Scalable AI Services
Remote AI Platform Engineer II - Build Scalable AI Services

MeridianLink, Inc. • United States

On-site
USD 120,000 - 180,000
Remote culture
Mentorship program
AI/ML training
+4
Principal AI Engineer
Principal AI Engineer

Phizenix • New York (NY)

Hybrid
USD 180,000 - 260,000
AI Engineer
AI Engineer

Pinpoint Global Communications • United States

On-site
USD 120,000 - 180,000
Remote AI Platform Engineer II: Build Scalable LLM Infra
Remote AI Platform Engineer II: Build Scalable LLM Infra

MeridianLink • United States

Remote
USD 140,000 - 190,000
Fully remote company
Mentorship from Senior/Staff engineers
AI/ML training
+3
AI Platform Engineer II
AI Platform Engineer II

Mindtris • Memphis (TN)

On-site
USD 110,000 - 160,000
Senior AI Platform Engineer (#5640)
Senior AI Platform Engineer (#5640)

Talanto • Union (NJ), Northern (KY)

Hybrid
USD 140,000 - 210,000
Flexible working format
Competitive salary
Professional development
Staff Software Engineer, AI
Staff Software Engineer, AI

Empathy Talent • San Francisco (CA)

On-site
USD 186,000 - 310,000
401(k) plan
Wellness benefits
Technology reimbursements
+2
Sr AI Engineer - Data
Sr AI Engineer - Data

MeridianLink • United States

On-site
USD 120,000 - 150,000
AI Engineer 1 // Mid-Level
AI Engineer 1 // Mid-Level

Rygen Technologies • Greenville (SC)

On-site
USD 80,000 - 100,000
Principal Engineer
Principal Engineer

KPI Partners • New York (NY)

Hybrid
USD 150,000 - 200,000