Senior AI Retrieval Platform Architect

Jobtailor; New York (NY); On-site; USD 150,000 - 225,000; Full time

Job summary

Jobtailor is seeking a Senior Backend Architect in New York to design and build large-scale retrieval systems and RAG infrastructure. The role focuses on real-time indexing, vector stores, and hybrid retrieval, with close collaboration across AI, data, and product teams to deliver grounded, context-aware experiences.

You will mentor engineers, drive CI/CD and infrastructure-as-code adoption, and ensure low latency, high throughput platform capabilities in regulated enterprise environments.

Qualifications

• 8+ years building large-scale backend, platform, or distributed systems.
• Hands-on experience building search platforms, retrieval systems, indexing pipelines, knowledge systems, or recommendation platforms.
• Strong knowledge of APIs, microservices, Kubernetes, containers, CI/CD, and distributed data processing.
• Experience building enterprise platforms in highly regulated environments such as Wealth Management, Brokerage / Broker-Dealer, Banking, Capital Markets, Insurance, FinTech, or Healthcare.
• Knowledge of RAG (Retrieval Augmented Generation), semantic search, vector databases, embeddings, LLM integration patterns, knowledge graphs, real-time data platforms, Kafka / streaming systems, observability and monitoring, platform APIs, event-driven architecture, and multi-tenant platform design

Responsibilities

• Design and build high-scale retrieval systems and backend platforms.
• Lead architecture of large-scale AI platform components.
• Integrate LLMs with retrieval systems for grounded, context-aware experiences.
• Develop observability pipelines for metrics, logs, tracing, and performance.
• Mentor engineers and drive CI/CD, infra-as-code, and automated testing.
• Partner with AI, data, and product teams to shape platform capabilities.
• Build indexing pipelines, vector stores, enrichment pipelines, and real-time indexing.
• Create low-latency, highly available knowledge-service APIs.

Skills

Large-Scale Backend

Search Platform Engineering

APIs & Microservices

Java, Python, or Go

RAG & Semantic Search

Tools

Kubernetes

CI/CD

Containers

Kafka

Event-Driven Architecture

Distributed Data Processing

Job description

Jobtailor is seeking a Senior Backend Architect in New York to design and build large-scale retrieval systems and RAG infrastructure. The role focuses on real-time indexing, vector stores, and hybrid retrieval, with close collaboration across AI, data, and product teams to deliver grounded, context-aware experiences.

You will mentor engineers, drive CI/CD and infrastructure-as-code adoption, and ensure low latency, high throughput platform capabilities in regulated enterprise environments.