Senior AI Platform Architect

The Information; New York (NY); On-site; USD 155,000 - 175,000; Full time

Benefits offered by this job

Medical/Dental/Vision coverage

Parental leave

Generous PTO

401(k) with matching

FSAs

Wellness stipend

Cell phone reimbursement

In-office lunches

Commuter benefits

Job summary

The Information is seeking an AI Architect to lead the design, evolution, and scaling of our AI pipeline infrastructure in the US. You will own an API‑first backend platform that orchestrates AI workflows at scale and extend it for a growing set of high‑fan‑out features central to our product strategy.

You will manage LLM providers, cost tracking, and model upgrades, while collaborating with product, editorial, and growth teams to translate requirements into robust pipeline designs.

Qualifications

• Deep backend framework experience with ORM usage and API‑only design
• Experience designing idempotent, retryable, fan‑out job pipelines
• Hands‑on with multiple LLM providers, embeddings, and cost tracking
• Experience with a vector database for similarity matching at scale
• Operational mindset for running internal services on a cloud PaaS with databases and queues
• Track record of authoring design docs and build-vs-buy decisions

Responsibilities

• Maintain and operate all existing AI pipelines on the platform
• Migrate remaining workflows from legacy framework to the main platform
• Own on‑call response for AI pipeline failures and retries
• Manage LLM provider relationships, API keys, and cost tracking
• Design and implement new high‑fan‑out pipelines for future workloads
• Establish onboarding patterns for new pipelines and automation
• Drive data storage, queuePartitioning, and concurrency cost controls
• Evaluate new LLM providers and embedding models while preserving data compatibility
• Build observability tools and extend dashboards with reporting and alerting
• Collaborate with product/editorial/growth to translate requirements into designs
• Mentor engineers on pipeline patterns and platform architecture
• Lead technical proposals for major infrastructure changes

Skills

Backend framework

Job orchestration

LLM integration

Vector search

Production operations

Architecture design

Job description

The Information is seeking an AI Architect to lead the design, evolution, and scaling of our AI pipeline infrastructure in the US. You will own an API‑first backend platform that orchestrates AI workflows at scale and extend it for a growing set of high‑fan‑out features central to our product strategy.

You will manage LLM providers, cost tracking, and model upgrades, while collaborating with product, editorial, and growth teams to translate requirements into robust pipeline designs.