Platform Engineer - Enterprise AI & Agent Infrastructure

Madison-Davis, LLC

New York (NY)

On-site

USD 140,000 - 210,000

Full time

3 days ago

Be an early applicant

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Madison-Davis, LLC in New York is expanding an AI technology team responsible for building the shared infrastructure behind enterprise AI applications. The team is moving beyond isolated experimentation and creating a scalable platform that enables engineers and business teams to develop, deploy, evaluate, and operate AI agents in production.

This engineer will own meaningful pieces of that platform end-to-end.

Qualifications

Strong software-engineering background with hands-on development experience.
Experience building AI-enabled applications, agentic workflows, or LLM infrastructure.
Hands-on experience with RAG or enterprise-retrieval architectures.
Understanding of securely exposing proprietary datasets to AI applications.
Experience designing production-quality services with testing and monitoring.
Ability to evaluate technical alternatives and make pragmatic architecture decisions.

Responsibilities

Own components of an enterprise AI platform from evaluation and architecture through production deployment.
Build frameworks and tooling supporting AI agents and agentic applications.
Develop RAG and data-access patterns connecting internal information to AI applications.
Build and operate MCP servers, gateways, plugins, and related integration services.
Create evaluation and observability capabilities for testing and monitoring AI systems.
Build secure authentication, authorization, and entitlement patterns around AI capabilities.
Turn recurring application patterns into reusable platform components.
Improve engineering standards, reliability, documentation, and developer workflows.