Senior AI Orchestration Architect

Jobtailor; Town of Carmel (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

Jobtailor is seeking an experienced AI Platform Architect in New York to own major portions of the AI workload orchestration platform. You will design end-to-end AI frameworks, enabling models, agents and tools to operate together at scale.

You will drive MLOps and LLMOps, implement governance and responsible AI guardrails, and lead cross-team reviews to ensure scalable, reliable developer experience across enterprise teams.

Qualifications

• Bachelor's degree in CS, data engineering, information systems, AI or equivalent.
• 5–7 years of experience in data engineering, AI engineering, or software engineering.
• Strong experience in large-scale data pipelines and distributed processing.
• Experience with Python, SQL, APIs, workflow automation, cloud-native architectures.
• Proven design and deployment of RESTful APIs and web services at scale.
• Excellent communication and collaboration with stakeholders.
• Track record of independently delivering projects from concept to production.
• Strong systems thinking and cross-team influence for scalability and reliability.

Responsibilities

• Own the technical vision and architecture for major portions of the AI platform.
• Design and engineer AI orchestration frameworks coordinating models, agents, tools, APIs, and apps.
• Develop agent-to-agent and human-in-the-loop workflows for complex operations.
• Lead AI context engineering strategies and AI agent architectures.
• Build reusable orchestration patterns for rapid deployment of AI-enabled capabilities.
• Design and develop scalable data pipelines for AI, analytics, and workflows.
• Build enterprise data products optimized for AI consumption.
• Implement MLOps, LLMOps deployment, monitoring, and governance capabilities.
• Establish Responsible AI guardrails, governance, and model risk management processes.
• Develop AI observability, telemetry, and performance measurement solutions.
• Design and implement RAG architectures for products with enterprise teams.
• Lead cross-team architecture reviews and align infrastructure and apps.

Skills

Python

SQL

Data Engineering

Machine Learning Engineering

Workflow Automation

Distributed Data Processing

Systems Thinking

Cross-Team Influence

Project Management

RESTful API Design

Education

Bachelor's degree in Computer Science, Data Engineering, Information Systems, AI or equivalent

Tools

Databricks

Snowflake

Spark

Kafka

Delta Lake

Iceberg

Airflow

FastAPI

React

Azure Cosmos DB

Job description

Jobtailor is seeking an experienced AI Platform Architect in New York to own major portions of the AI workload orchestration platform. You will design end-to-end AI frameworks, enabling models, agents and tools to operate together at scale.

You will drive MLOps and LLMOps, implement governance and responsible AI guardrails, and lead cross-team reviews to ensure scalable, reliable developer experience across enterprise teams.