Principal AI Engineer - Platform, Governance & Scale

Midwestern; New York (NY); Hybrid; USD 180,000 - 280,000; Full time

Job summary

Midwestern is seeking a Principal AI Engineer for its New York hybrid team. The role focuses on AI productization, platform engineering, and governance across a portfolio of internal products used by senior partners.

You will own secure AI design, multi-tenant services, and scalable tooling while mentoring 5–7 senior engineers and collaborating with product managers. The ideal candidate has 12+ years in software/data roles, deep AI/ML expertise, and hands-on cloud deployment, Docker, Terraform,

Qualifications

• 12+ years in software engineering, data science, or related technical field.
• Deep expertise in AI/ML frameworks and Python, with deployment to public cloud.
• Proven track record in multi-tenant AI services and LLM integrations in production.
• Experience leading microservices architectures and CI/CD for distributed systems.
• Hands-on with Docker, Terraform, and modern DevOps practices.
• Experience with AI/LLM security, prompt injection, and data boundary enforcement.
• Strong communication and ability to translate architectural decisions to executives.
• Experience with Agile and cross-functional product team collaboration.

Responsibilities

• Design and own AI productization and governance playbook, including service patterns and production readiness criteria.
• Build reusable internal tooling for AI services, evaluation, monitoring, and data infra.
• Establish AI agent governance policies for permissions and human-in-the-loop.
• Define SOC2/ISO-aligned AI controls and vendor data handling policies.
• Create standardized deployment patterns using containerization and IaC templates.
• Champion AI-assisted development practices and scalable tooling across teams.
• Mentor senior engineers and tech leads to improve delivery and quality.
• Bridge technical and non-technical stakeholders with clear guidance on platform tradeoffs.

Skills

AI/ML frameworks

Python ecosystem

LLM integrations

Microservices architecture

DevOps practices

Agile methodologies

Cross-functional collaboration

AI security

Prompt injection

Data boundary enforcement

Tools

Docker

Terraform

CI/CD tooling

Job description

Midwestern is seeking a Principal AI Engineer for its New York hybrid team. The role focuses on AI productization, platform engineering, and governance across a portfolio of internal products used by senior partners.

You will own secure AI design, multi-tenant services, and scalable tooling while mentoring 5–7 senior engineers and collaborating with product managers. The ideal candidate has 12+ years in software/data roles, deep AI/ML expertise, and hands-on cloud deployment, Docker, Terraform,