Principal AI Engineer - Midtown, NY

Midwestern; New York (NY); Hybrid; USD 180,000 - 240,000; Full time

Job summary

Midwestern is seeking a Principal Engineer to lead AI productization and platform governance across the firm’s internal tooling. You’ll own AI service patterns, security/compliance standards, and code-level architecture for scalable, secure AI capabilities used by senior partners and consultants.

You will mentor 5–7 engineers, drive cross-team collaboration, and shape how AI is built across the portfolio with a strong emphasis on reliability, threat modeling, and production-readiness in a hybrid

Qualifications

• 12+ years in software engineering, data science, or a closely related technical field.
• Experience designing and operating multi-tenant AI services in production.
• Hands-on Python development with AI/ML frameworks.

Responsibilities

• Design and own AI productization and governance playbook for internal platforms.
• Build reusable internal tooling and data infrastructure for AI services.
• Mentor engineers and tech leads to improve delivery quality and production readiness.
• Partner with Security, Legal, and Compliance to define AI controls and data policies.
• Establish deployment patterns using containers, IAC, and CI/CD templates.

Skills

AI/ML frameworks

Python

Multi-tenant AI services

CI/CD

DevOps

Team mentoring

Architectural leadership

Cloud deployment

Effective communication

Education

Bachelor's degree in Computer Science or Engineering

Tools

Docker

Terraform

CI/CD tooling

Job description

**About the Role**Our client is a top-tier strategy and management consulting firm, the kind that competes with McKinsey, BCG and Bain for C-suite work. This role isn't on the client-facing side. It sits in their internal platform and product group, which builds and runs the 30+ products their consultants use to do that work. Your customers are the firm's senior partners, and they have little patience for AI features that sound good in a demo and fall apart in production.The AI work falls into two buckets. Existing products are adding AI features and tooling. New products are being built from AI use cases that are still being defined, and you'll help define them. They're hiring Principal Engineers first, then building teams around them, so you'd get in early and shape how AI gets built across the portfolio.They want engineers who have built, trained, and shipped real ML and LLM systems, not engineers who have mostly written prompts. Expect 70% to 80% of your time in the code, with the rest on architecture and tech leadership. You'll own how AI gets built securely, which means thinking about prompt injection and data boundaries before an incident forces the conversation. Infrastructure is handled by another team, so your focus stays on the AI itself. You'll mentor 5 to 7 senior engineers and work closely with product managers.**Location:** New York (Hybrid - Midtown)**Work Arrangements:** Open to 1099, C2C or W2**Duration:** 12 month contract - high likelihood of extension based on performance**Travel:** None**What You'll Do**AI Productization & Platform Engineering• Design and own the firm's AI productization & governance playbook, covering service patterns, security/compliance standards, model evaluation rubrics, and production-readiness criteria.• Build and maintain reusable internal tooling, including AI service scaffolding, evaluation and monitoring tooling, and data infrastructure - designed for team adoption without ongoing hand-holding.• Establish AI agent governance policies covering agent permissions, code execution controls, access to internal systems, and human-in-the-loop enforcement.• Partner with Security, Legal, and Compliance to define SOC2/ISO-aligned AI controls, vendor DPA requirements, and prompt data classification policies.• Establish standardized deployment patterns using containerization, infrastructure-as-code, and CI/CD pipeline templates reusable across teams.**Developer Experience & Engineering Excellence**• Champion AI-assisted development practices across the engineering org, including LLM-integrated development workflows, test-driven development patterns, and reusable tooling standards that scale across teams.• Codify modern software development standards (CI/CD, DevOps, testing, delivery quality) referenced by multiple teams as a baseline for new or re- platformed products.• Mentor engineers and tech leads with observable improvement in delivery consistency, design quality, and production readiness rigor.**Cross-Functional Leadership & Stakeholder Influence**• Serve as the go-to technical authority on AI/ML, platform architecture, and engineering practices - regularly consulted by senior stakeholders at the design and strategy stages.• Bridge technical and non-technical stakeholders, translating complex architectural decisions, AI risk topics, and platform tradeoffs into clear, actionable guidance.**What You'll Need**• 12+ years in software engineering, data science, or a closely related technical field.• Bachelor's degree or higher in Computer Science, Engineering, or a related field preferred.• Deep expertise in AI/ML frameworks and the Python ecosystem, with hands-on experience deploying models to public cloud infrastructure.• Demonstrated experience designing and operating multi-tenant AI services and LLM integrations in production.• Proven track record leading microservices architecture - decomposing monoliths, defining service contracts, and operationalizing CI/CD for distributed systems.• Strong hands-on command of containerization (Docker), infrastructure-as-code (Terraform), and modern DevOps practices.• Substantive experience with AI/LLM security - including prompt injection, data boundary enforcement, model supply chain risk, and AI-specific threat modeling.• Strong problem-solving skills, especially in building governance frameworks, evaluation rubrics, and reusable platform patterns at scale.• Excellent written and verbal communication skills in English; ability to translate complex technical topics to diverse audiences, including executive stakeholders.• Experience with Agile methodologies and cross-functional product team collaboration.**Preferred / Additional Qualifications**• Experience applying AI/ML in business consulting, advisory, or professional services contexts.• Familiarity with AI service interface and gateway design patterns, including emerging AI integration protocols.• Contributions to open-source AI/ML projects, publications, or active involvement in technical communities.• Advanced certifications in AI, deep learning, cloud architecture, or security (e.g., AWS/GCP/Azure ML, CISSP).• Experience defining AI compliance controls for SOC2, ISO 27001, or TISAX frameworks.• Demonstrated enthusiasm for developer education - writing internal guides, running workshops, or building internal tooling communities.• Proficiency in additional languages is a plus (Go, Typescript)• Demonstrated ability and enthusiasm to mentor and uplift junior team members or peers• Willingness to work outside of normal business hours, and in particular as unique projects/needs arise.Ready to apply?Powered byFirst name \\*Last name \\*Email \\*LinkedIn URL \\*Phone numberLocation \\*Resume \\*Click to upload or drag and drop hereCover letterClick to upload or drag and drop hereAre you a current Midwestern employee?This role requires onsite work in Midtown Manhattan (hybrid) and final interviews are held in person at the client's office. Government-issued photo ID is verified at the in-person interview and again at contract signing. Are you able to meet these requirements? \\*This is a contract role, 12 months + possible extension. Are you open to this type of work arrangement? \\*Name the company on your resume where you most recently shipped a production AI system, and describe what it did in one sentence. \\*