Senior Machine Learning Engineer, AI

People in AI; New York (NY); Hybrid; USD 180,000 - 260,000; Full time

Job summary

People In AI is building an internal AI engineering team in New York City. You will design, build, and deploy modern AI applications that drive measurable value across diverse business operations.

You’ll work directly with AI leadership to shape production-grade systems, partnering with operators and stakeholders to deliver impactful solutions. This role combines software engineering, ML, LLMs, and retrieval systems, offering ownership from ideation to production in a fast-paced, entrepreneurial

Qualifications

• Experience building production AI applications.
• Strong software engineering fundamentals.
• Ability to translate open-ended challenges into production AI solutions.
• Comfort working with both technical and non-technical stakeholders.

Responsibilities

• Build production AI applications using LLMs, embeddings, retrieval systems, and NLP.
• Design intelligent workflows that automate complex business processes.
• Prototype full-stack AI products, including backend services and lightweight user interfaces.
• Develop evaluation frameworks, prompt strategies, and experimentation pipelines.
• Partner with business and technical stakeholders to translate open-ended challenges into production AI solutions.
• Own projects from ideation through deployment and continuous improvement.

Skills

Python production

LLMs NLP embeddings

Prototyping

Stakeholder communication

Builder mindset

ML tooling

Tools

PyTorch

Hugging Face

Job description

Location: New York City preferred (Hybrid)

Join a highly respected investment organization building an internal AI engineering team from the ground up. This is an opportunity to work directly with the organization's AI leadership, developing production AI systems that drive measurable value across a diverse portfolio of businesses and internal operations.

This isn't an AI research lab or a consulting role. You'll build practical AI products that solve real business problems, partnering with operators, technical teams, and senior business stakeholders to deliver high-impact solutions.

The Mission

Artificial intelligence is becoming a strategic capability across the organization. The team is focused on identifying high-value opportunities, rapidly prototyping solutions, and deploying production AI systems that automate workflows, improve decision-making, and unlock operational efficiencies across multiple industries.

This is a chance to help shape a newly formed AI function while working on commercially meaningful problems with direct executive visibility.

The Role

You'll join a small, highly technical AI team responsible for designing, building, and deploying modern AI applications. The role combines software engineering, machine learning, LLMs, retrieval systems, and lightweight product development, giving you ownership from concept through production.

This is ideal for engineers who enjoy solving ambiguous problems, building quickly, and seeing their work deployed into real business environments.

What You'll Do

• Build production AI applications using LLMs, embeddings, retrieval systems, and modern NLP techniques
• Design intelligent workflows that automate complex business processes
• Prototype full-stack AI products, including backend services and lightweight user interfaces
• Develop evaluation frameworks, prompt strategies, and experimentation pipelines
• Partner with business and technical stakeholders to translate open-ended challenges into production AI solutions
• Own projects from ideation through deployment and continuous improvement

What You'll Bring

• Strong software engineering fundamentals with production Python experience
• Hands-on experience building AI applications using LLMs, NLP, embeddings, or retrieval systems
• Experience with frameworks such as PyTorch, Hugging Face, or similar ML tooling
• Ability to rapidly prototype and ship production-quality software
• Strong communication skills and comfort working with both technical and non-technical stakeholders
• A builder's mindset with a desire to work in a fast-paced, entrepreneurial environment

Why Join?

• Build from Day One: Help shape a newly established AI engineering function with significant influence over technical direction.
• High Visibility: Work directly with senior leadership on strategic initiatives that have organization-wide impact.
• Meaningful Problems: Build AI systems that deliver measurable business value across a broad range of industries and use cases.
• Ownership: Take products from idea to production in a small, high-performing team where engineering decisions matter.

About People In AI

People In AI partners with leading AI startups, technology companies, and innovation-focused organizations to connect exceptional engineers with high-impact opportunities. Every role we represent is carefully selected for its technical challenge, growth potential, and real-world impact.