Senior AI Engineer

InRhythm; New York (NY); On-site; USD 100,000 - 250,000; Full time

Job summary

A leading tech company is seeking a Senior AI Engineer to design scalable AI systems and lead innovative projects. This role involves collaboration on cutting-edge AI applications and mentoring junior engineers. Candidates should have extensive experience in machine learning and a passion for AI development.

Benefits

Medical, Dental, and Vision Plans

401(k) Matching

Scalable PTO

Qualifications

• 8+ years in software engineering focused on AI/ML required.
• 3+ years in a technical leadership role needed.
• Experience with large language models and prompt engineering highly desired.

Responsibilities

• Architect advanced AI and ML systems for business solutions.
• Lead design and deployment of LLM-based applications.
• Mentor engineers on AI architecture and ethical use of ML.

Skills

Python

Machine Learning

Natural Language Processing

Deep Learning

AI System Design

Generative AI

Education

Bachelor's Degree in Computer Science or related field

Tools

PyTorch

TensorFlow

Hugging Face Transformers

AWS

Job description

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from InRhythm

Enterprise Account Executive at InRhythm

Build What Matters—AI Engineering & Applied Intelligence Leadership

At InRhythm, we don’t just build apps—we transform industries. We launch high-impact digital platforms, modernize mission-critical systems, and create human-centered experiences that shape the way people live, work, and thrive.

We’re seeking a Senior AI Engineer to lead the development of intelligent, scalable, and production-ready AI systems. This is a high-impact role for an engineer passionate about applying the latest in machine learning, generative AI, and intelligent automation to real-world challenges across industries.

Who We Are

We’re InRhythm. We build high-impact digital products that solve real-world problems at scale.

Since 2002, we’ve helped modernize platforms and accelerate innovation for some of the world’s most recognized enterprises—including Goldman Sachs, Morgan Stanley, Mastercard, Fidelity, UnitedHealth Group, Amazon, and more.

We specialize in web, mobile, and cloud-native development—but what sets us apart is our culture of craftsmanship, velocity, and outcome-driven delivery. We don’t wait to be told what to do. We lead from within.

Build the AI-Driven Future

AI isn’t a trend here—it’s the foundation of our future.

As a Senior AI Engineer, you’ll take a leading role in embedding artificial intelligence into every layer of the product and delivery lifecycle. You’ll shape client platforms through our AI Accelerator and lead the design and development of real-time, intelligent systems powered by large language models, natural language processing, and machine learning.

You’ll also help drive client-facing innovation by facilitating workshops that explore cutting-edge AI applications and scalable, enterprise-ready solutions. If you’re passionate about building the future of AI, this is your platform to lead and create a lasting impact.

What You’ll Do

As a Senior AI Engineer at InRhythm, you will:

• Architect and implement advanced AI and machine learning systems that solve complex business problems
• Lead the design and deployment of LLM-based applications using frameworks like LangChain, LlamaIndex, and vector databases
• Develop end-to-end ML pipelines from data acquisition and model training to deployment and monitoring
• Design and build AI copilots, agents, and generative workflows that integrate seamlessly into modern software ecosystems
• Apply deep expertise in NLP, computer vision, or predictive modeling to build intelligent, real-time systems
• Evaluate and fine-tune foundation models for custom enterprise use cases
• Collaborate with cross-functional product, design, and engineering teams to define intelligent experiences
• Explore and implement retrieval-augmented generation (RAG), semantic search, and multi-modal reasoning techniques
• Contribute to internal AI frameworks, toolkits, and accelerators to speed up solution delivery
• Mentor engineers on AI architecture, model lifecycle best practices, and ethical/secure use of machine learning

Requirements

You’ll bring:

• 8+ years of software engineering experience with a strong focus on AI/ML and intelligent systems
• 3+ years in a technical leadership role, building and deploying machine learning systems in production
• Deep expertise in Python and modern AI/ML libraries (e.g., PyTorch, TensorFlow, Hugging Face Transformers)
• Experience with large language models (OpenAI, Anthropic, Cohere, open source LLMs) and prompt engineering
• Familiarity with vector databases (e.g., Pinecone, Weaviate, FAISS) and scalable ML infrastructure
• Knowledge of AI system design, data engineering for ML, model evaluation, and MLOps practices
• Strong understanding of NLP, generative AI, embeddings, and semantic search
• Experience integrating AI capabilities into full-stack applications and cloud-native environments, specifically within AWS.
• Strong communication skills and a consulting mindset—able to confidently lead client-facing discussions on AI strategy
• Passion for experimentation, innovation, and shaping the future of applied AI

Why You’ll Thrive at InRhythm

We’re a community of builders who believe in doing our best work and helping others do the same.

For example, we recently launched our internal AI Accelerator, enabling teams to rapidly prototype, deploy, and iterate on generative AI and machine learning solutions for enterprise clients. This initiative empowers engineers to create scalable, AI-native systems that drive business value and innovation.

At InRhythm, you’ll:

• Work on high-visibility, high-impact AI initiatives that shape the digital landscape
• Join empowered, autonomous teams committed to pushing the boundaries of AI
• Collaborate with bold thinkers in a community that champions learning, experimentation, and growth
• Lead initiatives, contribute to open-source tools, and mentor peers on AI system design
• Share your work and drive innovation through tech talks, workshops, and peer engagement

We don’t just build—we build what’s next. Together.

At InRhythm, we believe in building a better workplace. When you join our team, you can expect:

• Comprehensive and customizable Medical, Dental, and Vision Plans
• 401(k) Matching
• Scalable PTO

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at InRhythm by 2x

Inferred from the description for this job

Medical insurance

Vision insurance

401(k)

Get notified about new Artificial Intelligence Engineer jobs in New York City Metropolitan Area.

Brooklyn, NY $100,000.00-$150,000.00 3 weeks ago

Brooklyn, NY $150,000.00-$200,000.00 2 weeks ago

New York, NY $170,000.00-$250,000.00 1 week ago

New York City Metropolitan Area $150,000.00-$200,000.00 3 days ago

New York, NY $100,000.00-$250,000.00 23 hours ago

Brooklyn, NY $120,000.00-$170,000.00 3 weeks ago

New York, NY $150,000.00-$200,000.00 1 month ago

New York, NY $80,000.00-$160,000.00 1 week ago

New York, NY $120,000.00-$200,000.00 2 weeks ago

New York, NY $187,000.00-$270,000.00 1 day ago

AI / Machine Learning Research Engineer (early career)

New York, NY $132,000.00-$154,000.00 2 days ago

New York, NY $150,000.00-$250,000.00 1 week ago

New York, NY $140,000.00-$200,000.00 8 months ago

New York, NY $140,000.00-$200,000.00 8 months ago

New York, NY $130,000.00-$170,000.00 20 hours ago

New York City Metropolitan Area $160,000.00-$200,000.00 1 day ago

New York, NY $56.25-$173,000.00 2 weeks ago

New York, NY $180,000.00-$240,000.00 1 month ago

New York City Metropolitan Area $160,000.00-$200,000.00 2 days ago

New York, NY $150,000.00-$250,000.00 2 months ago

New York, NY $160,000.00-$200,000.00 1 week ago

New York, NY $114,000.00-$171,000.00 2 weeks ago

New York City Metropolitan Area 4 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.