AI/ML Engineer — LLMs, RAG Pipelines & Production Systems

New York Technology Partners

New York (NY)

On-site

USD 150,000 - 190,000

Full time

24 hours ago
Be an early applicant
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

New York Technology Partners seeks an AI/ML Engineer to design, build, and deploy production-grade ML, generative AI, and agentic AI solutions focused on LLM applications, RAG pipelines, document intelligence, and reliable AI systems.

You will partner with product, clinical, and operational stakeholders to translate complex problems into scalable AI solutions while applying Responsible AI, governance, and model risk practices.

Qualifications

  • 5+ years building and deploying ML/AI systems with hands-on LLM experience.
  • Strong ML, DL, NLP, and transformer foundations.
  • Proficient Python with PyTorch or TensorFlow.
  • Hands-on with Azure OpenAI, OpenAI, or Anthropic platforms.
  • Experience with LLM agents, RAG, vector databases, and embeddings.

Responsibilities

  • Design and deploy LLM-powered and agentic AI applications.
  • Build and optimize RAG pipelines and document intelligence solutions.
  • Develop production-grade Python services and deploy with Docker, Kubernetes, and CI/CD.
  • Implement observability for AI/ML systems and monitor performance.
  • Collaborate with clinical, operational, and product teams on scalable AI solutions.
  • Apply Responsible AI, governance, and model risk practices.

Skills

LLM development
Python
PyTorch
TensorFlow
LangChain (or LangGraph)
RAG pipelines
Docker
Kubernetes
CI/CD
Cloud platforms (Azure)
Observability tools

Education

Bachelor's degree in CS/DS/ML or related
Master's degree in CS/DS/ML or related

Tools

Docker
Kubernetes
Airflow
Spark
Databricks
Snowflake
GitHub

Job description

New York Technology Partners seeks an AI/ML Engineer to design, build, and deploy production-grade ML, generative AI, and agentic AI solutions focused on LLM applications, RAG pipelines, document intelligence, and reliable AI systems.

You will partner with product, clinical, and operational stakeholders to translate complex problems into scalable AI solutions while applying Responsible AI, governance, and model risk practices.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI/ML Engineer — LLM Infra & Agentic Workflows
AI/ML Engineer — LLM Infra & Agentic Workflows

Objective Partners • New York (NY)

On-site
USD 150,000 - 260,000
Medical, dental, vision insurance
High-performance hardware access
Competitive base + incentive options
Senior AI Engineer — Production LLM & RAG Pipelines
Senior AI Engineer — Production LLM & RAG Pipelines

Brown Brothers Harriman & Co. • Town of Boston (NY)

On-site
USD 175,000 - 215,000
LLM-Powered AI Engineer: RAG, Prompts & Production ML
LLM-Powered AI Engineer: RAG, Prompts & Production ML

RiskForce • Northern (KY)

Hybrid
USD 120,000 - 155,000
Senior AI/ML Engineer: LLMs, RAG & Secure Cloud
Senior AI/ML Engineer: LLMs, RAG & Secure Cloud

24-MAG • Washington

Hybrid
USD 96,000 - 276,000
Staff Generative AI Engineer: Production-Ready LLMs & Agents
Staff Generative AI Engineer: Production-Ready LLMs & Agents

Citi • New York (NY)

Hybrid
USD 142,000 - 213,000
Health benefits
401(k)
Production AI/ML Engineer: LLMs, RAG & Infra
Production AI/ML Engineer: LLMs, RAG & Infra

Amazon Inc. • Seattle (WA)

On-site
USD 144,000 - 194,000
Health insurance
401(k) matching
Paid time off
+2
AI/ML Engineer ($50/hr)
AI/ML Engineer ($50/hr)

New York Technology Partners • New York (NY)

On-site
USD 150,000 - 190,000
Production AI/ML Engineer: LLMs, RAG & Secure Cloud
Production AI/ML Engineer: LLMs, RAG & Secure Cloud

24-Mag Llc • Washington, Northern (KY)

Hybrid
USD 96,000 - 276,000
Hybrid work arrangement
Competitive hourly rate
Senior AI Engineer: Production LLM & RAG Lead
Senior AI Engineer: Production LLM & RAG Lead

Brown Brothers Harriman • Jersey City (NJ)

On-site
USD 175,000 - 215,000
Senior AI Engineer — Production LLMs & RAG
Senior AI Engineer — Production LLMs & RAG

LexisNexis Risk Data Management, LLC Company • Oklahoma City (OK)

On-site
USD 95,000 - 159,000
Health benefits
401(k) with match
Employee Share Purchase Plan
+3