Senior AI & ML Engineer: LLMs, RAG & Agents

New York Technology Partners; United States; On-site; USD 180,000 - 240,000; Full time

Job summary

New York Technology Partners is seeking a senior AI systems engineer to design, deploy, and operate LLM-powered applications with agent-based orchestration and robust RAG pipelines. You will collaborate with clinical and product teams to translate complex problems into reliable AI solutions.

The role requires hands-on experience with LLMs, multi-agent frameworks, and end-to-end ML pipelines, plus strong software engineering in Python and cloud-native architectures.

Qualifications

• Strong grounding in ML fundamentals and evaluation methodologies.
• Hands-on with deep learning frameworks (PyTorch or TensorFlow).
• Solid NLP knowledge and transformer architectures.

Responsibilities

• Design, build, and deploy LLM-powered, agentic AI applications with multi-agent orchestration.
• Develop and optimize RAG pipelines with provenance and factual grounding.
• Build document intelligence workflows for extraction, classification, OCR, and structuring.

Skills

ML fundamentals

Deep learning

NLP

LLMs

Generative AI

RAG

Vector databases

Knowledge graphs

AI agents

Agentic AI frameworks

Python

Java

APIs

Microservices

Distributed systems

Azure AI Services

AWS SageMaker

Google Vertex AI

Databricks

Snowflake

Spark

Kafka

Kubernetes

Docker

GitHub Actions

Azure DevOps

Terraform

CI/CD

Responsible AI

Education

Bachelor's or Master's in Computer Science/Data Science/ML

Tools

LangChain

LangGraph

LlamaIndex

OpenAI

Azure OpenAI

Spark

Airflow

Job description

New York Technology Partners is seeking a senior AI systems engineer to design, deploy, and operate LLM-powered applications with agent-based orchestration and robust RAG pipelines. You will collaborate with clinical and product teams to translate complex problems into reliable AI solutions.

The role requires hands-on experience with LLMs, multi-agent frameworks, and end-to-end ML pipelines, plus strong software engineering in Python and cloud-native architectures.