AI/ML Engineer: LLM & RAG Systems (Remote)

AgileGrid Solutions; United States; Remote; USD 130,000 - 210,000; Full time

Benefits offered by this job

Health insurance

Remote work options

Training budgets and conference access

Paid time off

Retirement savings plans

Performance-based incentives

Diversity, equity and inclusion

Job summary

New York Technology Partners is seeking an AI/ML Engineer to design, develop, and deploy production-grade AI solutions focused on LLMs, RAG pipelines, and document intelligence. You will work with product managers, clinical experts, and operators to translate complex problems into scalable AI systems in high-stakes environments such as healthcare and enterprise operations.

The role emphasizes hands-on ML/DL/NLP, Python, and modern ML tooling with a strong focus on responsible AI, governance, and

Qualifications

• 5+ years in building and deploying ML/AI systems with recent hands-on LLM or agentic AI work.
• Solid foundation in ML, DL, NLP and transformers.
• Proficiency in Python with PyTorch/TensorFlow.
• Hands-on with Azure OpenAI, OpenAI or Anthropic platforms.
• Familiarity with RAG, vector databases, embeddings and LangChain/LangGraph/LlamaIndex.
• Experience building data/ML pipelines using SQL, Airflow, Spark, Databricks or Snowflake.
• Knowledge of containerization, CI/CD practices, cloud (Azure preferred) and observability tools.

Responsibilities

• Design and deploy LLM-powered and agentic AI apps including tool calls and multi-agent orchestration.
• Build and optimize RAG pipelines for document retrieval and understanding.
• Develop document intelligence solutions for extraction, classification, OCR, and structured data.
• Establish evaluation, human-in-the-loop, and feedback mechanisms for AI accuracy.
• Implement observability to monitor quality, latency, cost, and model performance.
• Develop production-grade Python services deployed via Docker, CI/CD, Kubernetes, and cloud-native tech.
• Collaborate with business, clinical, and operational stakeholders to translate problems into scalable AI solutions.
• Ensure Responsible AI, governance, security, and risk management in deployments.

Skills

Large language models

Agentic AI

Natural language processing

Transformer architectures

Python

PyTorch

TensorFlow

Education

Bachelor's or Master's in Computer Science / Data Science / Machine Learning or equivalent

Tools

Azure OpenAI

OpenAI

Anthropic

LangChain

LangGraph

LlamaIndex

Vector databases

Embeddings

SQL

Airflow

Spark

Databricks

Snowflake

Docker

Kubernetes

Job description

New York Technology Partners is seeking an AI/ML Engineer to design, develop, and deploy production-grade AI solutions focused on LLMs, RAG pipelines, and document intelligence. You will work with product managers, clinical experts, and operators to translate complex problems into scalable AI systems in high-stakes environments such as healthcare and enterprise operations.

The role emphasizes hands-on ML/DL/NLP, Python, and modern ML tooling with a strong focus on responsible AI, governance, and