Senior AI Engineer — LLMs, Prompts & AI Agents

SharpAtoms

New York (NY)

On-site

USD 150,000 - 210,000

Full time

31 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

SharpAtoms is seeking an AI Engineer for an onsite role in NYC, focusing on prompt engineering, LLM optimization, and enterprise integration. You will design prompts, enhance model outputs, and build robust, context-aware AI solutions for healthcare data workflows.

You will collaborate with product and engineering teams to translate requirements into AI-driven capabilities, implement RAG patterns, and ensure adherence to security and governance standards. Onsite in NYC, full-time.

Qualifications

  • Experience designing prompts for large language models across domains.
  • Ability to implement RAG and context-aware reasoning.
  • Knowledge of healthcare data privacy and PHI/PII handling per HIPAA.

Responsibilities

  • Design, develop, and optimize prompts for LLMs to improve accuracy and outcomes.
  • Build Agentic AI solutions with planning, memory, and multi-step execution.
  • Develop MCP tools to securely discover and interact with enterprise data sources.

Skills

LLMs expertise
Prompt engineering
LLM APIs & RAG
Embeddings & vector DBs
NLP & prompt tuning
HIPAA/PHI/PII security
MCP servers & cloud
Healthcare data integration

Tools

LLM tooling
Semantic search tooling

Job description

SharpAtoms is seeking an AI Engineer for an onsite role in NYC, focusing on prompt engineering, LLM optimization, and enterprise integration. You will design prompts, enhance model outputs, and build robust, context-aware AI solutions for healthcare data workflows.

You will collaborate with product and engineering teams to translate requirements into AI-driven capabilities, implement RAG patterns, and ensure adherence to security and governance standards. Onsite in NYC, full-time.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Engineer: Prompting, LLM Agents & Secure AI
Senior AI Engineer: Prompting, LLM Agents & Secure AI

SharpAtoms • Dallas (TX)

On-site
USD 140,000 - 210,000
Sr. AI Engineer - NYC NY
Sr. AI Engineer - NYC NY

SharpAtoms • New York (NY)

On-site
USD 150,000 - 210,000
Senior AI Engineer: LLMs, Prompting & Agent Architect
Senior AI Engineer: LLMs, Prompting & Agent Architect

Astir IT Solutions, Inc. • Dallas (TX)

On-site
USD 150,000 - 190,000
Senior AI Engineer - Onsite Chicago (Healthcare AI)
Senior AI Engineer - Onsite Chicago (Healthcare AI)

SharpAtoms • Chicago (IL)

On-site
USD 140,000 - 190,000
AI Engineer — Prompt & Data-Driven LLM Apps (Onsite NYC)
AI Engineer — Prompt & Data-Driven LLM Apps (Onsite NYC)

Robotics Technologies • New York (NY)

On-site
USD 90,000 - 128,000
Generative AI Engineer
Generative AI Engineer

TRUSYS, Inc. • Dallas (TX)

On-site
USD 120,000 - 170,000
Applied AI Engineer: Agentic AI & LLMs – Onsite NYC
Applied AI Engineer: Agentic AI & LLMs – Onsite NYC

Robson Bale Ltd • New York (NY)

On-site
USD 150,000 - 200,000
Competitive base salary
Medical, dental, vision coverage
401(k) with matching
+4
Sr. AI Engineer - Dallas TX
Sr. AI Engineer - Dallas TX

SharpAtoms • Dallas (TX)

On-site
USD 140,000 - 210,000
AI Engineer
AI Engineer

Astir IT Solutions, Inc. • Dallas (TX)

On-site
USD 150,000 - 190,000
Senior AI Engineer: LLM Prompts, Agentic AI
Senior AI Engineer: LLM Prompts, Agentic AI

Photon • Dallas (TX)

On-site
USD 120,000 - 180,000