Sr. AI Engineer - NYC NY

SharpAtoms

New York (NY)

On-site

USD 150,000 - 210,000

Full time

30 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

SharpAtoms is seeking an AI Engineer for an onsite role in NYC, focusing on prompt engineering, LLM optimization, and enterprise integration. You will design prompts, enhance model outputs, and build robust, context-aware AI solutions for healthcare data workflows.

You will collaborate with product and engineering teams to translate requirements into AI-driven capabilities, implement RAG patterns, and ensure adherence to security and governance standards. Onsite in NYC, full-time.

Qualifications

  • Experience designing prompts for large language models across domains.
  • Ability to implement RAG and context-aware reasoning.
  • Knowledge of healthcare data privacy and PHI/PII handling per HIPAA.

Responsibilities

  • Design, develop, and optimize prompts for LLMs to improve accuracy and outcomes.
  • Build Agentic AI solutions with planning, memory, and multi-step execution.
  • Develop MCP tools to securely discover and interact with enterprise data sources.

Skills

LLMs expertise
Prompt engineering
LLM APIs & RAG
Embeddings & vector DBs
NLP & prompt tuning
HIPAA/PHI/PII security
MCP servers & cloud
Healthcare data integration

Tools

LLM tooling
Semantic search tooling

Job description

W2 Role | Healthcare experience is preferred.

NYC, NY (Full Onsite)

AI Engineer with strong hands-on experience in prompt engineering, LLM response optimization, and AI application development. The ideal candidate can design prompts, improve model output quality, help LLMs understand user input, and build reliable, context-aware AI solutions.

Key Responsibilities:

  • Design, develop, and optimize prompts for Large Language Models (LLMs) to improve accuracy, reliability, and business outcomes.
  • Build and configure Agentic AI solutions that leverage planning, reasoning, memory, and multi-step task execution capabilities.
  • Develop and integrate MCP (Model Context Protocol) tools, enabling AIagents to securely discover and interact with enterprise systems, APIs, and data sources.
  • Design agent architectures, tool-calling frameworks, retrieval mechanisms, and context management strategies.
  • Collaborate with product managers, architects, and engineering teams to translate business requirements into AI-driven solutions.
  • Implement Retrieval-Augmented Generation (RAG), knowledge grounding, and context orchestration patterns.
  • Define evaluation frameworks and prompt testing methodologies to measure agent performance, quality, and reliability.
  • Ensure AI solutions adhere to security, compliance, governance, and responsible AI standards.
  • Support deployment, monitoring, troubleshooting, and continuous improvement of AI agents and MCP-enabled workflows.
  • Contribute to architecture reviews, technical design documentation, and engineering best practices for AI platforms.

Required Skills:

  • Hands-on experience with LLMs such as GPT, Claude, Gemini, Llama, or similar models.
  • Strong prompt engineering skills, including prompt templates, system prompts, few-shot prompting, and response tuning.
  • Develop AI-powered applications using LLM APIs, RAG workflows, enterprise data sources, and backend services.
  • Knowledge of RAG, embeddings, vector databases, semantic search, and knowledge retrieval workflows.
  • Ability to evaluate and improve AI responses for accuracy, relevance, completeness, tone, and instruction following.
  • Understanding of NLP concepts, hallucination mitigation, prompt injection risks, guardrails, and responsible AI practices.
  • Knowledge of healthcare data privacy and secure sensitive-data handling, including HIPAA-aligned PHI/PII practices, data minimization, de-identification, masking, access controls, auditability, and responsible use of healthcare data in AI workflows.
  • Experience with MCP servers, cloud platforms, APIs, backend services, and production deployment is preferred.
  • Experience integrating AI agents with healthcare, health records, or regulated industry systems.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr. AI Engineer - Chicago IL
Sr. AI Engineer - Chicago IL

SharpAtoms • Chicago (IL)

On-site
USD 140,000 - 190,000
AI Engineer
AI Engineer

Astir IT Solutions, Inc. • Dallas (TX)

On-site
USD 150,000 - 190,000
Sr. AI Engineer - Dallas TX
Sr. AI Engineer - Dallas TX

SharpAtoms • Dallas (TX)

On-site
USD 140,000 - 210,000
Sr. AI Engineer
Sr. AI Engineer

Photon • Dallas (TX)

On-site
USD 120,000 - 180,000
Generative AI Engineer
Generative AI Engineer

TRUSYS, Inc. • Dallas (TX)

On-site
USD 120,000 - 170,000
Senior AI Engineer: LLMs, Prompting & Agent Architect
Senior AI Engineer: LLMs, Prompting & Agent Architect

Astir IT Solutions, Inc. • Dallas (TX)

On-site
USD 150,000 - 190,000
AI Prompt Engineer / Agentic AI Engineer
AI Prompt Engineer / Agentic AI Engineer

Confisa International Group • United States

On-site
USD 120,000 - 170,000
Senior AI Engineer — LLMs, Prompts & AI Agents
Senior AI Engineer — LLMs, Prompts & AI Agents

SharpAtoms • New York (NY)

On-site
USD 150,000 - 210,000
AI Prompt Engineer
AI Prompt Engineer

Moonfire • New Jersey

On-site
USD 110,000 - 170,000
GenAI Prompt Engineering
GenAI Prompt Engineering

Latitude • New York (NY)

On-site
USD 140,000 - 220,000