Senior AI Engineer - Enterprise Solutions & CoE

Black Osprey; Village of Garden City (NY); Hybrid; USD 225,000 - 250,000; Full time

Benefits offered by this job

Medical benefits

401(k) plan

Unlimited PTO

Job summary

Rafferty Holdings is seeking two hands-on Lead AI Engineers as founding members of its AI Center of Excellence. Based in the Long Island office in Garden City, NY, this senior IC role sits with operations, compliance, risk, and client service teams to build end-to-end AI solutions that improve everyday workflows.

You will prototype, deploy, and govern AI apps using LLMs, RAG, AI agents, and cloud-native services; mentor future engineers; and help grow reusable frameworks and standards aligned

Qualifications

• 5+ years of software engineering delivering enterprise applications.
• 3+ years deploying AI/ML solutions in production.
• Experience scoping problems with business users and delivering tools.

Responsibilities

• Collaborate with operations, compliance, risk, and client service teams.
• Take each use case from discovery through deployment and support.
• Translate observations into clear problem statements and working software.
• Refine solutions based on user feedback and operational needs.
• Design, deploy, and support enterprise AI applications and services.
• Build AI solutions with LLMs, RAG, AI agents, and ML models.
• Develop reusable prompt libraries and AI solution frameworks.
• Create APIs and cloud-native services to speed AI adoption.

Skills

LLMs

Prompt engineering

RAG architectures

AI agents

Python

Azure OpenAI

Cloud platforms

Model evaluation

API / microservices

Data governance

Education

Bachelor's degree in CS or related field

Tools

Azure OpenAI Service

Anthropic Claude

LangChain

Databricks

LangGraph

Semantic Kernel

Job description

Rafferty Holdings is seeking two hands-on Lead AI Engineers as founding members of its AI Center of Excellence. Based in the Long Island office in Garden City, NY, this senior IC role sits with operations, compliance, risk, and client service teams to build end-to-end AI solutions that improve everyday workflows.

You will prototype, deploy, and govern AI apps using LLMs, RAG, AI agents, and cloud-native services; mentor future engineers; and help grow reusable frameworks and standards aligned