Senior AI Engineer — Enterprise LLMs & AI Apps

The Phoenix Group; New York (NY); On-site; USD 140,000 - 220,000; Full time

Job summary

The Phoenix Group Advisors is seeking a Senior Software Engineer focused on AI and LLMs to design, build, and integrate AI-powered solutions across enterprise systems in New York. You will work on production AI applications, agents, and LLM-powered workflows, with strong emphasis on Python, MCP, and OpenAI APIs.

You will collaborate with stakeholders, work across existing apps and new AI initiatives, and evaluate models, tools, and infrastructure to ensure secure, scalable solutions.

Qualifications

• 5+ years of professional software engineering, application development, or systems architecture.
• Strong Python development experience.
• Experience with C#/.NET, ASP.NET, or enterprise app stacks.
• Hands-on experience building production AI/LLM applications.
• Experience building AI agents or autonomous AI systems.
• Experience with MCP (Model Context Protocol).
• Experience with OpenAI APIs and self-hosted LLMs.
• Experience with self-hosted LLMs using Ollama/vLLM/Hugging Face.
• Experience integrating AI into enterprise software.
• Understanding of RAG, embeddings, vector/semantic search, tool calling, and prompt engineering.
• Strong knowledge of APIs, databases, security, and production practices.
• Experience with Azure and/or AWS.

Responsibilities

• Design, develop, and deploy production-grade AI and LLM-powered applications using Python.
• Architect AI solutions integrated with existing enterprise apps, APIs, databases, and business systems.
• Build AI agents, agentic workflows, and autonomous processes for complex tasks.
• Develop MCP servers, tools, and integrations enabling secure interactions with enterprise apps.
• Build solutions using OpenAI APIs and self-hosted LLMs.
• Work with local model inference technologies such as Ollama, vLLM, or similar.
• Develop RIS/TIyam evaluation, testing, and optimization for AI workflows.
• Establish best practices around agent development, MCP, AI tooling, and integration.
• Collaborate with technical and business stakeholders to translate requirements into scalable AI solutions.
• Evaluate new AI models, frameworks, tools, and infrastructure.

Skills

Python

C#/.NET

AI/LLM engineering

MCP

OpenAI APIs

Azure/AWS

Production AI

APIs

Education

Bachelor's degree in CS or related field

Tools

Ollama

vLLM

Hugging Face

LM Studio

Docker

Azure DevOps

Job description

The Phoenix Group Advisors is seeking a Senior Software Engineer focused on AI and LLMs to design, build, and integrate AI-powered solutions across enterprise systems in New York. You will work on production AI applications, agents, and LLM-powered workflows, with strong emphasis on Python, MCP, and OpenAI APIs.

You will collaborate with stakeholders, work across existing apps and new AI initiatives, and evaluate models, tools, and infrastructure to ensure secure, scalable solutions.