Senior AI Software Engineer

The Phoenix Group; New York (NY); Hybrid; USD 120,000 - 210,000; Full time

Job summary

Premier Global Law Firm in New York City seeks an experienced AI Engineer/Architect to design, build, and integrate AI-powered solutions across Finance, HR, and IT. The role focuses on integrating LLMs into enterprise apps, with a strong Python background and production AI experience.

The position is hybrid, based in NYC, requiring 3 days onsite. You will modernize on-prem apps with AI capabilities and collaborate with stakeholders to drive enterprise AI adoption.

Qualifications

• Strong professional experience developing software with Python.
• Experience building and deploying production AI applications.
• Hands-on experience with OpenAI APIs.
• Experience integrating AI capabilities into existing enterprise applications.
• Experience building AI Agents, Skills, and custom MCP servers.
• Experience with locally hosted LLMs such as Ollama, Hugging Face, or vLLM.

Responsibilities

• Design and develop AI-powered applications and services using Python.
• Architect and integrate AI capabilities into existing enterprise applications and business systems.
• Build production-ready solutions utilizing OpenAI APIs and internally hosted LLMs.
• Develop AI agents, custom workflows, and intelligent automation solutions.
• Design and implement custom MCP servers and AI integrations.
• Work with locally hosted inference platforms including Ollama, Hugging Face, vLLM, or similar technologies.
• Optimize inference performance through model selection, parameter tuning, context window management, and benchmarking.
• Design evaluation pipelines to measure AI application performance and quality.
• Collaborate with business stakeholders across Finance, HR, and IT to identify opportunities for AI adoption.
• Evaluate emerging AI technologies and recommend new solutions that improve business processes.

Skills

Python

OpenAI APIs

AI Agents

MCP servers

Azure

Prompt engineering

Tools

Ollama

Hugging Face

vLLM

Job description

A premier global law firm is seeking an experienced AI Engineer / AI Architect to join its Information Services team and help design, build, and integrate AI-powered solutions across the firm's Finance, HR, and IT organizations.

This is a hands-on engineering role focused on architecting intelligent systems, integrating large language models into existing enterprise applications, and helping shape the firm's AI strategy. The ideal candidate has a strong Python background and experience building production AI solutions.

This is a hybrid position based in New York City, requiring 3 days per week onsite.

Role Overview

This position will focus on modernizing existing on-premises applications by integrating AI capabilities using both commercial and self-hosted large language models. The successful candidate will work closely with technical and business stakeholders to design scalable AI architectures, develop intelligent workflows, and deliver enterprise-grade AI applications.

Key Responsibilities

• Design and develop AI-powered applications and services using Python.
• Architect and integrate AI capabilities into existing enterprise applications and business systems.
• Build production-ready solutions utilizing OpenAI APIs and internally hosted LLMs.
• Develop AI agents, custom workflows, and intelligent automation solutions.
• Design and implement custom MCP servers and AI integrations.
• Work with locally hosted inference platforms including Ollama, Hugging Face, vLLM, or similar technologies.
• Optimize inference performance through model selection, parameter tuning, context window management, and benchmarking.
• Design evaluation pipelines to measure AI application performance and quality.
• Collaborate with business stakeholders across Finance, HR, and IT to identify opportunities for AI adoption.
• Evaluate emerging AI technologies and recommend new solutions that improve business processes.

Required Qualifications

• Strong professional experience developing software with Python.
• Experience building and deploying production AI applications.
• Hands-on experience with OpenAI APIs.
• Experience integrating AI capabilities into existing enterprise applications.
• Experience building AI Agents, Skills, and custom MCP servers.
• Experience working with locally hosted LLMs including Ollama, Hugging Face, vLLM, or similar inference platforms.
• Experience designing AI system architecture and enterprise AI solutions.
• Strong understanding of prompt engineering, model evaluation, and production AI deployment.
• Experience with Azure and cloud-based AI services.
• Excellent communication skills with the ability to work directly with technical and business stakeholders.

Preferred Qualifications

• Experience modernizing existing enterprise applications through AI integration.
• Experience with Microsoft Entra ID authentication.
• Azure DevOps, PowerShell, SharePoint, Salesforce, iManage Cloud API, Aderant, or Workday experience is a plus.
• Experience within a legal or professional services environment.

Core Technologies

Languages: Python

AI & LLMs: OpenAI API, Ollama, Hugging Face, vLLM, AI Agents, Skills, MCP Servers, Prompt Engineering

This is an excellent opportunity for an engineer who enjoys designing enterprise AI solutions and integrating large language models into real-world business applications.