LLM & AI Engineer on Microsoft Foundry - Hybrid NJ

JSR Tech Consulting; New Jersey; Hybrid; USD 96,000 - 152,000; Full time

Job summary

JSR Tech Consulting is seeking an AI Engineer / LLM Developer for a long-term contract in New Jersey. Hybrid work with 3 days on-site per week, focusing on building production-grade AI apps on the Microsoft Foundry platform.

You will design and deploy LLM-based solutions, integrate with Azure services and the Microsoft ecosystem, and optimize RAG and related architectures while collaborating with business stakeholders.

Qualifications

• 4+ years of professional software development experience with advanced Python.
• Hands-on experience building and deploying applications on the Microsoft Foundry platform.
• Demonstrated experience developing production LLM-based applications—not just experimentation or theoretical knowledge.
• Experience with prompt engineering, model evaluation, and LLM optimization techniques.
• Experience integrating AI solutions with enterprise data sources and APIs.
• Strong understanding of AI application architecture and scalable solution design.
• Experience building REST APIs and Python-based backend services.
• Experience working with large and complex datasets.
• Strong communication skills with ability to explain AI concepts to technical and business audiences.
• Experience within financial services is highly desirable.

Responsibilities

• Design, develop, and deploy production-grade AI applications using the Microsoft Foundry platform.
• Build custom Generative AI solutions leveraging LLMs to solve complex business problems.
• Develop AI-powered applications that integrate with the Microsoft ecosystem, including Azure services and Power Platform.
• Build and optimize Retrieval-Augmented Generation (RAG) solutions and other enterprise AI architectures.
• Develop Python-based services, APIs, and automation workflows supporting AI applications.
• Evaluate, fine-tune, and optimize LLM performance for accuracy and scalability.
• Collaborate with business stakeholders to translate problems into AI-driven solutions.
• Integrate enterprise data sources into AI applications with security and governance in mind.
• Prototype new AI capabilities and transition prototypes into production.
• Document AI architectures, development standards, and implementation best practices.
• Stay current with emerging AI technologies and recommend practical applications.

Skills

Python

LLM Development

Prompt Engineering

REST APIs

Communication

Tools

Microsoft Foundry

Azure AI

Power BI

LangChain

Semantic Kernel

Job description

JSR Tech Consulting is seeking an AI Engineer / LLM Developer for a long-term contract in New Jersey. Hybrid work with 3 days on-site per week, focusing on building production-grade AI apps on the Microsoft Foundry platform.

You will design and deploy LLM-based solutions, integrate with Azure services and the Microsoft ecosystem, and optimize RAG and related architectures while collaborating with business stakeholders.