Principal GenAI Engineer

IMR Soft LLC; New York (NY); Hybrid; USD 180,000 - 260,000; Full time

Job summary

IMR Soft LLC in NYC is seeking a Principal GenAI Engineer with deep expertise in LLMs to lead enterprise-scale AI implementations for Fortune 500 clients, focusing on RAG systems that blend structured reasoning with advanced LLM architectures for scalable, production-grade solutions.

The role emphasizes design and deployment of GenAI systems on cloud platforms, mentoring engineers, and collaborating with product owners and data scientists to deliver impactful AI products and robust CI/CD

Qualifications

• 8-13 years of experience in ML/AI systems.
• 2 years hands-on experience with LLMs (RAG, agents, prompt engineering).
• Strong proficiency in Python, LangGraph, and SQL.
• Experience deploying GenAI systems on AWS/Azure/Google Cloud Platform.

Responsibilities

• Develop and optimize LLM-based solutions: lead design and deployment of large language models, leveraging prompt engineering, RAG, and agent-based architectures.
• Codebase ownership: build and review high-quality Python and SQL components, focusing on scalability and performance.
• Cloud integration: assist in deployment of GenAI applications on cloud platforms (Azure, GCP, AWS), optimizing resources and CI/CD processes.
• Cross-functional collaboration: work with product owners, data scientists, and SMEs to define requirements and deliver AI products.
• Mentoring and guidance: provide technical leadership and knowledge-sharing within the engineering team.

Skills

Python

LangGraph

SQL

LLMs / GenAI

RAG / prompt engineering

Cloud deployment (AWS/Azure/GC)

Team leadership / mentoring

Tools

LangChain

CI/CD

AWS/Azure/GC Cloud

Job description

Principal GenAI Engineer

Location: NYC, NY - 3 Days WFO

Employment Type: Full Time

About the Role

About the Role
hiring a Principal GenAI Engineer with strong expertise in LLMs to lead enterprise-scale AI implementations for Fortune 500 clients. This role focuses on building RAG systems that combine structured semantic reasoning with advanced LLM architectures to deliver scalable, explainable, production-grade AI solutions.

What We're Looking For

• 8-13 years of experience in ML/AI systems
• 2 years hands‑on experience with LLMs (RAG, agents, prompt engineering)
• Strong proficiency in Python, LangGraph, and SQL
• Experience deploying GenAI systems on AWS / Azure / Google Cloud Platform

Roles & Responsibilities

• Develop and optimize LLM-based solutions: Lead the design and deployment of large language models, leveraging techniques like prompt engineering, retrieval-augmented generation (RAG), and agent-based architectures.
• Codebase ownership: Build and maintain/review high-quality, efficient code in Python (using frameworks like LangChain/LangGraph) and SQL, focusing on reusable components, scalability, and performance best practices.
• Cloud integration: Aide in deployment of GenAI applications on cloud platforms (Azure, Google Cloud Platform, or AWS), optimizing resource usage and ensuring robust CI/CD processes.
• Cross-functional collaboration: Work closely with product owners, data scientists, and business SMEs to define project requirements, translate technical details, and deliver impactful AI products.
• Mentoring and guidance: Provide technical leadership and knowledge-sharing to the engineering team, fostering best practices in machine learning and large language model development.