Principal GenAI Engineer

ApTask; New York (NY); On-site; USD 170,000 - 200,000; Full time

Job summary

ApTask is hiring a Principal GenAI Engineer in New York to lead enterprise-scale AI initiatives for Fortune 500 clients. The role centers on building RAG systems that combine structured semantic reasoning with advanced LLM architectures to deliver scalable, production-grade AI solutions.

You will mentor teams, drive code quality in Python and SQL, and collaborate with cross-functional stakeholders to deliver impactful GenAI products in a cloud environment (AWS/Azure/GCP).

Qualifications

• 8-13 years of experience in ML/AI systems.
• 2+ years hands-on experience with LLMs (RAG, agents, prompt engineering).
• Strong proficiency in Python, LangGraph, and SQL.

Responsibilities

• Develop and optimize LLM-based solutions: lead design and deployment of large language models, leveraging prompt engineering, retrieval-augmented generation (RAG), and agent-based architectures.
• Codebase ownership: build and maintain/review high-quality, efficient code in Python (LangChain/LangGraph) and SQL, focusing on reusable components, scalability, and performance.
• Cloud integration: assist in deployment of GenAI applications on cloud platforms (Azure, GCP, AWS), ensuring robust CI/CD processes.
• Cross-functional collaboration: work with product owners, data scientists, and business SMEs to define requirements and deliver AI products.
• Mentoring and guidance: provide technical leadership and knowledge-sharing to the engineering team.

Skills

ML/AI systems

LLMs

Python

LangGraph

SQL

Tools

AWS

Azure

GCP

LangChain

LangGraph

Job description

About Client

The client provides information technology (IT) services, including business outsourcing, infrastructure technology, and application services. The application service offered by the company includes application development, maintenance, and support. The markets served by the company are financial services and insurance, healthcare, manufacturing, government, transportation, communications, and consumer and retail industries.

Salary Range

$170K-$200K/Annum

Job Description

• Our Client is hiring a Principal GenAI Engineer with strong expertise in LLMs to lead enterprise-scale AI implementations for Fortune 500 clients.
• This role focuses on building RAG systems that combine structured semantic reasoning with advanced LLM architectures to deliver scalable, explainable, production-grade AI solutions.

Requirements

• 8-13 years of experience in ML/AI systems
• 2+ years hands-on experience with LLMs (RAG, agents, prompt engineering)
• Strong proficiency in Python, LangGraph, and SQL
• Experience deploying GenAI systems on AWS / Azure / GCP

Roles & Responsibilities

• Develop and optimize LLM-based solutions: Lead the design and deployment of large language models, leveraging techniques like prompt engineering, retrieval-augmented generation (RAG), and agent-based architectures.
• Codebase ownership: Build and maintain/review high-quality, efficient code in Python (using frameworks like LangChain/LangGraph) and SQL, focusing on reusable components, scalability, and performance best practices.
• Cloud integration: Aide in deployment of GenAI applications on cloud platforms (Azure, GCP, or AWS), optimizing resource usage and ensuring robust CI/CD processes.
• Cross-functional collaboration: Work closely with product owners, data scientists, and business SMEs to define project requirements, translate technical details, and deliver impactful AI products.
• Mentoring and guidance: Provide technical leadership and knowledge-sharing to the engineering team, fostering best practices in machine learning and large language model development.

Interview Requirements

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.

Candidate Data Collection Disclaimer

At ApTask, we prioritize safeguarding your privacy. As part of our recruitment process, certain Personally Identifiable Information (PII) may be requested by our clients for verification and application purposes. Rest assured, we strictly adhere to confidentiality standards and comply with all relevant data protection laws. Please note that we only collect the necessary information as specified by each client and do not request sensitive details during the initial stages of recruitment. If you have any concerns or queries about your personal information, please feel free to contact our compliance team at [e-mail].

Applicant Consent

By submitting your application, you agree to ApTask's (www.aptask.com) Terms of Use and Privacy Policy, and provide your consent to receive SMS and voice call communications regarding employment opportunities that match your resume and qualifications. You understand that your personal information will be used solely for recruitment purposes and that you can withdraw your consent at any time by contacting us at 732-355-8000 or [e-mail]. Message frequency may vary. Msg & data rates may apply