Principal GenAI Engineer

ApTask; New York (NY); On-site; USD 160,000 - 200,000; Full time

Job summary

ApTask is seeking a Principal GenAI Engineer to lead enterprise-scale AI implementations for Fortune 500 clients. The role centers on building RAG systems that fuse structured semantic reasoning with advanced LLM architectures to deliver scalable, production-ready AI solutions.

You will mentor the engineering team, own code quality in Python and SQL, and drive deployment across cloud platforms (AWS/Azure/GCP) with a focus on reliability, scalability, and explainability.

Qualifications

• 8-13 years of experience in ML/AI systems.
• 2+ years hands-on experience with LLMs (RAG, agents, prompt engineering).
• Strong proficiency in Python and SQL.
• Experience deploying GenAI systems on AWS / Azure / GCP.

Responsibilities

• Develop and optimize LLM-based solutions for enterprise-scale AI deployments.
• Codebase ownership: write and review Python (LangChain/LangGraph) and SQL components.
• Enable cloud deployment of GenAI apps on Azure, GCP, or AWS with robust CI/CD processes.
• Collaborate with product owners, data scientists, and business SMEs to translate requirements.
• Provide technical leadership and promote best practices in ML and LLM development.

Skills

Experience in ML/AI systems

LLMs (RAG, agents, prompt engineering)

Python proficiency

SQL

Cloud deployment on AWS/Azure/GCP

Tools

LangChain

LangGraph

Job description

About Client

The client is a U.S.-based artificial intelligence company Specializing in AI-powered tech services, that connects enterprises with pre-vetted, remote software engineers through its Intelligent Talent Cloud platform. The company has grown rapidly, boasting a network of over 4 million professionals and serving more than 1,000 clients, including industry leaders like OpenAI, Google, Anthropic, and Meta. Client's services encompass AGI training, GenAI application engineering, and custom AI solutions, enabling businesses to advance and deploy artificial intelligence effectively. Recognized for its innovation, it has received accolades such as Forbes's "One of America's Best Startup Employers" and Fast Company's "World's Most Innovative Companies."

Salary Range: $160K-$200K/Annum

Job Description

• Principal GenAI Engineer with strong expertise in LLMs to lead enterprise-scale AI implementations for Fortune 500 clients.
• This role focuses on building RAG systems that combine structured semantic reasoning with advanced LLM architectures to deliver scalable, explainable, production-grade AI solutions.

Requirements

• 8-13 years of experience in ML/AI systems
• 2+ years hands-on experience with LLMs (RAG, agents, prompt engineering)
• Strong proficiency in Python, LangGraph, and SQL
• Experience deploying GenAI systems on AWS / Azure / GCP

Roles & Responsibilities

• Develop and optimize LLM-based solutions: Lead the design and deployment of large language models, leveraging techniques like prompt engineering, retrieval-augmented generation (RAG), and agent-based architectures.
• Codebase ownership: Build and maintain/review high-quality, efficient code in Python (using frameworks like LangChain/LangGraph) and SQL, focusing on reusable components, scalability, and performance best practices.
• Cloud integration: Aide in deployment of GenAI applications on cloud platforms (Azure, GCP, or AWS), optimizing resource usage and ensuring robust CI/CD processes.
• Cross-functional collaboration: Work closely with product owners, data scientists, and business SMEs to define project requirements, translate technical details, and deliver impactful AI products.
• Mentoring and guidance: Provide technical leadership and knowledge-sharing to the engineering team, fostering best practices in machine learning and large language model development.

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.