Principal AI Engineer: GenAI, Production ML & APIs

Anaplan; New York (NY); Hybrid; USD 210,000 - 285,000; Full time

Job summary

Anaplan seeks a Principal Engineer, AI to architect and deploy GenAI features across its AI-enabled planning platform. You will craft end-to-end AI capabilities, from model integration to user-facing interfaces, and ensure production readiness with monitoring and cost-efficient inference.

The role is hybrid, with two days per week onsite in New York, collaborating with data scientists and software engineers to advance forecasting and planning workflows.

Qualifications

• Extensive hands-on experience in Artificial Intelligence, ML, or related engineering domains.
• End-to-end model lifecycle development, training and deployment in production.
• Deep knowledge of LLM APIs, prompt engineering, and conversational AI patterns.
• Experience fine-tuning LLMs for domain-specific enterprise apps.
• Strong expertise in MLOps and LLMOps for scalable deployments.
• Experience with agentic frameworks and autonomous agent architectures.
• Proficiency in Python and modern software development practices (CI/CD).
• Track record delivering complex technical projects on time with high quality.
• Advanced degree (Master's or PhD) in CS/AI/ML or related field.
• Hands-on with cloud-native ML infrastructure platforms.
• Knowledge of embedding models and vector databases.
• Experience with model serving frameworks (e.g., vLLM, TensorRT, Ray).
• Experience with A/B testing and experimentation for AI features.
• Contributions to open-source ML projects or publications.
• Experience with observability tools (LangSmith, Weights & Biases, MLflow).

Responsibilities

• Lead architecture, design, and deployment of scalable GenAI and ML systems into production.
• Develop end-to-end GenAI features including backend APIs and model integration.
• Integrate and optimize LLMs for planning use cases with prompt engineering and RAG.
• Build conversational interfaces and autonomous agent workflows for planning tasks.
• Implement evaluation frameworks for GenAI feature quality (accuracy, latency, user satisfaction).
• Design and develop APIs exposing AI capabilities to Anaplan's platform and integrations.
• Optimize model inference pipelines for performance, cost, and scalability.
• Implement monitoring, logging, and observability for GenAI systems.
• Collaborate with data scientists to productionize ML models and forecasting algorithms.

Skills

AI engineering

LLM APIs

Prompt engineering

MLOps

Python

Education

Master's or PhD in CS/AI/related

Tools

Pinecone

Weaviate

Qdrant

vLLM

TensorRT

Ray

LangSmith

MLflow

Job description

Anaplan seeks a Principal Engineer, AI to architect and deploy GenAI features across its AI-enabled planning platform. You will craft end-to-end AI capabilities, from model integration to user-facing interfaces, and ensure production readiness with monitoring and cost-efficient inference.

The role is hybrid, with two days per week onsite in New York, collaborating with data scientists and software engineers to advance forecasting and planning workflows.