Principal Engineer, AI

AI Chopping Block, Inc.; New York (NY); Hybrid; USD 210,000 - 285,000; Full time

Job summary

Anaplan in New York is seeking a Principal Engineer, AI who can work across the full stack of our AI applications—from model integration and prompt engineering to intuitive user interfaces. You'll build production-ready GenAI features that empower business users to leverage AI within planning workflows.

We value deep ML knowledge and strong software engineering skills, with the role offered on a hybrid schedule and two on-site days per week at our New York office.

Qualifications

• Extensive hands-on AI/ML engineering experience.
• Experience training and deploying ML models in production.
• Deep knowledge of LLM APIs, prompt engineering, and conversational AI patterns.
• Fine-tuning LLMs for domain-specific enterprise applications.
• Proficiency in Python and modern software development practices (testing, CI/CD).
• Proven track record of delivering complex technical projects on time.

Responsibilities

• Lead architecture, design, and deployment of scalable GenAI and ML systems into production environments.
• Develop end-to-end GenAI features, including backend API services, model integration, monitoring, evaluations, and deployments.
• Integrate and optimize LLMs for business planning use cases, including prompt engineering and RAG implementation.
• Build conversational interfaces and agentic workflows for accessible planning tasks.
• Implement evaluation frameworks to measure GenAI feature quality, including accuracy and latency.
• Design and develop APIs exposing AI capabilities to Anaplan's platform and third-party integrations.
• Collaborate with data scientists to productionise ML models and forecasting algorithms.

Skills

LLM APIs

Prompt engineering

MLOps

Python

CI/CD

API design

Agentic frameworks

Education

Master's or PhD in CS/AI

Tools

vLLM

TensorRT

Ray

Pinecone

Weaviate

Qdrant

LangSmith

W&B

MLflow

Job description

At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market.

What unites Anaplanners across teams and geographies is our collective commitment to our customers’ success and to our Winning Culture.

Our customers rank among the who’s who in the Fortune 50. Coca-Cola, LinkedIn, Adobe, LVMH and Bayer are just a few of the 2,400+ global companies who rely on our best-in-class platform.

Our Winning Culture is the engine that drives our teams of innovators. We champion diversity of thought and ideas, we behave like leaders regardless of title, we are committed to achieving ambitious goals, and we love celebratingour wins – big and small.

Supported by operating principles of being strategy-led, values-based and disciplined in execution, you’ll be inspired, connected, developed and rewarded here. Everything that makes you unique is welcome; join us and let’s build what’s next - together!

We're seeking a Principal Engineer, AI who can work across the full stack of Anaplan AI applications, from model integration and prompt engineering to building intuitive user interfaces. You'll build production-ready AI features that empower business users to leverage the power of GenAI within their planning workflows, requiring both deep ML knowledge and strong software engineering skills.

We look forward to collaborating in person! This role features a hybrid work model, with two days a week spent onsite in our New York office.

Your Impact

• Lead the architecture, design, and deployment of scalable Generative AI and Machine learning systems into production environments.
• Develop end-to-end GenAI features, including backend API services, model integration, model monitoring, evaluations, and deployments.
• Integrate and optimize LLMs for specific business planning use cases, including prompt engineering and RAG implementation.
• Build conversational interfaces and agentic workflows that make complex planning tasks accessible through natural language
• Implement evaluation frameworks to measure and improve GenAI feature quality, including accuracy, latency, and user satisfaction metrics
• Design and develop APIs that expose AI capabilities to Anaplan's platform and third-party integrations
• Optimize model inference pipelines for performance, cost, and scalability in production environments
• Implement monitoring, logging, and observability for GenAI systems to track usage, errors, and model behavior.
• Collaborate with data scientists to productionise ML models and forecasting algorithms

Your Qualifications

• Extensive hands‑on professional experience in the field of Artificial Intelligence, Machine Learning, or related engineering domains.
• End-to-end exposure in model lifecycle development, including extensive experience in training and deploying ML models in production environments.
• Deep knowledge of LLM APIs, prompt engineering, and conversational AI patterns.
• Experience in fine-tuning LLMs for domain‑specific enterprise applications.
• Strong expertise in MLOps and LLMOps, ensuring scalable, reliable, and monitorable model deployments.
• Experience with agentic frameworks and autonomous agent architectures.
• Proficiency in Python and modern software development practices (testing, code review, CI/CD).
• Proven track record of delivering complex technical projects on time with high quality

Desirable

• Advanced degree (Master's or Ph.D.) in Computer Science, Artificial Intelligence, Machine Learning, or a strongly related quantitative field
• Hands‑on experience with cloud‑native ML infrastructure platforms
• Knowledge of vector databases (Pinecone, Weaviate, Qdrant) and embedding models
• Experience with model serving frameworks (vLLM, TensorRT, Ray)
• Experience with A/B testing and experimentation frameworks for AI features
• Contributions to open‑source ML projects or research publications
• Experience with model observability tools (LangSmith, W&B, MLflow)

#LI-SP1

Base Salary Range:

$210,000 — $285,000 USD

Our Commitment to Diversity, Equity, Inclusionand Belonging (DEIB)

We believe attracting and retaining the best talent and fostering an inclusive culture strengthens our business. DEIB improves our workforce, enhances trust with our partners and customers, and drives business success. Build your career in a place where diversity, equity, inclusion and belonging aren’t just words on paper – this is what drives our innovation, it’s how we connect, and it contributes to what makes us a market leader. We believe in a hiring and working environment where all people are respected and valued, regardless of gender identity or expression, sexual orientation, religion, ethnicity, age, neurodiversity, disability status, citizenship, or any other aspect which makes people unique. We hire you for who you are, and we want you to bring your authentic self to work every day!

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, perform essential job functions, and receive equitable benefits and all privileges of employment. Please contact us to request accommodation.