Senior AI Platform Engineer — LLM Agents

Aimlroles; Northern (KY); Hybrid; USD 175,000 - 245,000; Full time

Benefits offered by this job

401k Match

Paid holidays

Parental Leave

Udemy courses for development

Life insurance and disability plans

Remote work options

Job summary

Smartsheet seeks an experienced software engineer focused on building LLM-powered agents and AI-driven workflows. You will architect production-grade AI systems, optimize prompts, and manage end-to-end deployment on cloud platforms. Collaboration with engineering, product, and AI platform teams is essential, along with mentoring peers on modern ML practices.

US telework is supported; candidates should be legally eligible to work in the United States and thrive in a fast-paced AI environment.

Qualifications

• 8+ years of software engineering experience; at least 2 years with LLMs in production.
• Deep experience with prompt engineering and context engineering for model behavior.
• Strong knowledge of RAG architectures, embedding models, and evaluation pipelines.

Responsibilities

• Architect production-grade LLM-powered agents and workflows, including system design, data pipelines, and deployment strategies.
• Develop and optimize prompts, RAG pipelines, and agent reasoning patterns; build evaluation frameworks for accuracy and performance across models.
• Implement and manage end-to-end AI systems on cloud infrastructure (AWS, GCP, Azure) with monitoring and incident response.
• Collaborate with Engineering, Product, and AI Platform teams to translate business requirements into technical AI solutions.
• Mentor engineers on applied ML best practices and production considerations.

Skills

LLM production experience

Prompt engineering

Python

Cross-functional collaboration

Communication skills

Education

BS/MS in Computer Science or related field

Tools

MLflow

Databricks

Cloud platforms (AWS/GCP/Azure)

Job description

Smartsheet seeks an experienced software engineer focused on building LLM-powered agents and AI-driven workflows. You will architect production-grade AI systems, optimize prompts, and manage end-to-end deployment on cloud platforms. Collaboration with engineering, product, and AI platform teams is essential, along with mentoring peers on modern ML practices.

US telework is supported; candidates should be legally eligible to work in the United States and thrive in a fast-paced AI environment.