Senior AI Platform Engineer — Remote, Enterprise AI

NewRocket; Raleigh (NC); Hybrid; USD 140,000 - 190,000; Full time

Job summary

NewRocket is seeking an experienced AI Platform Engineer to build, operate, and improve foundational AI platforms that securely scale enterprise AI solutions powered by Claude and other models.

The role covers cloud engineering, platform engineering, DevOps, MLOps/LLMOps, data integration, and governance. You will collaborate with AI Architects, data engineers, and ServiceNow teams to deliver reusable platforms and safe, scalable AI capabilities.

Qualifications

• 5+ years of platform engineering, cloud engineering, DevOps, software engineering, data engineering, systems integration, or related technical roles.
• Hands-on experience designing and deploying cloud-native applications and services on AWS, Azure, and/or Google Cloud Platform.
• Strong experience with CI/CD, Git-based workflows, automated testing, infrastructure as code, and production release processes.
• Experience with containerization and orchestration technologies such as Docker, Kubernetes, serverless services, or comparable cloud-native platforms.
• Proficiency in Python, JavaScript/TypeScript, Java, Go, Bash, or similar languages.
• Experience designing and consuming REST APIs and integrating enterprise applications.
• Hands-on experience with LLM-powered applications, generative AI services, AI/ML platforms, RAG systems, or related technologies.
• Familiarity with LLM concepts including prompt and context engineering, token management, embeddings, vector search, RAG, and tool use.

Responsibilities

• Design, build, deploy, and maintain scalable platform capabilities for enterprise AI, including LLM/RAG and agentic AI applications.
• Create reusable reference architectures, deployment templates, and integration components for NewRocket’s AI Foundry.
• Ensure secure connections to enterprise data, APIs, and tools while enabling Claude-powered applications and RAG workflows.
• Collaborate with AI Architects and Forward Deployed Engineers to translate client needs into reliable platform designs.
• Operate CI/CD pipelines for AI applications, including model configurations, prompts, evaluation assets, and deployment automation.
• Maintain security, privacy, governance controls, observability, and model monitoring across deployments.

Skills

Cloud engineering

DevOps

MLOps

Data engineering

Python

REST APIs

LLMOps

Observability

Security

CI/CD

Education

Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or related field

Tools

Terraform

CloudFormation

Pulumi

Kubernetes

Docker

GitHub Actions

Argo CD

Snowflake

Databricks

PostgreSQL

Job description

NewRocket is seeking an experienced AI Platform Engineer to build, operate, and improve foundational AI platforms that securely scale enterprise AI solutions powered by Claude and other models.

The role covers cloud engineering, platform engineering, DevOps, MLOps/LLMOps, data integration, and governance. You will collaborate with AI Architects, data engineers, and ServiceNow teams to deliver reusable platforms and safe, scalable AI capabilities.