Senior AI Platform Engineer: Hybrid Cloud for Autonomous Agents

Aimlroles; City of Rochester (NY); Hybrid; USD 150,000 - 230,000; Full time

Job summary

Aimlroles is seeking a senior platform engineer to architect high-performance hosting environments for AI models and autonomous agents, emphasizing scalable back-end systems and container orchestration. The role is hybrid, located within 100 miles of Mayo Clinic for occasional on-site expectations in Rochester, NY.

You will drive real-time monitoring, distributed tracing, and production evaluation of agents and models, and join a rotating platform operations team to ensure reliability and

Qualifications

• Bachelor's degree in Computer Science/Engineering or related field with 5 years of experience; OR an Associate’s degree with 7 years of experience.
• Deep knowledge of software engineering practices including SDLC, code reviews, version control, build, test, and operations.
• Experience with containerized environments and orchestration, preferably Kubernetes.
• Strong understanding of LLM lifecycles, inference optimization, and RAG architectures.

Responsibilities

• Architect the future of runtimes: design and implement high-performance hosting environments for models and autonomous agents.
• Scale hybrid-cloud infrastructure: build multi-tenant platform capabilities for cross-cloud and on-prem environments.
• Drive operational excellence: implement real-time monitoring, distributed tracing, and automated evaluation of agents & models in production.
• Operational stewardship: be part of a rotating platform operations team ensuring reliability and uptime of AI services.
• Collaborate & advocate: partner with cross-functional AI teams to reduce friction and accelerate AI-driven value delivery.

Skills

Deep systems expertise

AI/ML fluency

Operational rigor

Problem-solving mindset

Education

Bachelor's degree in CS/Engineering or related field

Associate’s degree in CS/Engineering or related field

Tools

Kubernetes

Python

GCP

AWS

Azure

Job description

Aimlroles is seeking a senior platform engineer to architect high-performance hosting environments for AI models and autonomous agents, emphasizing scalable back-end systems and container orchestration. The role is hybrid, located within 100 miles of Mayo Clinic for occasional on-site expectations in Rochester, NY.

You will drive real-time monitoring, distributed tracing, and production evaluation of agents and models, and join a rotating platform operations team to ensure reliability and