Senior AI Platform & Runtime Engineer | AWS + LLMs

HedgeServ Corporation; Raleigh (NC); Hybrid; USD 150,000 - 210,000; Full time

Benefits offered by this job

Remote and hybrid work options

Job summary

HedgeServ Corporation seeks a Senior AI Platform and Runtime Engineer to build and operate its shared AWS platform for AI applications and agents. You will own runtime infrastructure, identity and security, model access, deployment, and reliability, delivering scalable capabilities and reusable standards for engineering teams.

This role focuses on secure, scalable AI platforms, production LLM workloads, and cross-team collaboration to deliver measurable outcomes.

Qualifications

• 5+ years of software engineering experience, including at least 1 year delivering LLM or agent-based applications in production.
• Demonstrated experience in cloud, platform, site reliability, or software engineering with responsibility for production systems.
• Strong enterprise-cloud experience across identity, networking, compute, storage, and event-driven architectures. Hands-on AWS experience is preferred; deep experience with another enterprise cloud and the ability to transfer those skills to AWS are also valued.
• Experience with infrastructure as code, containerized workloads, and automated delivery using Terraform, AWS CDK, Docker, ECS, EKS, or comparable cloud-native technologies.
• Hands-on experience building or operating production LLM, generative AI, or agent applications using model APIs, structured outputs, tool integration, retrieval, or comparable patterns.
• Experience designing or operating distributed systems with asynchronous processing, state management, retries, idempotency, resilience, and recovery.
• Working knowledge of observability, incident response, cost management, and enterprise security practices.
• Strong analytical, troubleshooting, communication, and collaboration skills, with the ability to work across technical and business teams.

Responsibilities

• Design, build, and operate secure, scalable AI and agent platforms on AWS, applying relevant patterns from other enterprise clouds.
• Own platform architecture across infrastructure, AI services, identity, networking, observability, and runtime operations.
• Automate infrastructure and delivery using Terraform, AWS CDK, and CI/CD tooling.
• Deploy and support production LLM and agent workloads using Amazon Bedrock and related AWS services.
• Build resilient distributed systems using asynchronous processing, durable state, retries, idempotency, and recovery.
• Own agent-runtime reliability, including scaling, performance, observability, service-level objectives, incident response, pause-and-resume recovery, and cost optimization.
• Implement identity and authorization controls, least privilege, encryption, secrets management, and auditable data and tool access.
• Govern model access, quotas, provider onboarding, evaluation, and lifecycle controls.
• Partner with engineering, architecture, security, product, and business teams to establish reusable standards and patterns.

Skills

LLM apps

Agent workloads

AWS (primary)

Terraform

AWS CDK

Docker

ECS

EKS

Security controls

Observability

Distributed systems

Tools

Terraform

AWS CDK

Docker

ECS

EKS

Job description

HedgeServ Corporation seeks a Senior AI Platform and Runtime Engineer to build and operate its shared AWS platform for AI applications and agents. You will own runtime infrastructure, identity and security, model access, deployment, and reliability, delivering scalable capabilities and reusable standards for engineering teams.

This role focuses on secure, scalable AI platforms, production LLM workloads, and cross-team collaboration to deliver measurable outcomes.