Senior AI Platform Engineer

PRI Technology; New York (NY); On-site; USD 160,000 - 240,000; Full time

Job summary

PRI Technology in New York, NY seeks a Senior Software Engineer to build reliable, compliant AI platform services powering enterprise workflows.

You will design Kubernetes-based PaaS, AI/LLM gateways, and self-service developer tooling, with emphasis on reliability, observability, and secure networking.

Candidates should have 6+ years of experience, strong Python, AWS, Terraform, and production-grade backend expertise; ability to lead large initiatives.

Qualifications

• Six or more years of professional software engineering experience.
• Strong Python development skills, including production-grade backend services and APIs.
• Experience designing and operating distributed systems in public-cloud environments.
• Strong understanding of failure modes, fault tolerance, high availability, and resilient design patterns.
• Hands-on AWS experience, including EC2, S3, IAM, and container-based workloads.
• Experience with Infrastructure as Code, preferably Terraform.
• Experience supporting production systems using metrics, logging, tracing, dashboards, alerting, SLOs, and incident-response practices.
• Strong knowledge of software architecture, databases, networking, cloud infrastructure, and modern application development.
• Demonstrated ability to take ownership and independently lead complex technical projects.
• Bachelor’s degree in computer science, engineering, or related field, or equivalent practical experience.

Responsibilities

• Improve platform reliability and resilience by designing for failure and meeting SLOs.
• Design, build, and operate Kubernetes-based PaaS frameworks and APIs for enterprise AI apps.
• Develop model-agnostic gateway capabilities for providers like OpenAI, Anthropic, Gemini, and AWS Bedrock.
• Implement routing, fallbacks, retries, rate limiting, caching, and cost controls across providers.
• Build observability solutions covering metrics, logs, traces, dashboards, and alerting.
• Develop secure networking solutions connecting public-cloud and on-premises environments.
• Provision and manage AWS infrastructure using Terraform and IaC practices.
• Maintain platform security through dependency patching, upgrades, migrations, and provider updates.
• Create reusable frameworks, templates, tools, and workflows to boost developer productivity.
• Evaluate emerging AI tech and adapt the platform for new development patterns.
• Independently lead large technical initiatives from concept to production.

Skills

Python development

Distributed systems

AWS

Kubernetes

Terraform

Observability

API design

Education

Bachelor’s degree in computer science, engineering, or related field

Tools

OpenTelemetry

Prometheus

Grafana

Datadog

AWS SageMaker

Job description

PRI Technology in New York, NY seeks a Senior Software Engineer to build reliable, compliant AI platform services powering enterprise workflows.

You will design Kubernetes-based PaaS, AI/LLM gateways, and self-service developer tooling, with emphasis on reliability, observability, and secure networking.

Candidates should have 6+ years of experience, strong Python, AWS, Terraform, and production-grade backend expertise; ability to lead large initiatives.