Real-Time AI Infra Engineer: Cloud, Reliability

Palona AI; Los Altos (CA); On-site; USD 150,000 - 230,000; Full time

Benefits offered by this job

Stock options

Medical, dental, vision

Paid time off

Learning and development

Job summary

Palona AI is seeking an Infrastructure Engineer to design, build, and operate the cloud platform under Palona’s AI products. You will write production code, design systems, automate repetitive work, and own outcomes across the full service lifecycle.

The role focuses on reliability, performance, and cost efficiency in a production environment using Python, Docker, AWS, and Terraform. Collaboration with product and AI teams is essential.

Qualifications

• 3+ years in relevant technical domain.
• Strong software engineering fundamentals and experience with production distributed systems.
• Hands-on experience with major cloud platforms (AWS preferred).
• Experience with containers, infrastructure as code, CI/CD, monitoring, and production debugging.
• Ability to write automation and services in Python or similar.
• Sound judgment on availability, latency, scalability, security, and cost tradeoffs.

Responsibilities

• Design, build, and evolve secure, scalable cloud infrastructure for real-time AI services and customer-facing apps.
• Improve service reliability through clear SLOs, observability, capacity planning, and incident prevention.
• Build deployment and release systems that are fast, repeatable, auditable, and safe.
• Own infrastructure as code and environment consistency across dev, staging, and production.
• Collaborate with product and AI engineers on architecture, performance, data flows, and operational readiness.
• Diagnose complex distributed-system failures across multiple boundaries.
• Reduce infrastructure and model-serving cost without compromising customer experience.
• Strengthen secrets management, access controls, backup/recovery, and vulnerability management.
• Build internal tooling to streamline shipping and operating services.
• Participate in incident response and turn incidents into durable improvements.

Skills

Distributed systems

Software engineering fundamentals

Architecture reviews

Incident response

Python or modern language

Tools

AWS

Docker

Terraform/OpenTofu

CI/CD

Monitoring/Datadog

Job description

Palona AI is seeking an Infrastructure Engineer to design, build, and operate the cloud platform under Palona’s AI products. You will write production code, design systems, automate repetitive work, and own outcomes across the full service lifecycle.

The role focuses on reliability, performance, and cost efficiency in a production environment using Python, Docker, AWS, and Terraform. Collaboration with product and AI teams is essential.