Senior Software Engineer, Distributed Systems

Parasail; California (MO); On-site; USD 140,000 - 200,000; Full time

Job summary

Parasail is redefining AI infrastructure by enabling seamless deployment across a distributed network of GPUs, optimizing for cost, performance, and flexibility.

The Senior Software Engineer, Distributed Systems will ensure scalable and secure AI platform deployment, working with AI-focused teams to orchestrate resources for high-performing workloads in cloud-native environments.

Qualifications

• 5+ years of backend or infrastructure experience in Kubernetes and distributed environments.
• Proven ability to build scalable, secure backends for AI workloads.
• Willingness to learn new technologies and stay current with AI infrastructure trends.

Responsibilities

• Oversee deployment, orchestration, and scaling of AI workloads on distributed infrastructure.
• Ensure security, resilience, and performance of the platform across cloud environments.
• Collaborate with AI performance teams to optimize cost, speed, and reliability.

Skills

Microservice Architecture

Backend Development

Java

Spring Boot

Golang

Distributed Systems

Cloud-Native

LLMs

Job description

Parasail is redefining AI infrastructure by enabling seamless deployment across a distributed network of GPUs, optimizing for cost, performance, and flexibility. Our mission is to empower AI developers with a fast, cost-efficient, and scalable cloud experience—free from vendor lock-in and designed for the next generation of AI workloads.

The Senior Software Engineer, Distributed Systems role at Parasail is crucial for ensuring the seamless deployment, scalability, and security of our AI platform. This position is tailored for individuals passionate about creating robust infrastructures that support complex AI workloads, with a strong emphasis on cloud compatibility, security, ease of use, and cost savings. You will work closely with AI-focused performance and solutions engineering teams, facilitating the orchestration of resources needed for high-performing AI applications, all while ensuring our infrastructure adheres to the highest standards of security and data privacy.

Technical Abilities

• Microservice Architecture: Deep understanding of distributed application design patterns, service decomposition, and inter-service communication. Experience in building scalable and maintainable microservice-based systems.
• Backend Development: Strong foundation in storage solutions and networking protocols. Ability to design and implement robust backend systems with optimized data management and network communication.
• Programming Languages & Frameworks: Extensive experience with Java, Spring Boot, and Golang. Proficiency in developing enterprise-grade applications using modern development frameworks and tools.
• Distributed Systems: Deep knowledge of distributed computing principles, including consistency models, fault tolerance, and scalability patterns. Experience in designing and maintaining large-scale distributed applications.
• Cloud-Native Technologies: Proficiency in cloud platforms and Infrastructure as Code (IaC). Experience with containerization, orchestration, and automated infrastructure deployment using modern DevOps practices.
• Large Language Models: Understanding of LLM technologies and their applications. Experience in integrating and working with AI language models in production environments, including model deployment and optimization.

Qualifications

• 5+ years of experience in backend or infrastructure, with exposure in Kubernetes and distributed computing environments.
• Demonstrated ability to build and secure scalable, high-performance backend.
• Hands-on to build brand new system and make end to end work
• Excellent problem-solving skills, with a track record of designing solutions that address the complex needs of AI workloads.
• While AI experience is not required, a demonstrated capacity to learn new technologies and stay up-to-date on the cutting edge is essential.

What You Bring to the Table

This role is pivotal in building a new breed of cloud architecture that enables enterprises to build powerful AI in their preferred environment with the same performance and economics as uncontrolled external services. This role ensures our AI solutions are not just innovative but also secure and sustainable. If you’re passionate about learning the cutting edge of AI, building the future of infrastructure, and making a tangible impact to the early days of a company, we’re excited to welcome you aboard.