Senior Software Engineer, Distributed Systems

Kindredventures

San Mateo (CA)

On-site

USD 170,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Parasail in San Mateo is redefining AI infrastructure by enabling seamless deployment across a distributed GPU network. Our mission is to empower AI developers with a fast, cost-efficient, and scalable cloud experience—free from vendor lock-in and designed for the next generation of AI workloads.

The Senior Software Engineer, Distributed Systems role at Parasail is crucial for ensuring the seamless deployment, scalability, and security of our AI platform.

Qualifications

  • 5+ years in backend or infrastructure roles with Kubernetes exposure.
  • Ability to design scalable, high‑performance backend systems.
  • Hands‑on to build end‑to‑end new systems.
  • Excellent problem‑solving skills for AI workloads.
  • Willingness to learn cutting‑edge technologies.

Skills

Microservice Architecture
Backend Development
Programming Languages & Frameworks
Distributed Systems
Cloud-Native Technologies
Large Language Models

Tools

Kubernetes

Job description

Parasail is redefining AI infrastructure by enabling seamless deployment across a distributed network of GPUs, optimizing for cost, performance, and flexibility. Our mission is to empower AI developers with a fast, cost-efficient, and scalable cloud experience—free from vendor lock-in and designed for the next generation of AI workloads.

The Senior Software Engineer, Distributed Systems role at Parasail is crucial for ensuring the seamless deployment, scalability, and security of our AI platform. This position is tailored for individuals passionate about creating robust infrastructures that support complex AI workloads, with a strong emphasis on cloud compatibility, security, ease of use, and cost savings. You will work closely with AI‑focused performance and solutions engineering teams, facilitating the orchestration of resources needed for high‑performing AI applications, all while ensuring our infrastructure adheres to the highest standards of security and data privacy.

Technical Abilities
  • Microservice Architecture: Deep understanding of distributed application design patterns, service decomposition, and inter‑service communication. Experience in building scalable and maintainable microservice‑based systems.

  • Backend Development: Strong foundation in storage solutions and networking protocols. Ability to design and implement robust backend systems with optimized data management and network communication.

  • Programming Languages & Frameworks: Extensive experience with Java, Spring Boot, and Golang. Proficiency in developing enterprise‑grade applications using modern development frameworks and tools.

  • Distributed Systems: Deep knowledge of distributed computing principles, including consistency models, fault tolerance, and scalability patterns. Experience in designing and maintaining large‑scale distributed applications.

  • Cloud‑Native Technologies: Proficiency in cloud platforms and Infrastructure as Code (IaC). Experience with containerization, orchestration, and automated infrastructure deployment using modern DevOps practices.

  • Large Language Models: Understanding of LLM technologies and their applications. Experience in integrating and working with AI language models in production environments, including model deployment and optimization.

Qualifications
  • 5+ years of experience in backend or infrastructure, with exposure in Kubernetes and distributed computing environments.

  • Demonstrated ability to build and secure scalable, high‑performance backend.

  • Hands‑on to build brand new system and make end to end work.

  • Excellent problem‑solving skills, with a track record of designing solutions that address the complex needs of AI workloads.

  • While AI experience is not required, a demonstrated capacity to learn new technologies and stay up‑to‑date on the cutting edge is essential.

What You Bring to the Table

This role is pivotal in building a new breed of cloud architecture that enables enterprises to build powerful AI in their preferred environment with the same performance and economics as uncontrolled external services. This role ensures our AI solutions are not just innovative but also secure and sustainable. If you’re passionate about learning the cutting edge of AI, building the future of infrastructure, and making a tangible impact to the early days of a company, we’re excited to welcome you aboard.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Distributed Systems Engineer - AI Infra & Cloud
Senior Distributed Systems Engineer - AI Infra & Cloud

Kindredventures • San Mateo (CA)

On-site
USD 170,000 - 210,000
Senior Site Reliability Engineer, Site Lead
Senior Site Reliability Engineer, Site Lead

Parasail • United States

Remote
USD 201,000 - 313,000
Senior Inference Reliability Engineer
Senior Inference Reliability Engineer

Parasail • California

On-site
USD 180,000 - 280,000
Distributed Systems Software Engineer - Public Cloud (Mid/Senior/Lead/Principal)
Distributed Systems Software Engineer - Public Cloud (Mid/Senior/Lead/Principal)

Leadout Capital • San Francisco (CA)

On-site
USD 180,000 - 240,000
Wellbeing reimbursement
Parental leave
Adoption assistance
+1
Senior Software Engineer (Cloud)
Senior Software Engineer (Cloud)

7AI • Boston (MA)

On-site
USD 120,000 - 150,000
AI Infrastructure Lead
AI Infrastructure Lead

Outsourceit • San Francisco (CA)

On-site
USD 120,000 - 170,000
Lead Software Engineer- Distributed Systems
Lead Software Engineer- Distributed Systems

Leadout Capital • San Francisco (CA)

On-site
USD 180,000 - 260,000
Senior AI/ML & Cloud Native Software Engineer
Senior AI/ML & Cloud Native Software Engineer

Parallax Advanced Research • Beavercreek (OH)

On-site
USD 120,000 - 150,000
Medical, dental, and vision coverage
Employer-paid life and disability insurance
401(k) with company match
+2
Cloud Native Engineer
Cloud Native Engineer

SproutsAI • Palo Alto (CA)

On-site
USD 120,000 - 160,000
Competitive salary and equity
Hybrid work model
Senior SRE: Global GPU Infra & Production Reliability
Senior SRE: Global GPU Infra & Production Reliability

Parasail • San Mateo (CA)

Hybrid
USD 160,000 - 240,000