Senior AI Infrastructure Engineer

Together AI; San Francisco (CA); On-site; USD 160,000 - 230,000; Full time

Job summary

Together AI is seeking a Senior AI Infrastructure Engineer to build a scalable, multi-cloud PaaS platform using open-source technologies. The ideal candidate will have extensive experience in software development, particularly in Kubernetes and cloud microservices, with strong fundamentals in system-level concepts. This role offers a competitive salary, equity, and the opportunity to be a thought leader in AI technologies.

Benefits

Competitive compensation

Startup equity

Health insurance

Flexible remote work options

Qualifications

• 5+ years of experience with software development, preferably in Golang.
• Excellent understanding of operating systems, memory management, and networking.
• Experience with high-performance distributed systems and cloud providers.

Responsibilities

• Perform architecture and research for decentralized AI workloads.
• Work on the core Together AI platform and create developer documentation.
• Develop testing frameworks for robustness and fault-tolerance.

Skills

Infrastructure-as-code

Software development

Troubleshooting

Kubernetes

Cloud microservices

Communication

Tools

Terraform

Ansible

Golang

Pytorch

TensorFlow

Job description

Role

As a Senior AI Infrastructure Engineer, you will be responsible for building the next generation, highly available, global, multi-cloud PaaS platform with open-source technologies to enable and accelerate Together AI’s rapid growth.

Role

As a Senior AI Infrastructure Engineer, you will be responsible for building the next generation, highly available, global, multi-cloud PaaS platform with open-source technologies to enable and accelerate Together AI’s rapid growth.

This system spans many diverse environments (Kubernetes, VMs, bare metal compute, and edge deployments) and provides a cohesive and reliable abstraction for running AI workloads in them. You will get to be a technology thought leader, evangelize new, cutting-edge technologies, and solve complex problems.

To be successful, you’ll need to be deeply technical and possess excellent communication, collaboration, and diplomacy skills. You have experience practicing infrastructure-as-code, including using tools like Terraform and Ansible. You have strong software development fundamentals and skills. In addition, you have strong systems knowledge and troubleshooting abilities.

Requirements

• 5+ years of professional software development experience and proficiency in at least one backend programming language (Golang desired)
• Demonstrated experience with high performance or distributed cloud microservices architectures and ideally experience building them in operation at a global scale using multiple cloud providers such as AWS, Azure, or GCP
• Excellent understanding of low level operating systems concepts including multi-threading, memory management, networking and storage, performance, and scale
• Pragmatic, methodical, well-organized, detail-oriented, and self-starting
• Experience with Kubernetes and containerization, VPNs, AI workloads, and blockchain based protocols a plus
• GPU programming, NCCL, CUDA knowledge a plus
• Experience with Pytorch or Tensorflow a plus
• 5+ years experience writing high-performance, well-tested, production quality code
  
  

Responsibilities

• Perform architecture and research work for decentralized AI workloads
• Work on the core, open-source Together AI platform
• Create services, tools, and developer documentation
• Create testing frameworks for robustness and fault-tolerance
  
  

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $160,000 - $230,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Software Development

Referrals increase your chances of interviewing at Together AI by 2x

Get notified about new Senior Infrastructure Engineer jobs in San Francisco, CA.

1091-IT Operations Support Administrator I

San Francisco, CA $112,000.00-$160,000.00 1 day ago

1091-IT Operations Support Administrator I

San Francisco, CA $80.00-$109.00 21 hours ago

San Francisco, CA $100,000.00-$120,000.00 1 hour ago

Senior Manager IT Infrastructure, Operations

Alameda, CA $180,000.00-$225,000.00 1 day ago

San Francisco, CA $30,000.00-$220,000.00 1 day ago

San Francisco, CA $200,000.00-$225,000.00 5 days ago

Software Engineer, Deployment & Observability

San Francisco, CA $150,000.00-$250,000.00 21 hours ago

Emeryville, CA $180,000.00-$230,000.00 1 hour ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.