GenAI Infra Architect - Multi-Cloud, Kubernetes, Scale

Scale; San Francisco, New York (CA, NY); On-site; USD 179,000 - 224,000; Full time

Benefits offered by this job

Health, dental & vision insurance

Retirement benefits

Learning & development stipend

Generous PTO

Commuter stipend

Job summary

Scale is seeking an Infrastructure Software Engineer for Enterprise GenAI to design and scale our multi-cloud infrastructure across AWS, Azure, and GCP, with integrations to customer data environments. The role emphasizes collaboration with platform teams and customers, delivering high-quality experiments and evolving infrastructure.

Ideal candidates have 4+ years of software engineering, hands-on distributed systems, Kubernetes, and modern AI tooling like LLMs and vector databases.

Qualifications

• 4+ years of full-time engineering experience, post-graduation.
• Experience scaling products at hyper growth startups.
• Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies.
• Experience with Kubernetes.
• Experience with major cloud providers (AWS, Azure, GCP).
• Excellent communication skills with the ability to explain technical concepts to both technical and non-technical audiences.

Responsibilities

• Architect multi-cloud systems and abstractions to allow the Scale GenAI platform to run on top of existing Cloud providers.
• Implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs).
• Collaborate with platform, product teams and our customers directly to develop and implement infrastructure that scales to evolving needs.
• Deliver experiments at a high velocity and level of quality to engage customers.
• Work across the entire product lifecycle from conceptualization through production.
• Be able and willing to multi-task and learn new technologies quickly.

Skills

4+ years experience

Kubernetes

AWS

Azure

GCP

LLMs

Vector databases

Distributed systems

Multi-cloud

Communication skills

Job description

Scale is seeking an Infrastructure Software Engineer for Enterprise GenAI to design and scale our multi-cloud infrastructure across AWS, Azure, and GCP, with integrations to customer data environments. The role emphasizes collaboration with platform teams and customers, delivering high-quality experiments and evolving infrastructure.

Ideal candidates have 4+ years of software engineering, hands-on distributed systems, Kubernetes, and modern AI tooling like LLMs and vector databases.