Principal Backend & ML Infrastructure Architect

Medium; Almont (CO); On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Health coverage

Home-office and connectivity allowance

Annual learning budget

Job summary

Level AI is seeking a Principal engineer to own backend and ML infrastructure architecture at scale in a fast-growing environment. You will lead cross-team design reviews, mentor senior engineers, and shape the engineering standards that sustain multiple products across global sites.

You will partner with ML, Product, and Infrastructure leads to drive a measurable impact on latency, throughput, and total cost of ownership.

Qualifications

• 10+ years building backend and infrastructure systems with architecture ownership.
• Experience with large-scale databases, high-throughput messaging, and real-time queues.
• Ability to navigate large codebases and reason about architectural tradeoffs.
• Experience mentoring senior engineers and driving decisions through influence.
• Strong written communication for multiple time zones and executives.
• BTech/MTech/PhD in Computer Science or equivalent is preferred.

Responsibilities

• Own the architecture for real-time data processing at scale and design distributed messaging systems.
• Build the ML platform for faster model training and serving infrastructure.
• Scale GPU infrastructure including capacity planning, scheduling, and utilization.
• Scale inference by optimizing latency, cost, and throughput with batching, routing, and autoscaling.
• Drive reliability, observability, and incident response for production systems.
• Turn business problems into executable technical plans with cross-functional partners.
• Lead design reviews, mentor engineers, and elevate engineering practices.
• Evaluate new tools and technologies and adopt those that add meaningful value.

Skills

10+ years backend/infrastructure

Large-scale databases

High-throughput messaging

Real-time queues

Mentoring engineers

Strong written communication

Education

BTech/MTech/PhD in Computer Science or equivalent

Tools

Django

Celery

Redis

PostgreSQL

Google Cloud

Job description

Level AI is seeking a Principal engineer to own backend and ML infrastructure architecture at scale in a fast-growing environment. You will lead cross-team design reviews, mentor senior engineers, and shape the engineering standards that sustain multiple products across global sites.

You will partner with ML, Product, and Infrastructure leads to drive a measurable impact on latency, throughput, and total cost of ownership.