Staff Backend Engineer - Infrastructure

Lastmileai; New York (NY); On-site; USD 150,000 - 200,000; Full time

Benefits offered by this job

Competitive salary

Equity options

Flexible work environment

Job summary

A technology company in New York seeks an exceptional engineer for head of infrastructure to manage and build their software platform. This role involves tackling ML Ops challenges and optimizing the platform's capabilities within real-world deployment constraints. Ideal candidates have at least 7 years of experience in distributed systems and are proactive problem solvers.

Qualifications

• 7+ years of experience as an infrastructure engineer.
• Experience building distributed systems at scale.
• Entrepreneurial mindset with proactive initiative.

Responsibilities

• Guide platform architecture for deployment scenarios.
• Manage Kubernetes clusters and workers.
• Develop the inference and model training backend.
• Optimize service reliability for enterprise use-cases.

Skills

Distributed systems

Kubernetes management

Terraform

Data pipeline design

Machine Learning Operations

Job description

We’re LastMile AI , a company revolutionizing the way developers build AI agents. mcp-agent gives developers a composable framework to build powerful AI agents. We are a small team, primarily comprised of experienced engineers and product designers.

We are seeking an exceptional engineer to be our head of infrastructure, who will build and manage our software platform, including building and leading a team around this function in the future. The role comprises challenging ML Ops problems to optimize our platform’s capabilities across various deployments with security, privacy and hardware constraints. Success in this position requires making decisions that anticipate the needs of customers and solving for challenges faced in real-world deployment scenarios.

Key Responsibilities

• Guiding platform architecture to support known and anticipated deployment scenarios.
• Using Terraform to manage the infrastructure.
• Managing Kubernetes clusters and workers.
• Developing the inference and model training backend.
• Designing data pipelines including evaluation metric computations.
• Optimizing service reliability and performance for enterprise use-cases.
• Growing and mentoring the team as we scale.

Qualifications

• Exceptional infrastructure engineer (staff IC with 7+ years of experience) with prior first‑hand experience building distributed systems at scale.
• Entrepreneurial mindset with experience proactively identifying opportunities and tackling initiatives without waiting for direction.
• Based in or willing to relocate to New York.

Nice to Have

• Experience with AI agents and generative AI research.

Why Join Us?

Lead the technical roadmap and guide a talented engineering team to build the infrastructure that will solve some of the most challenging and important AI problems.

Work alongside a passionate and talented team of technologists and innovators.

Competitive salary, equity and the opportunity to make a tangible impact on the company's trajectory.

Flexible work environment with a culture that values autonomy and growth.

How to Apply

Reach out to [e-mail] if you’re excited about working at LastMile AI, and explain how you can create exceptional impact. Send along links that best showcase evidence of exceptional ability.