Infrastructure Engineer: Scale Low-Latency AI Compute (NYC)

Harnham

New York (NY)

On-site

USD 200,000 - 440,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Harnham is seeking a Software Engineer - Infrastructure in New York City to join a fast-growing AI technology company. The role focuses on designing and building high-performance, low-latency infrastructure systems that support large-scale computation, while collaborating closely with engineers and researchers.

This position offers a salary range of $200,000 to $440,000 plus equity. Candidates should have strong experience in infrastructure systems and a proven background in performance optimization.

Qualifications

  • Strong experience solving engineering problems at the infrastructure or platform level.
  • Proven background building scalable systems used by large engineering teams.
  • Deep focus on performance, reliability, and developer experience.

Responsibilities

  • Design and build high-performance, low-latency infrastructure systems.
  • Scale and maintain reliable data ingestion pipelines.
  • Identify and resolve architectural inefficiencies across distributed systems.

Skills

Problem-solving at the infrastructure level
Building scalable systems
Performance optimization
Networking protocols
Production environments

Job description

Harnham is seeking a Software Engineer - Infrastructure in New York City to join a fast-growing AI technology company. The role focuses on designing and building high-performance, low-latency infrastructure systems that support large-scale computation, while collaborating closely with engineers and researchers.

This position offers a salary range of $200,000 to $440,000 plus equity. Candidates should have strong experience in infrastructure systems and a proven background in performance optimization.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Infrastructure Engineer
Infrastructure Engineer

Harnham • New York (NY)

On-site
USD 200,000 - 440,000
Infra Engineering Manager, AI Deployments
Infra Engineering Manager, AI Deployments

Scale AI • New York (NY), San Francisco (CA)

On-site
USD 216,000 - 270,000
Health, dental, and vision coverage
Retirement benefits
Learning and development stipend
+2
AI Infrastructure Engineer: Scale GPU ML Pipelines
AI Infrastructure Engineer: Scale GPU ML Pipelines

Akkodis • Town of Florida (NY)

On-site
USD 125,000 - 130,000
Senior Performance Engineer: AI Systems & Latency
Senior Performance Engineer: AI Systems & Latency

OpenAI • New York (NY)

On-site
USD 325,000 - 405,000
Senior GPU Systems Engineer: Scale AI Clusters & HPC
Senior GPU Systems Engineer: Scale AI Clusters & HPC

Career Techniques • New York (NY)

Hybrid
USD 200,000 - 300,000
AI Platform Engineer — Scalable ML Infra (Hybrid NYC)
AI Platform Engineer — Scalable ML Infra (Hybrid NYC)

Accrete • New York (NY)

Hybrid
USD 150,000 - 180,000
Health & wellness benefits
Flexible PTO
Catered lunch
+1
Platform Engineer: Scale Infra & Cloud-Native
Platform Engineer: Scale Infra & Cloud-Native

Anthropic • New York (NY)

Hybrid
USD 405,000 - 485,000
Platform Engineer — AI Infra, High-Impact, Equity
Platform Engineer — AI Infra, High-Impact, Equity

Xpertise Recruitment • New York (NY)

On-site
USD 212,000 - 250,000
Full Medical
Unlimited PTO
Equinox Membership
+2
Senior Mission Data Engineer - Scalable Low-Latency Systems
Senior Mission Data Engineer - Scalable Low-Latency Systems

Scale AI, Inc. • New York (NY)

On-site
USD 186,000 - 233,000
Comprehensive health, dental and vision coverage
Retirement benefits
Learning and development stipend
+2
Platform Engineer - Scale Infra, AI Tools, and Secure APIs
Platform Engineer - Scale Infra, AI Tools, and Secure APIs

Partiful • New York (NY)

On-site
USD 150,000 - 200,000
401(k) with up to 6% matching
Comprehensive health, dental, and vision insurance
Free OneMedical membership and telehealth services
+4