AI Infra Engineer: SRE for Secure LLM Platforms

Capstoneinvestmentadvisors

New York (NY)

On-site

USD 165,000 - 200,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Training and development opportunities
Robust wellness resources
Time-off and retirement benefits
Gym reimbursement
Commuter benefits

Job summary

Capstone Investment Advisors is looking for an AI Infrastructure Engineer to design and build the foundational infrastructure for AI-driven development. You'll focus on creating production-grade systems to support intelligent agents and large language models.

Ideal candidates will have a strong software engineering background and hands-on experience with AI infrastructure and Site Reliability Engineering. Join us and be a part of innovative AI solutions that shape the future.

Qualifications

  • 5+ years of professional software engineering experience.
  • Experience managing Kubernetes in a production environment.
  • Expertise in supporting AI/ML infrastructure.

Responsibilities

  • Design and implement orchestration frameworks for LLM-powered tools.
  • Develop scalable infrastructure for distributed agent development.
  • Manage agent lifecycles ensuring compliance with standards.
  • Build and maintain Model Context Protocol services.
  • Establish monitoring and security frameworks for AI operations.
  • Promote AI infrastructure best practices across teams.

Skills

Software engineering
Kubernetes management
AI/ML infrastructure
API security

Job description

Capstone Investment Advisors is looking for an AI Infrastructure Engineer to design and build the foundational infrastructure for AI-driven development. You'll focus on creating production-grade systems to support intelligent agents and large language models.

Ideal candidates will have a strong software engineering background and hands-on experience with AI infrastructure and Site Reliability Engineering. Join us and be a part of innovative AI solutions that shape the future.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Infrastructure Architect for Scalable AI Platforms
AI Infrastructure Architect for Scalable AI Platforms

Capstone Investment Advisors • New York (NY)

On-site
USD 120,000 - 150,000
AI Infrastructure Engineer
AI Infrastructure Engineer

Capstone Investment Advisors • New York (NY)

On-site
USD 120,000 - 150,000
AI Infrastructure Engineer
AI Infrastructure Engineer

Hedge Fund • New York (NY)

On-site
USD 150,000 - 230,000
AI Platform Engineer: Scalable Infra & SRE
AI Platform Engineer: Scalable Infra & SRE

Hedge Fund • New York (NY)

On-site
USD 150,000 - 230,000
AI Infrastructure Engineer
AI Infrastructure Engineer

Capstoneinvestmentadvisors • New York (NY)

On-site
USD 165,000 - 200,000
Training and development opportunities
Robust wellness resources
Time-off and retirement benefits
+2
AI Infrastructure SRE - Ultra-Low Latency & Automated Ops
AI Infrastructure SRE - Ultra-Low Latency & Automated Ops

Blaxel • San Francisco (CA)

On-site
USD 130,000 - 160,000
Innovative work environment
Opportunities for professional growth
Competitive compensation package
SRE for AI Platform & ML Inference Infra
SRE for AI Platform & ML Inference Infra

Cohere • New York (NY)

Hybrid
USD 140,000 - 200,000
Weekly lunch stipend
Health and dental benefits
RRSP matching
+3
AI Engineer - Build Production-Grade LLM Systems
AI Engineer - Build Production-Grade LLM Systems

Innovaccer Inc. • San Francisco (CA), Northern (KY)

Hybrid
USD 140,000 - 210,000
Generous PTO
Parental Leave
Rewards & Recognition
+1
Senior AI Infra Engineer - Scalable LLM Platforms
Senior AI Infra Engineer - Scalable LLM Platforms

Crusoe Energy Systems LLC • San Francisco (CA), Northern (KY)

Hybrid
USD 170,000 - 205,000
Health insurance
401(k) with company match
Paid parental leave
+6
Senior Staff AI Infra Engineer — LLM Serving (Hybrid)
Senior Staff AI Infra Engineer — LLM Serving (Hybrid)

LinkedIn • California (MO)

Hybrid
USD 198,000 - 326,000
Annual performance bonus
Stock options
Comprehensive benefits package