Full-Stack AI Infra Engineer — Scale & Inference

Bytoa

Laurel (MD)

On-site

USD 200,000 - 220,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Bytoa is seeking a Full-Stack Software Engineer to support our AI infrastructure team in Laurel, MD. You will help build and maintain the platform that enables customer AI capabilities, focusing on inference services and scalable AI infrastructure components.

Salary range listed as $200,000–$220,000 with compensation determined case-by-case. This role requires experience with production systems, AWS, Kubernetes, and observability, and offers opportunities to mentor junior engineers.

Qualifications

  • Extensive experience building & maintaining production systems.
  • Experience with high-volume web applications and performance optimization.
  • Strong background in systems integration across diverse technologies and platforms.

Responsibilities

  • Design, implement, and optimize infrastructure for AI model inference at scale.
  • Support production AI services and applications including retrieval augmented generation (RAG) and autonomous agents.
  • Navigate ambiguity and define solutions for underspecified systems and requirements.
  • Drive adoption of new technologies and practices across engineering teams.
  • Implement monitoring, logging, and observability solutions for AI services.
  • Automate infrastructure provisioning and configuration using IaC principles.
  • Ensure high availability, reliability, and performance of AI platform components.
  • Provide technical guidance and informal mentorship to junior engineers.

Skills

Production systems
Web app architecture
Systems integration
AWS
Kubernetes
Observability
CI/CD
DevOps
Communication
Mentoring

Education

BS in technical discipline
4 additional years of experience in lieu of BS

Job description

Bytoa is seeking a Full-Stack Software Engineer to support our AI infrastructure team in Laurel, MD. You will help build and maintain the platform that enables customer AI capabilities, focusing on inference services and scalable AI infrastructure components.

Salary range listed as $200,000–$220,000 with compensation determined case-by-case. This role requires experience with production systems, AWS, Kubernetes, and observability, and offers opportunities to mentor junior engineers.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Full Stack Software Engineer (AI Infrastructure)
Full Stack Software Engineer (AI Infrastructure)

Bytoa • Laurel (MD)

On-site
USD 200,000 - 220,000
Full Stack Software Engineer (AI Infrastructure)
Full Stack Software Engineer (AI Infrastructure)

The Josef Group • Columbia (MD)

On-site
USD 120,000 - 180,000
Senior AI Systems & Infra Engineer - Scalable LLMs
Senior AI Systems & Infra Engineer - Scalable LLMs

Bytoa • Columbia (MD)

On-site
USD 235,000 - 255,000
AI Infra Engineer: Scale & Reliability with Equity
AI Infra Engineer: Scale & Reliability with Equity

Togetherai • San Francisco (CA)

On-site
USD 190,000 - 270,000
Health insurance
Startup equity
Competitive benefits
Full-Stack Engineer for AI Infra — Hybrid + Equity
Full-Stack Engineer for AI Infra — Hybrid + Equity

bespokelabs • Mountain View (CA)

Hybrid
USD 120,000 - 160,000
Health coverage
Flexible work arrangements
Competitive salary and equity
Senior AI Infrastructure Engineer, Inference at Scale
Senior AI Infrastructure Engineer, Inference at Scale

Bigbear.ai • Columbia (MD)

On-site
USD 150,000 - 190,000
Lead AI-Driven Full-Stack Engineer
Lead AI-Driven Full-Stack Engineer

Infinite Computer Solutions • Washington

Hybrid
USD 120,000 - 170,000
Platform Engineer – AI Infra & Cloud Foundations
Platform Engineer – AI Infra & Cloud Foundations

Scale AI, Inc. • San Francisco (CA)

On-site
USD 216,000 - 270,000
Comprehensive health, dental and vision coverage
Retirement benefits
Learning and development stipend
+2
Staff Engineer, Inference Runtime — High-Performance AI Serving
Staff Engineer, Inference Runtime — High-Performance AI Serving

Anthropic • Seattle (WA)

Hybrid
USD 405,000 - 485,000
Staff Software Engineer, Inference Systems at Scale
Staff Software Engineer, Inference Systems at Scale

Anthropic • San Francisco (CA)

On-site
USD 300,000 - 485,000
Competitive salary
Flexible working hours
Generous vacation and parental leave