GenAI Frameworks Engineer – MTIA Inference

Meta Careers

Menlo Park, Northern (CA, KY)

Hybrid

USD 150,000 - 210,000

Full time

2 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Meta is hiring a Software Engineer for GenAI Frameworks within MTIA in Menlo Park, CA. You will own a key area of GenAI inference on MTIA, shaping serving frameworks, distributed inference, graph-mode execution, and PyTorch integration.

You will lead multi-quarter programs, define technical direction, ensure accuracy, performance, and robust test coverage on in-house silicon, collaborating across teams and org boundaries to push frontier models into production.

Responsibilities

  • Serve as technical owner and domain expert for a GenAI inference framework area: serving runtime, distributed inference, graph-mode execution and compilation, or core PyTorch integration
  • Lead ambiguous, multi-quarter technical programs end to end: technical design, execution, test strategy and CI, rollout, and production hardening across teams and org boundaries

Job description

Meta is hiring a Software Engineer for GenAI Frameworks within MTIA in Menlo Park, CA. You will own a key area of GenAI inference on MTIA, shaping serving frameworks, distributed inference, graph-mode execution, and PyTorch integration.

You will lead multi-quarter programs, define technical direction, ensure accuracy, performance, and robust test coverage on in-house silicon, collaborating across teams and org boundaries to push frontier models into production.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer, GenAI Frameworks - MTIA
Software Engineer, GenAI Frameworks - MTIA

Meta Careers • Menlo Park (CA), Northern (KY)

Hybrid
USD 150,000 - 210,000
Senior Software Engineer - AI Infrastructure & Simulators
Senior Software Engineer - AI Infrastructure & Simulators

Meta • Bellevue (WA)

On-site
USD 180,000 - 240,000
Principal MTIA Compiler Architect — AI Accelerator Stack
Principal MTIA Compiler Architect — AI Accelerator Stack

Meta • New York (NY)

On-site
USD 219,000 - 301,000
Systems ML Engineer - AI Compiler & Kernel Optimizations
Systems ML Engineer - AI Compiler & Kernel Optimizations

Meta Careers • Santa Clara (CA), Northern (KY)

Hybrid
USD 180,000 - 240,000
GenAI Platform Engineer (MTS) – Remote US
GenAI Platform Engineer (MTS) – Remote US

Kamiwaza AI • Colorado

On-site
USD 100,000 - 200,000
401(k) match
Medical, dental, and vision insurance
Disability and life insurance
+2
Senior AI Kernel & Performance Engineer (MTIA)
Senior AI Kernel & Performance Engineer (MTIA)

Meta • Menlo Park (CA)

On-site
USD 154,000 - 217,000
AI Accelerator Tooling Systems Engineer
AI Accelerator Tooling Systems Engineer

Meta Careers • Menlo Park (CA)

On-site
USD 150,000 - 190,000
Staff Software Engineer, GenAI Inference Performance
Staff Software Engineer, GenAI Inference Performance

Google LLC • Mountain View (CA)

On-site
USD 207,000 - 300,000
GenAI Platform Engineer - AI/ML, Hybrid Work
GenAI Platform Engineer - AI/ML, Hybrid Work

Aimlroles • San Mateo (CA)

Hybrid
USD 114,000 - 202,000
Hybrid work options
Health and wellness benefits
Paid time off including volunteering
+1
AI Systems Engineer: ML Infra & Hardware Acceleration
AI Systems Engineer: ML Infra & Hardware Acceleration

Meta • Denver (CO)

On-site
USD 184,000 - 257,000