Software Engineer, Systems Machine Learning

Meta

Austin (TX)

On-site

USD 122,000 - 181,000

Full time

13 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Meta is seeking a Software Engineer to join the MTIA Software Tooling team, which builds the tooling ecosystem for Meta's in-house AI accelerator. You will design, build, and maintain developer tools that help engineers debug, profile, measure, and monitor AI workloads running on MTIA hardware at scale.

You will collaborate with the MTIA compiler, runtime, kernel, and hardware teams to integrate tooling hooks, own features end-to-end, and improve developer productivity across the MTIA ecosystem.

Qualifications

  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
  • 2+ years of experience in software engineering, with exposure to systems software, developer tooling, or infrastructure.
  • Proficiency in C++ and Python, including systems-level programming concepts.
  • Experience across multiple layers of a system stack (application, runtime, OS/driver, or hardware interfaces).
  • Track record of independently delivering software projects from design through production deployment.
  • Experience debugging and resolving issues in complex software systems (e.g., log analysis, stack traces).

Responsibilities

  • Design and develop software tools across the MTIA tooling ecosystem, including debugging, profiling, performance analysis, memory analysis, and monitoring infrastructure.
  • Own features and components end-to-end, from design through implementation, testing, and deployment.
  • Build and improve tooling infrastructure that enables engineers to efficiently develop, test, and optimize AI workloads on MTIA hardware.
  • Collaborate with the MTIA compiler, runtime, kernel, and hardware teams to integrate tooling hooks and support new platform capabilities.
  • Proactively identify gaps in the tooling ecosystem and propose solutions to improve developer productivity.
  • Contribute to technical design discussions, write design documents for medium-scope projects, and participate in code reviews.
  • Partner with internal product teams across advertising, recommendations, and generative AI to understand developer pain points and improve tool usability.

Skills

C++
Python
Systems programming
Tooling development
End-to-end ownership

Education

Bachelor's degree in Computer Science/Engineering

Tools

GDB
Perf
Valgrind

Job description

Summary:

Meta is seeking a Software Engineer to join the MTIA (Meta Training & Inference Accelerator) Software Tooling team, which develops and maintains the tooling ecosystem for Meta's in-house AI accelerator ASICs. The Tooling team provides debugging, profiling, memory analysis, and monitoring capabilities for the whole MTIA Ecosystem, redefining ML accelerator tooling by leveraging Meta's full-stack ownership from silicon specs to fleet observability.In this role, you will design, build, and maintain developer tools that help engineers debug, profile, measure, and monitor AI workloads running on MTIA hardware at scale. You will work at the intersection of compilers, runtime, hardware, and ML frameworks, collaborating with cross-functional partners to deliver a high-quality developer experience for Meta's custom AI accelerators.

Required Skills:

Software Engineer, Systems Machine Learning Responsibilities:

  1. Design and develop software tools across the MTIA tooling ecosystem, including debugging, profiling, performance analysis, memory analysis, and monitoring infrastructure

  2. Own features and components end-to-end, from design through implementation, testing, and deployment

  3. Build and improve tooling infrastructure that enables engineers to efficiently develop, test, and optimize AI workloads on MTIA hardware

  4. Collaborate with the MTIA compiler, runtime, kernel, and hardware teams to integrate tooling hooks and support new platform capabilities

  5. Proactively identify gaps in the tooling ecosystem and propose solutions to improve developer productivity

  6. Contribute to technical design discussions, write design documents for medium-scope projects, and participate in code reviews

  7. Partner with internal product teams across advertising, recommendations, and generative AI to understand developer pain points and improve tool usability

Minimum Qualifications:

Minimum Qualifications:

  1. Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta

  2. Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

  3. Bachelor's degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience

  4. 2+ years of experience in software engineering, with exposure to systems software, developer tooling, or infrastructure

  5. Proficiency in C++ and Python, including systems-level programming concepts

  6. Experience working across multiple layers of a system stack (e.g., application, runtime, OS/driver, or hardware interfaces)

  7. Track record of independently delivering software projects from design through production deployment

  8. Experience debugging and resolving issues in complex software systems (e.g., using log analysis, stack traces, or system-level diagnostic tools)

Preferred Qualifications:

Preferred Qualifications:

  1. Exposure to accelerator ecosystems (GPU/CUDA, TPU, custom ASICs) or heterogeneous computing environments

  2. Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies

  3. Experience building developer tools such as debuggers, profilers, build systems, CLI tools, monitoring dashboards, or diagnostic utilities

  4. Contributions to open-source projects demonstrating tooling or system software interest

  5. Experience in using data-driven methods to evaluate tooling effectiveness and to prioritize improvements

  6. Familiarity with Linux debugging and profiling tools (gdb, perf, strace, eBPF, valgrind) or similar diagnostic infrastructure

  7. Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)

  8. Familiarity with ML frameworks (PyTorch, TensorFlow) or compiler infrastructure (LLVM, MLIR, TVM)

  9. Experience with distributed systems debugging, profiling, or monitoring at scale

  10. Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)

Public Compensation:

$121,992/year to $181,000/year + bonus + equity + benefits

Industry: Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affir…

Meta is committed to providing reasonable accommodations for candidates with disabilities…

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer, Systems Machine Learning
Software Engineer, Systems Machine Learning

Meta • Sunnyvale (CA)

On-site
USD 122,000 - 181,000
Software Engineer, Systems ML
Software Engineer, Systems ML

Meta • Menlo Park (CA)

On-site
USD 154,000 - 217,000
Bonus
Equity
Benefits
Compiler Engineer, MTIA Software (Technical Leadership)
Compiler Engineer, MTIA Software (Technical Leadership)

Meta • New York (NY)

On-site
USD 219,000 - 301,000
Software Engineer, Systems ML
Software Engineer, Systems ML

Meta • Honolulu (HI)

On-site
USD 219,000 - 301,000
Software Engineer, Systems ML
Software Engineer, Systems ML

Meta • Dover (DE)

On-site
USD 219,000 - 301,000
Bonus
Equity
Benefits
Software Engineer, Systems ML - Compilers / Kernels
Software Engineer, Systems ML - Compilers / Kernels

Meta • New York (NY)

On-site
USD 122,000 - 181,000
Bonus
Equity
Benefits
Software Engineer, AI Kernels & Performance Optimization — MTIA Software
Software Engineer, AI Kernels & Performance Optimization — MTIA Software

Meta • New York (NY)

On-site
USD 184,000 - 257,000
Equity
Bonus
Benefits
System Engineer, AI Accelerator Module Management
System Engineer, AI Accelerator Module Management

Meta • Menlo Park (CA)

On-site
USD 173,000 - 245,000
Bonus
Equity
Benefits
Software Engineer, Systems ML - Compilers
Software Engineer, Systems ML - Compilers

Meta • Sunnyvale (CA)

On-site
USD 184,000 - 257,000
Production Systems Engineer, AI Systems
Production Systems Engineer, AI Systems

Meta • Menlo Park (CA)

On-site
USD 173,000 - 245,000