Senior ML Infra Engineer: Automation & CI/CD

fal; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Health, dental, and vision insurance (

Job summary

fal is empowering the next generation of AI products by building scalable infra, tools, and model access for developers and enterprises. This role focuses on accelerating ML development by owning and improving CI/CD systems and automation for a growing suite of models and inference pipelines.

You will collaborate with Applied ML and ML Performance teams to ship new models and optimizations with confidence, designing automated model validation, performance benchmarks, and AI-driven workflows that

Qualifications

• 5+ years of software engineering background with production infrastructure experience.
• Strong Python proficiency and ability to build tooling for developers.
• Experience designing and operating CI/CD systems, especially with GitHub Actions.
• Deep understanding of automated testing, build systems, caching, and parallel execution.
• Experience with containerized workloads (Docker) and cloud infrastructure.
• Ability to design reliable distributed systems and diagnose complex failures.
• Strong observability skills: logs, metrics, tracing, and alerting.
• Proven track record of improving developer productivity through automation.

Responsibilities

• Own ML CI/CD infrastructure for ML models and inference services.
• Design, build, and maintain automated testing, validation, and deployment pipelines.
• Reduce CI execution times via parallelization, caching, and efficient resource use.
• Develop automated model validation to detect quality regressions across models and GPUs.
• Build continuous performance testing for latency, throughput, GPU utilization, and cost.
• Create automated pricing and deployment checks before production rollout.
• Advance agentic engineering workflows to diagnose CI failures and propose fixes.
• Improve deployment reliability with safeguards, verification, and rollback strategies.
• Eliminate repetitive toil by building end-to-end automation for ML teams.

Skills

Python

CI/CD

Automation

Observability

Distributed systems

Tools

Docker

GitHub Actions

Cloud platforms

Job description

fal is empowering the next generation of AI products by building scalable infra, tools, and model access for developers and enterprises. This role focuses on accelerating ML development by owning and improving CI/CD systems and automation for a growing suite of models and inference pipelines.

You will collaborate with Applied ML and ML Performance teams to ship new models and optimizations with confidence, designing automated model validation, performance benchmarks, and AI-driven workflows that