Machine Learning Operations Engineer

4Minds

Dallas (TX)

On-site

USD 140,000 - 225,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Healthcare
401(k) with match
Flexible PTO
Paid holidays

Job summary

4Minds is seeking a senior Machine Learning Ops Engineer to own and scale the AI infrastructure across cloud and on‑prem environments. You will drive inference performance, model lifecycle automation, and GPU optimization with a hands‑on, research‑minded approach.

You’ll partner with the CTO to push the boundaries of AI deployment in enterprise settings, ensuring the platform remains private, scalable, and production‑ready at every stage.

Qualifications

  • 5+ years of hands-on production ML infrastructure experience.
  • Deploying and operating AI models at scale.
  • Bachelor’s or equivalent practical experience in CS/Engineering.
  • Deep proficiency with Kubernetes and Docker for multi‑env workloads.
  • Hands-on CI/CD pipelines for AI/ML lifecycles.
  • Strong knowledge of Nvidia Triton and TensorRT.
  • Experience across multiple clouds (GCP/AWS/Azure/CoreWeave).
  • GPU cluster management and on‑prem deployment experience.
  • Solid understanding of MLOps and model lifecycle management.

Responsibilities

  • Design, build, and improve CI/CD pipelines for AI models from development to production.
  • Own inference pipeline reliability across cloud and on‑prem environments.
  • Research GPU scaling approaches to inform infra decisions.
  • Implement Nvidia Triton Inference Server and Fleet Command usage.
  • Manage GPU clusters and deploy models with Kubernetes and Docker.
  • Automate model retraining and redeployment based on data changes.
  • Monitor system health and reliability with AI observability tools.
  • Collaborate with CTO on infrastructure research initiatives.

Skills

ML infra engineering
Kubernetes
Docker
CI/CD for AI
Nvidia Triton
TensorRT
Cloud platforms
GPU cluster mgmt
MLOps
Autonomy

Education

Bachelor's degree in CS/Engineering or related field
Master's degree (preferred)

Tools

Kubernetes
Docker
Nvidia Triton Inference Server
TensorRT
Nvidia Fleet Command

Job description

About Us

With 4Minds, you can advance beyond AI trained on public knowledge to custom AI that actually understands how your unique business operates. The platform continually applies evolving enterprise knowledge and operational context, reasoning across relationships, dependencies and changing business conditions. With 4Minds, you can deploy AI that stays aligned with missioncritical operations, supports strategic decisions and modernizes business workflows while continuously improving over time.

With 4Minds, you can advance beyond AI trained on public knowledge to custom AI that actually understands how your unique business operates. The platform continually applies evolving enterprise knowledge and operational context, reasoning across relationships, dependencies and changing business conditions. With 4Minds, you can deploy AI that stays aligned with missioncritical operations, supports strategic decisions and modernizes business workflows while continuously improving over time.

About This Role

As Machine Learning Ops Engineer at 4Minds, you will own the infrastructure that makes our AI platform perform, scale, and ship across the most demanding deployment environments in the enterprise market: GCP, AWS, Azure, CoreWeave , and on-premise . This isn't a role where you maintain what others built. You'll actively research, evaluate, and drive improvements across every layer of the stack, from inference pipeline reliability to GPU performance optimization across hardware architectures. Working in close partnership with the CTO, you'll take on initiatives that sit at the frontier of what's possible with modern AI infrastructure. Our platform's ability to deploy privately, on-premise or in any cloud, is a core product promise, and you're the engineer who makes that promise real at scale. This is a senior, hands‑on role on a focused engineering and research team. You'll bring production discipline to a system that demands it, while continuously pushing the boundaries of how we scale, optimize , and extend our infrastructure as the platform grows.

Key Responsibilities
  • Design, build, and continuously improve CI/CD pipelines that move AI models reliably from development through production, including testing, validation, and deployment automation
  • Own inference pipeline reliability and performance across GCP, AWS, Azure, CoreWeave, and on-premise environments, proactively identifying and implementing improvements
  • Research and evaluate GPU scaling approaches across hardware architectures to inform infrastructure decisions and extend platform capabilities
  • Implement and manage Nvidia Triton Inference Server and leverage Nvidia Fleet Command to streamline model inference workloads
  • Manage GPU clusters and deploy models using Kubernetes and Docker to ensure scalable, efficient across all deployment environments
  • Automate model retraining and redeployment processes in response to data updates and performance changes
  • Monitor system health, performance, and reliability using AI observability tools, with a focus on continuous improvement rather than maintenance alone
  • Partner closely with the CTO on infrastructure research initiatives, translating emerging hardware and deployment capabilities into production-ready systems
  • Support early on-premise customer installations and contribute to knowledge transfer as Solutions Engineering takes ownership of that function
Required Qualifications
  • 5+ years of hands‑on experience in production
  • ML infrastructure engineering, with a track record of deploying and operating AI models at scale
  • Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience
  • Deep proficiency with Kubernetes and Docker for deploying and managing all workloads across diverse environments
  • Hands‑on experience with CI/CD pipelines designed for AI and ML model lifecycle management
  • Strong working knowledge of Nvidia Triton Inference Server and TensorRT
  • Experience designing and managing infrastructure across multiple cloud platforms, including at least two of: GCP, AWS, Azure, CoreWeave
  • Solid understanding of GPU cluster management and the performance tradeoffs across hardware configurations
  • Experience with on‑premise AI deployment and the infrastructure complexity it introduces
  • Strong grasp of MLOps principles and AI model lifecycle management from experimentation through production
  • Ability to work autonomously, make infrastructure decisions with limited oversight, and communicate technical tradeoffs clearly to senior leadership
Preferred Qualifications
  • 7+ years of ML infrastructure experience, with increasing ownership of complex, multi‑environment deployments
  • Experience with Nvidia Fleet Command for managing distributed inference deployments or equivalent technology
  • Familiarity with GPU scaling research across hardware architectures beyond Nvidia
  • Background working directly with research or data science teams to productionize experimental models
  • Experience in high‑growth startups or early‑stage companies where infrastructure ownership is broad and fast‑moving
  • Familiarity with real‑time performance monitoring and observability tooling for AI systems
  • Master's degree in Computer Science, Engineering, or a related field, or equivalent practical experience
Compensation
  • $140,000 – $225,000 per year
  • Base salary as listed per role, plus equity package
  • Performance‑based commission structure for quota‑carrying positions
  • Annual merit‑based performance reviews targeting 20% of base salary for non‑quota‑carrying roles
Benefits
  • Comprehensive healthcare coverage (80% employer‑paid)
  • 401(k) with company matching
  • Flexible PTO starting at 15 days
  • 11 paid holidays
Professional Development
  • Annual training and certification budget
  • Access to enterprise learning platforms
  • Conference attendance opportunities
  • Internal workshops and knowledge‑sharing sessions
Work Environment
  • On‑site at our Dallas, TX office, 5 days per week
  • Standing desks and modern collaborative workspace
  • Monthly team events
  • Company‑provided laptop
Interview Process
  • Recruiter interview (30–60 minutes)
  • Hiring manager interview (30–60 minutes)
  • Technical interview loop (half or full day)
  • CEO interview (30–60 minutes)
  • Technical Interviews and/or Presentation (half to full day) Interview with CEO (30 minutes)

4MindsAI is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Machine Learning Operations Engineer
Machine Learning Operations Engineer

4MINDS AI Inc. • Dallas (TX)

On-site
USD 140,000 - 225,000
Healthcare coverage (80% employer-paid
401(k) with company matching
Flexible PTO
+2
DevSecOps Engineer
DevSecOps Engineer

4MINDS AI Inc. • Dallas (TX)

On-site
USD 130,000 - 220,000
Laptop provided
Healthcare coverage
Flexible PTO
+1
Fullstack Software Engineer
Fullstack Software Engineer

4MINDS AI Inc. • Dallas (TX)

On-site
USD 140,000 - 180,000
Equity package
Annual merit reviews
Healthcare coverage
+3
Fullstack Software Engineer
Fullstack Software Engineer

4MindsAI Inc. • Dallas (TX)

On-site
USD 140,000 - 180,000
Comprehensive medical, dental, and vision coverage
Unlimited PTO policy
Annual training and certification budget
Forward Deployed Engineer
Forward Deployed Engineer

4MINDS AI Inc. • Dallas (TX)

Hybrid
USD 190,000 - 225,000
Healthcare coverage (employer-paid)
401(k) with company matching
Flexible PTO
+3
Forward Deployed Engineer
Forward Deployed Engineer

4Minds • United States

Remote
USD 190,000 - 225,000
Healthcare coverage (80% employer-paid
401(k) with company matching
Flexible PTO 15 days
+1
Senior AI/ML Engineer | ML & MLOps Leader
Senior AI/ML Engineer | ML & MLOps Leader

Cogniify, Inc. • Santa Clara (CA)

Hybrid
USD 150,000 - 170,000
Unlimited PTO
Parental leave (generous)
Medical insurance
+3
Member of Technical Staff - Training Platform
Member of Technical Staff - Training Platform

Prime Intellect • United States

Remote
USD 150,000 - 300,000
Cash compensation $150K–$300K with equ
Flexible work arrangement (remote or S
Visa sponsorship and relocation
+3
Staff Engineer, Frontier AI Training Platform
Staff Engineer, Frontier AI Training Platform

Prime Intellect, Inc. • United States

Remote
USD 150,000 - 300,000
Cash compensation $150K–$300K with equ
Flexible work arrangement (remote or S
Visa sponsorship and relocation
+3
Software Engineer, Systems Generalist
Software Engineer, Systems Generalist

Bison • San Francisco (CA)

On-site
USD 300,000 - 400,000
Health benefits
Dental benefits
Vision benefits
+3