Lead AI/ML Engineer

OfferGenie

United States

Hybrid

USD 150,000 - 230,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Marlabs is seeking a Lead AI/ML Engineer to design, build, and scale enterprise AI systems that power smart decision-making and business outcomes.

You will lead production AI initiatives, including RAG, model serving, and governance controls, working with data, platform, and product teams to ensure secure, explainable, and compliant outputs.

Qualifications

  • 6+ years of software engineering experience with production AI/NLP/LLM deployments.
  • Strong Python and modern AI/ML framework proficiency.
  • Hands-on with LLM tech: model serving, embeddings, vector stores, and retrieval pipelines.
  • Experience implementing AI governance, security controls, and responsible AI practices.
  • Ability to collaborate across data, platform, product, and engineering teams in complex enterprises.

Responsibilities

  • Design, build, and scale enterprise AI solutions including RAG and AI-powered decision support.
  • Develop and maintain AI model serving infra, embedding services, and vector search pipelines.
  • Create evaluation frameworks to measure accuracy, groundedness, and business impact.
  • Implement governance, guardrails, data protection, access controls, and monitoring.
  • Collaborate with product, security, and business stakeholders to define AI product capabilities.

Skills

Software engineering
Python
Production AI
LLM/NLP
AI governance
Cross-functional collaboration

Tools

Model serving
Vector databases
RAG pipelines
Ollama
Qdrant
pgvector
LlamaIndex
Haystack

Job description

Marlabs, a global AI and Digital Solutions Consulting firm, delivers intelligent solutions across AI, data, analytics, and product engineering. Since 2000, we have partnered with some of the largest healthcare, life sciences, financial services, and government organizations worldwide. As we continue to expand our global footprint, we have an exciting opportunity for a highly skilled Lead AI/ML Engineer to join our innovative and dynamic team.

Lead AI/ML Engineer | About You

As a Lead AI/ML Engineer, you will be responsible for designing, building, and scaling enterprise‑grade AI solutions that power intelligent decision‑making and business outcomes. You will lead the development of production AI systems, including retrieval‑augmented generation (RAG), model serving, AI orchestration, evaluation frameworks, and governance controls. Working closely with data engineering, platform engineering, and product teams, you will ensure AI solutions are accurate, explainable, secure, and compliant while delivering measurable business value. The ideal candidate combines deep AI/ML expertise with strong software engineering fundamentals and experience deploying production‑grade generative AI solutions in regulated or high‑stakes environments.

Lead AI/ML Engineer | Day‑to‑Day

  • Design, build, and optimize enterprise AI solutions, including retrieval‑augmented generation (RAG), semantic retrieval, model orchestration, and AI‑powered decision support capabilities.
  • Develop and maintain AI model serving infrastructure, embedding services, vector search platforms, and inference pipelines to support scalable production workloads.
  • Build AI evaluation frameworks and testing methodologies to measure model accuracy, groundedness, response quality, reliability, and business performance.
  • Implement AI governance, security, and guardrail controls, including PII protection, prompt injection defenses, access controls, model monitoring, and compliance requirements.
  • Partner with data engineering teams to integrate governed data sources, semantic layers, and structured‑query frameworks that ensure trustworthy and explainable AI outputs.
  • Collaborate with product, platform, security, and business stakeholders to define AI product capabilities, optimize performance, and continuously improve AI solution effectiveness.

Lead AI/ML Engineer | Skills & Experience

  • 6+ years of software engineering experience, including 2+ years building and deploying production AI, Machine Learning, NLP, LLM, or Retrieval‑Augmented Generation (RAG) solutions.
  • Strong expertise in Python and modern AI/ML frameworks, with experience developing scalable, production‑grade AI applications and services.
  • Hands‑on experience with LLM technologies, including model serving, vector databases, embeddings, prompt engineering, retrieval pipelines, agent/tool orchestration, and AI workflow automation.
  • Experience implementing AI governance and security controls, including model evaluation, guardrails, PII protection, prompt injection prevention, access controls, and responsible AI practices.
  • Proven ability to collaborate across data, platform, product, and engineering teams, delivering reliable, explainable, and business‑aligned AI solutions in complex enterprise environments.
  • Preferred: Experience with self‑hosted/open‑weight models, vLLM, Ollama, Qdrant, pgvector, LlamaIndex, Haystack, semantic layers, financial services, or other highly regulated industries.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead AI/ML Engineer
Lead AI/ML Engineer

Marlabs Inc. • United States

Hybrid
USD 130,000 - 185,000
Lead AI/ML Engineer — Production AI & RAG Expert
Lead AI/ML Engineer — Production AI & RAG Expert

Marlabs Inc. • Northern (KY)

Hybrid
USD 130,000 - 185,000
AI/ML Engineer
AI/ML Engineer

RiskForce LLC • United States

On-site
USD 120,000 - 180,000
Senior Software/AI engineer Central Europe
Senior Software/AI engineer Central Europe

Zoolatech • Central (LA)

On-site
USD 140,000 - 190,000
AI/ML Engineer
AI/ML Engineer

Akaasa Technologies • United States

Remote
USD 150,000 - 210,000
Senior LLMOps Engineer
Senior LLMOps Engineer

UNAVAILABLE • McLean (VA)

On-site
USD 180,000 - 240,000
Lead AI Scientist
Lead AI Scientist

EdCast • Mountain View (CA)

On-site
USD 190,000 - 270,000
Applied AI/ML Lead
Applied AI/ML Lead

JPMorgan Chase & Co. • Jersey City (NJ)

On-site
USD 180,000 - 260,000
Senior AI Engineer: Scalable LLMs & MLOps Leader
Senior AI Engineer: Scalable LLMs & MLOps Leader

Compunnel, Inc. • San Francisco (CA)

On-site
USD 120,000 - 160,000
AI Lead
AI Lead

Coforge • Oaks (PA)

On-site
USD 120,000 - 160,000