Senior ML Engineer: Production AI for Edge & Secure Systems

webAI; Washington; On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Competitive salary

Health, dental & vision benefits

401(k) match

Health stipend

Education support

Function Health subscription

Free parking

Flexible time off

Parental leave

Life insurance

Job summary

webAI is seeking a Senior Machine Learning Engineer to support Public Sector initiatives focused on building and optimizing production-ready AI systems for secure and distributed environments.

You will transform prototype models into scalable, reliable production workflows that operate across government cloud, edge devices, and restricted networks, using PyTorch, TensorFlow, and Hugging Face Transformers.

Qualifications

• Active US Security clearance
• 4+ years of experience in applied AI, ML engineering, or production AI systems
• Deep proficiency in PyTorch, TensorFlow, or Hugging Face Transformers
• Proven experience deploying AI models across cloud, edge, and mobile hardware environments
• Expertise in model compression and optimization (quantization, pruning, distillation)
• Experience building RAG pipelines and integrating vector databases (e.g., Quadrant, ChromaDB, FAISS, Milvus, Pinecone)
• Familiarity with multi-modal models and synthetic data generation methods
• Strong algorithmic and problem solving skills, especially in distributed or constrained compute environments

Responsibilities

• Design, develop, and deploy agentic workflows to orchestrate multi-step reasoning, tool use, and decision-making across production systems
• Productionize AI models from research prototypes into scalable, deployable systems
• Engineer adaptive ML systems using LoRA, PEFT, and on-device inference strategies
• Implement model optimization techniques such as quantization, pruning, distillation, and hardware specific acceleration
• Build and maintain Retrieval Augmented Generation (RAG) pipelines, including vector database integration
• Work with multi-modal AI systems across computer vision, audio, and natural language domains
• Optimize model execution for distributed and resource constrained environments, ensuring reliability under variable connectivity conditions

Skills

Algorithmic problem solving

Distributed compute environments

Multi-modal models

Tools

PyTorch

TensorFlow

Hugging Face Transformers

Job description

webAI is seeking a Senior Machine Learning Engineer to support Public Sector initiatives focused on building and optimizing production-ready AI systems for secure and distributed environments.

You will transform prototype models into scalable, reliable production workflows that operate across government cloud, edge devices, and restricted networks, using PyTorch, TensorFlow, and Hugging Face Transformers.