Edge ML Engineer: SLMs, MLOps & On-Device Deployments

Egnyte

United States

Remote

USD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

United States Digital Space LLC is seeking a skilled ML Engineer to fine-tune and train large language models (SLMs) using Hugging Face, TRL, and adapter methods. You will optimize models for inference, deploy to edge devices and local servers, and build end-to-end MLOps pipelines from data ingestion to deployment.

You will monitor model accuracy, latency, and hardware utilization in production, evaluate quality with benchmarking suites, and collaborate across teams to ensure efficient, reliable

Qualifications

  • Fine-tune SLMs using Hugging Face and adapters.
  • Apply quantization, pruning, and knowledge distillation for lightweight models.
  • Deploy models to edge devices, mobile, and local servers with latency targets.
  • Build end-to-end MLOps pipelines from data ingestion to deployment.
  • Monitor model accuracy, latency, and CPU/GPU usage in production.

Responsibilities

  • Fine-tune and train SLMs using Hugging Face, TRL, and adapter methods.
  • Optimize models for inference via quantization, pruning, and knowledge distillation.
  • Deploy models to edge devices, mobile, and local servers with strict latency targets.
  • Build end-to-endMLOpspipelines — from data ingestion to deployment.
  • Monitor model accuracy, latency, and hardware utilization in production.
  • Evaluate model quality using benchmarking frameworks and custom evaluation suites.

Skills

SLM fine-tuning
Model optimization
Edge deployment
MLOps pipelines
Performance monitoring

Tools

Hugging Face
TRL
LoRA/QLoRA/PEFT

Job description

United States Digital Space LLC is seeking a skilled ML Engineer to fine-tune and train large language models (SLMs) using Hugging Face, TRL, and adapter methods. You will optimize models for inference, deploy to edge devices and local servers, and build end-to-end MLOps pipelines from data ingestion to deployment.

You will monitor model accuracy, latency, and hardware utilization in production, evaluate quality with benchmarking suites, and collaborate across teams to ensure efficient, reliable

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Edge ML Engineer: Port & Optimize Models to Edge Hardware
Edge ML Engineer: Port & Optimize Models to Edge Hardware

Devconnectplatform • United States

Remote
USD 155,000 - 245,000
Edge ML Engineer: Port Models to Non-NVIDIA & Devices
Edge ML Engineer: Port Models to Non-NVIDIA & Devices

Deepgram • San Francisco (CA)

On-site
USD 150,000 - 230,000
Edge ML Engineer - Deploy ML on Non-NVIDIA Platforms
Edge ML Engineer - Deploy ML on Non-NVIDIA Platforms

FDE Times • United States

Remote
USD 140,000 - 210,000
ML Engineer: Edge Deployment & Fine-Tuning Expert
ML Engineer: Edge Deployment & Fine-Tuning Expert

Quantiphi • Atlanta (GA)

On-site
USD 140,000 - 190,000
Senior ML Scientist – Edge AI & LLMs (Remote)
Senior ML Scientist – Edge AI & LLMs (Remote)

Attis • United States

Remote
USD 250,000 - 400,000
Equity
Remote work (USA)
Production ML Engineer — Edge & Spaceflight Systems
Production ML Engineer — Edge & Spaceflight Systems

Constellation Space • Seattle (WA)

On-site
USD 120,000 - 190,000
Edge ML Engineer for Sign Language AI
Edge ML Engineer for Sign Language AI

Sign-Speak Inc • City of Rochester (NY)

On-site
USD 120,000 - 160,000
Health insurance
Dental insurance
Vision insurance
+3
Senior MLOps Engineer — Edge Inference Platform
Senior MLOps Engineer — Edge Inference Platform

Hudl, Inc. • United States

Remote
USD 140,000 - 180,000
Senior ML Engineer - Remote, Production ML & MLOps
Senior ML Engineer - Remote, Production ML & MLOps

Tech Holding • United States

Remote
USD 140,000 - 200,000
Remote Work
Corp to Corp (C2C) or contract
Senior ML Platform Engineer: Scalable Cloud & MLOps
Senior ML Platform Engineer: Scalable Cloud & MLOps

latitude • United States

Remote
USD 179,000 - 269,000
Medical, dental, and vision coverage
Employer-matched retirement savings
Paid parental and medical leave
+4