AI Infrastructure Engineer – Inference & Cloud Ops

Dover Networks LLC

Maryland

On-site

USD 163,000 - 178,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

401(k) contributions

Job summary

Dover Networks LLC in Maryland is seeking a software engineer to join our AI infrastructure team and help build the foundation for customer AI capabilities. You will focus on ensuring access to high-quality LLMs across the inference stack, and collaborate with model vendors to create reliable pipelines for closed-source models.

The role requires Python or other modern languages, hands-on experience with Kubernetes, Helm, Argo CD, and AWS, and a strong willingness to learn and communicate.

Qualifications

  • Experience with Python or other modern programming languages.
  • Familiarity with CI/CD frameworks such as Argo CD.
  • Experience with Kubernetes/Helm and AWS.

Responsibilities

  • Procure, configure, and test new inference models, preparing them for release to our user base.
  • Develop in-house services and techniques to guarantee continual high-quality inference service for our customer.
  • Work with model vendor teams and representatives to create reliable pipelines for closed-source model usage.
  • Collaborate with teammates on surge efforts to support short‑term, high‑priority inference needs from our customer.
  • Engage with other teams to establish solid infrastructure for our services and integrate LLM‑powered tools for user needs.

Skills

Python
CI/CD
Communication skills
Quick learner
Team collaboration

Education

BS in a technical discipline
4 additional yrs in place of BS

Tools

Argo CD
Kubernetes
Helm
AWS

Job description

Dover Networks LLC in Maryland is seeking a software engineer to join our AI infrastructure team and help build the foundation for customer AI capabilities. You will focus on ensuring access to high-quality LLMs across the inference stack, and collaborate with model vendors to create reliable pipelines for closed-source models.

The role requires Python or other modern languages, hands-on experience with Kubernetes, Helm, Argo CD, and AWS, and a strong willingness to learn and communicate.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Infrastructure Engineer – LLM Inference & Cloud
AI Infrastructure Engineer – LLM Inference & Cloud

Neuralsolutions • Columbia (MD)

On-site
USD 138,000 - 163,000
AI Infra Platform Engineer (AWS & Kubernetes)
AI Infra Platform Engineer (AWS & Kubernetes)

Dover Networks LLC • Maryland

On-site
USD 163,000 - 178,000
AI Infra Engineer: Python, Kubernetes & AWS
AI Infra Engineer: Python, Kubernetes & AWS

Akina, Inc. • Maryland

On-site
USD 163,000 - 199,000
PTO 24 days
Federal holidays
401k plan
+1
Junior Software Engineer – Inference
Junior Software Engineer – Inference

Neuralsolutions • Columbia (MD)

On-site
USD 138,000 - 163,000
Junior Software Engineer – Inference with Security Clearance
Junior Software Engineer – Inference with Security Clearance

Neural Solutions • Columbia (MD)

On-site
USD 138,000 - 163,000
AI Infra Engineer: LLM Inference & Cloud Services
AI Infra Engineer: LLM Inference & Cloud Services

Neural Solutions • Columbia (MD)

On-site
USD 138,000 - 163,000
Senior AI Inference Data Plane Engineer
Senior AI Inference Data Plane Engineer

DigitalOcean • Boston (MA)

On-site
USD 139,000 - 174,000
Equity compensation
Conference reimbursement
Learning stipend
+2
Full Stack Software Engineer (AI Infrastructure)
Full Stack Software Engineer (AI Infrastructure)

The Josef Group • Columbia (MD)

On-site
USD 120,000 - 180,000
Senior AI Inference Data Plane Engineer
Senior AI Inference Data Plane Engineer

DigitalOcean • Seattle (WA)

Hybrid
USD 139,000 - 174,000
Equity compensation
Hybrid work model
Edge-to-Cloud LLM Inference Engineer
Edge-to-Cloud LLM Inference Engineer

Insider, Inc. • United States

On-site
USD 100,000 - 140,000