LLM Inference Infrastructure Engineer

Dover Networks LLC; Capitol Heights (MD); On-site; USD 163,000 - 178,000; Full time

Job summary

Dover Networks LLC in Capitol Heights, MD, seeks a software engineer to support our AI infrastructure team, ensuring access to high-quality LLMs across the inference stack. You will procure, configure, and test new inference models and develop in-house services to guarantee reliable inference for our customers.

You will collaborate with model vendors to create robust pipelines and support surge needs while integrating LLM-powered tools for user needs.

Qualifications

• 3 years of experience in software engineering or 4 years of equivalent experience.
• Experience with Python and/or other modern programming languages.
• Familiarity with Argo CD and CI/CD frameworks.
• Experience with Kubernetes/Helm and AWS or other cloud providers.

Responsibilities

• Procure, configure, and test new inference models for release to users.
• Develop in-house services to guarantee high-quality inference services.
• Collaborate with model vendor teams to create reliable pipelines for closed-source models.
• Support surge efforts for short-term high-priority inference needs.
• Engage with teams to integrate LLM-powered tools for user needs.

Skills

Python

CI/CD

Cloud computing

Communication

Education

BS in a technical discipline

Tools

Argo CD

Kubernetes

Helm

AWS

Docker

Grafana/Prometheus

Job description

Dover Networks LLC in Capitol Heights, MD, seeks a software engineer to support our AI infrastructure team, ensuring access to high-quality LLMs across the inference stack. You will procure, configure, and test new inference models and develop in-house services to guarantee reliable inference for our customers.

You will collaborate with model vendors to create robust pipelines and support surge needs while integrating LLM-powered tools for user needs.