LLM Deployment Engineer — TS/SCI Clearance

Bitwise; Laurel (MD); Presencial; USD 198 000 - 233 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Top salaries

PTO 3–5 weeks

11 federal holidays paid

Snow days paid

401(k) match 24%

Employer-paid health benefits

Education assistance

Spot bonuses

Resumo da oferta

Bitwise is building the next generation of AI infrastructure and seeks a software engineer to support the AI infrastructure team. You will help build and maintain the foundation for customer AI capabilities while enabling a broader ecosystem of AI-enabled applications.

You will ensure access to high-quality LLMs across the inference stack. As part of the role, you will collaborate with model vendors, implement reliable pipelines for closed‑source models, and contribute to infrastructure enabling

Qualificações

• 3 years of software engineering experience, or a BS in a technical discipline plus 4 additional years of related experience.
• Experience with Python or other modern programming languages.
• Familiarity with Kubernetes, Docker, and CI/CD tooling.
• Experience with Argo CD and other CI/CD frameworks.
• Experience with AWS or other cloud service providers.
• Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
• Experience with other LLM hosting frameworks and practices.
• Experience supporting production software using Site Reliability Engineering (SRE) best practices.
• Experience with Elastic, Grafana/Prometheus, or other observability frameworks and practices.
• Experience with Docker and containerization.
• Experience in traffic shaping and quality-of-service engineering.

Responsabilidades

• Procure, configure, and test new inference models, preparing them for release to our user base.
• Develop in-house services and techniques to guarantee continual high-quality inference service for our customer.
• Work with model vendor teams and representatives to create reliable pipelines for closed‑source model usage.
• Collaborate with teammates on surge efforts to support short‑term, high-priority inference needs from our customer.
• Engage with other teams in our organization to establish solid infrastructure for our services and integrate LLM‑powered tools for user needs.

Conhecimentos

Python

Argo CD

Kubernetes

Docker

AWS

SRE

LLM hosting

Observability

Ferramentas

Grafana/Prometheus

Elasticsearch

Descrição da oferta de emprego

Bitwise is building the next generation of AI infrastructure and seeks a software engineer to support the AI infrastructure team. You will help build and maintain the foundation for customer AI capabilities while enabling a broader ecosystem of AI-enabled applications.

You will ensure access to high-quality LLMs across the inference stack. As part of the role, you will collaborate with model vendors, implement reliable pipelines for closed‑source models, and contribute to infrastructure enabling