AI Infra Engineer: LLM Inference & Cloud Services

Neural Solutions; Columbia (MD); On-site; USD 138,000 - 163,000; Full time

Job summary

Neural Solutions in Columbia, MD is seeking a software engineer to support our AI infrastructure team. You will build and maintain the foundation for customer AI capabilities and ensure access to the highest quality LLMs across the inference stack.

Responsibilities include procuring models, developing services for high-quality inference, collaborating with model vendors, and supporting surge and reliability needs. TS/SCI with polygraph and salary 138k-163k are stated.

Qualifications

• Experience with Python or other modern programming languages.
• Familiarity with CI/CD frameworks such as Argo CD.
• Experience with Kubernetes/Helm.
• Familiarity with AWS or other cloud service providers.
• Ability to learn new technologies quickly.
• Strong communication skills and willingness to ask questions.

Responsibilities

• Procure, configure, and test new inference models, preparing them for release to our user base.
• Develop in-house services and techniques to guarantee continual high-quality inference service for our customer.
• Work with model vendor teams and representatives to create reliable pipelines for closed-source model usage.
• Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer.
• Engage with other teams to establish solid infrastructure for our services and integrate LLM-powered tools for user needs.

Skills

Python

CI/CD

Kubernetes

AWS

Learning agility

Communication

Education

Bachelor’s degree in a technical discipline

Tools

Docker

Helm

Argo CD

Prometheus

Grafana

SRE practices

Job description

Neural Solutions in Columbia, MD is seeking a software engineer to support our AI infrastructure team. You will build and maintain the foundation for customer AI capabilities and ensure access to the highest quality LLMs across the inference stack.

Responsibilities include procuring models, developing services for high-quality inference, collaborating with model vendors, and supporting surge and reliability needs. TS/SCI with polygraph and salary 138k-163k are stated.