AI Infrastructure Engineer – LLM Inference & Cloud

Neuralsolutions; Columbia (MD); On-site; USD 138,000 - 163,000; Full time

Job summary

Neuralsolutions in Columbia, MD seeks a Software Engineer to support AI infrastructure, ensuring access to high-quality LLMs across the inference stack. You’ll procure, configure, and test models, develop in-house services, and collaborate with model vendors to maintain reliable pipelines for customer-facing AI capabilities.

The role emphasizes building scalable infrastructure, working with AWS and containerized environments, and contributing to production-grade AI hosting practices.

Qualifications

• Proficiency in Python or similar languages.
• Experience with Argo CD and CI/CD workflows.
• Hands-on with Kubernetes (Kubernetes/Helm).
• Cloud experience with AWS or similar.
• Ability to learn new technologies quickly.
• Strong communication skills and teamwork.

Responsibilities

• Procure, configure, and test new inference models for release to users.
• Develop in-house services to guarantee high-quality inference services.
• Collaborate with model vendors to create reliable closed-source pipelines.
• Support surge efforts for short-term, high-priority inference needs.
• Work with other teams to build infrastructure and integrate LLM tools.

Skills

Python

Argo CD

Kubernetes

Helm

AWS

Learning agility

Communication

Education

Bachelor's degree in a technical discipline

7 years of experience without degree

Tools

Docker

Job description

Neuralsolutions in Columbia, MD seeks a Software Engineer to support AI infrastructure, ensuring access to high-quality LLMs across the inference stack. You’ll procure, configure, and test models, develop in-house services, and collaborate with model vendors to maintain reliable pipelines for customer-facing AI capabilities.

The role emphasizes building scalable infrastructure, working with AWS and containerized environments, and contributing to production-grade AI hosting practices.