Junior AI Infrastructure Engineer - Build Scalable Inference

Neural Solutions; Columbia (MD); On-site; USD 138,000 - 163,000; Full time

Job summary

Neural Solutions in Columbia, MD is seeking a Software Engineer to support our AI infrastructure, building and maintaining the foundation for customer AI capabilities and an ecosystem of AI-enabled applications.

You will collaborate with model vendors and internal teams to deliver reliable inference pipelines, develop in-house services for high-quality inference, and stay current with new technologies while supporting surge workloads.

Qualifications

• 3 years with Bachelor's degree in technical field, or 7 additional years without degree.
• Location: Columbia, MD; TS/SCI with Polygraph clearance.
• Salary range provided: $138,000 - $163,000 per year.
• Proficiency in Python and modern programming languages.
• Experience with CI/CD and containerization is beneficial.

Responsibilities

• Procure, configure, and test new inference models for release to users.
• Develop in-house services to ensure high-quality inference for customers.
• Collaborate with model vendor teams to create reliable pipelines for closed-source models.
• Support surge efforts for short-term high-priority inferences.
• Integrate LLM-powered tools and collaborate with other teams to improve infrastructure.

Skills

Python

CI/CD

Kubernetes

Cloud AWS

Communication

Fast learner

Education

Bachelor's degree in a technical field

Tools

Argo CD

Kubernetes

Helm

Docker

Prometheus/Grafana

Job description

Neural Solutions in Columbia, MD is seeking a Software Engineer to support our AI infrastructure, building and maintaining the foundation for customer AI capabilities and an ecosystem of AI-enabled applications.

You will collaborate with model vendors and internal teams to deliver reliable inference pipelines, develop in-house services for high-quality inference, and stay current with new technologies while supporting surge workloads.