Junior Software Engineer – Inference with Security Clearance

Neural Solutions; Columbia (MD); On-site; USD 138,000 - 163,000; Full time

Job summary

Neural Solutions in Columbia, MD is seeking a Software Engineer to support the AI infrastructure team. You will help build and maintain the foundation for advanced AI capabilities and ensure high-quality LLM access throughout the inference software stack.

Responsibilities include procuring and testing inference models, developing in-house services, collaborating with model vendors, and supporting surge inference needs while integrating LLM-powered tools across teams.

Qualifications

• Experience with Python or other modern programming languages.
• Familiarity with Argo CD or other CI/CD frameworks.
• Experience with Kubernetes/Helm.
• Familiarity with AWS or other cloud service providers.
• Ability to learn new technologies quickly.
• Strong communication skills and willingness to ask questions.

Responsibilities

• Procure, configure, and test new inference models, preparing them for release to our user base.
• Develop in-house services and techniques to ensure continuous high-quality inference service.
• Collaborate with model vendor teams to create reliable pipelines for closed-source model usage.
• Support surge efforts to meet short-term, high-priority inference needs from our customer.
• Engage with other teams to establish robust infrastructure and integrate LLM-powered tools.

Skills

Python

Kubernetes

AWS

CI/CD

Communication

Learning new technologies

Education

Bachelor’s degree in a technical field

Tools

Argo CD

Kubernetes

Helm

Docker

Grafana/Prometheus

Elastic

Job description

Software Engineer We are seeking a software engineer to support our AI infrastructure team at Neural Solutions. You will help build and maintain the foundation for advanced AI capabilities, ensuring high-quality language model (LLM) access throughout the inference software stack.

Responsibilities

• Procure, configure, and test new inference models, preparing them for release to our user base.
• Develop in-house services and techniques to ensure continuous high-quality inference service.
• Collaborate with model vendor teams to create reliable pipelines for closed-source model usage.
• Support surge efforts to meet short-term, high-priority inference needs from our customer.
• Engage with other teams to establish robust infrastructure and integrate LLM-powered tools.

Required Skills

• Experience with Python or other modern programming languages.
• Familiarity with Argo CD or other CI/CD frameworks.
• Experience with Kubernetes/Helm.
• Familiarity with AWS or other cloud service providers.
• Ability to learn new technologies quickly.
• Strong communication skills and willingness to ask questions.

Nice to Have

• Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
• Experience with other LLM hosting frameworks and practices.
• Experience supporting production software using Site Reliability Engineering (SRE) best practices.
• Familiarity with Elastic, Grafana/Prometheus, or other observability frameworks.
• Experience with Docker and containerization.
• Experience in traffic shaping and quality-of-service engineering.

Experience Required: 3 years with Bachelor’s degree in a technical field, or 7 years without degree

Location: Columbia, MD

Clearance: TS/SCI with Polygraph required

Salary Range: $138,000 - $163,000

Questions about this role or want to learn more about Neural Solutions?