Junior Software Engineer – Inference with Security Clearance

Neural Solutions; Columbia (MD); On-site; USD 138,000 - 163,000; Full time

Job summary

Neural Solutions in Columbia, MD is seeking a Software Engineer to support an AI infrastructure team. You will help build and maintain the foundation for customer AI capabilities and support a broad ecosystem of AI-enabled applications.

You will procure models, develop in-house services for reliable inference, collaborate with model vendors, and assist with surge work while integrating LLM-powered tools across the organization.

Qualifications

• 3 years of software engineering with a technical degree, or 7 years without a degree.
• Experience with Python and modern programming languages.
• Familiarity with Argo CD, Kubernetes and Helm.
• Experience with AWS or other cloud providers.
• Strong written and verbal communication abilities.
• Willingness to learn new technologies quickly.

Responsibilities

• Procure, configure, and test new inference models for release.
• Develop in-house services to ensure high-quality inference.
• Collaborate with model vendors to create reliable pipelines for closed-source models.
• Support surge efforts for short-term inference needs.
• Work with teams to integrate LLM-powered tools and build solid infra.

Skills

Python programming

Communication skills

Learning agility

Problem solving

Education

Bachelor's degree in technical field

Tools

Argo CD

Kubernetes

Helm

AWS

Docker

CI/CD tooling

Grafana/Prometheus

vLLM / LiteLLM frameworks

Job description

Software Engineer - AI Infrastructure We’re seeking a software engineer to support our AI infrastructure team at Columbia, MD. In this role, you’ll help build and maintain the foundation for customer AI capabilities while supporting a broader ecosystem of AI-enabled applications.

• Procure, configure, and test new inference models, preparing them for release to our user base.
• Develop in-house services and techniques to guarantee continual high-quality inference service for our customer.
• Work with model vendor teams and representatives to create reliable pipelines for closed-source model usage.
• Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer.
• Engage with other teams in our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs. Required Skills:
• Experience with Python and/or other modern programming languages.
• Familiarity with Argo CD and/or other CI/CD frameworks.
• Experience with Kubernetes/Helm.
• Familiarity with AWS or other cloud service providers.
• Ability to learn new technologies quickly.
• Strong communication skills and willingness to ask questions. Nice to Have:
• Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
• Experience with other LLM hosting frameworks and practices.
• Experience supporting production software using Site Reliability Engineering (SRE) best practices.
• Experience with Elastic, Grafana/Prometheus, or other observability frameworks and practices.
• Experience with Docker and containerization.
• Experience in traffic shaping and quality-of-service engineering. Experience Required: 3 years with Bachelor's degree in technical field, or 7 additional years without degree Location: Columbia, MD Clearance: TS/SCI with Polygraph required Salary Range: $138,000 - $163,000