Senior Software Engineer – Inference

Neuralsolutions; Columbia, Northern (MD, KY); Hybrid; USD 204,000 - 247,000; Full time

Job summary

Neuralsolutions in Columbia, MD seeks a Senior Software Engineer to advance AI infrastructure and ensure access to top-quality LLMs across the inference stack.

You will lead model evaluation and deployment, mentor engineers, and build in-house services to sustain high-quality inference for customers, collaborating across teams to integrate LLM tools.

Qualifications

• 12 years of experience with a Bachelor’s degree in a technical discipline, or 16 years without a degree.
• Proficiency in Python or other modern programming languages.
• Experience with CI/CD frameworks and container orchestration (Argo CD, Kubernetes/Helm).
• Strong communication, leadership, and stakeholder management skills.

Responsibilities

• Lead evaluation, configuration, and deployment of inference models for users.
• Mentor engineers and grow development best practices and standards.
• Develop in-house services to guarantee high-quality inference for customers.
• Collaborate with teams to build infrastructure and integrate LLM tools.
• Support surge efforts for short-term, high-priority inference needs.

Skills

Python

Leadership

Mentoring

Communication

Education

Bachelor's degree in a technical discipline

Tools

Argo CD

Kubernetes

Helm

AWS

Job description

Senior Software Engineer

Join us in building the next generation of AI infrastructure that will power innovation across our organization. We’re seeking a senior software engineer to support our AI infrastructure team. Your focus will be ensuring access to the highest available quality LLMs to users throughout the inference software stack.

Responsibilities:

• Lead the evaluation, configuration, and deployment of inference models for our users.
• Mentor engineers and grow development best practices and standards for the team.
• Develop in-house services and techniques to guarantee continual high-quality inference service for our customer.
• Engage with other teams within our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs.
• Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer.

Required Skills:

• Experience with Python and/or other modern programming languages.
• Experience with Argo CD and/or other CI/CD frameworks.
• Experience with Kubernetes/Helm.
• Experience with AWS or other cloud service providers.
• Strong communication skills and ability to mentor other engineers.
• Excellent leadership and stakeholder management skills.

Nice to Have:

• Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
• Experience supporting production software using Site Reliability Engineering (SRE) best practices.
• Knowledge of and interest in hosting AI capabilities.

Experience Required: 12 years with Bachelor's degree in a technical discipline or 16 years without degree

Location: Columbia, MD

Clearance: TS/SCI with Polygraph required

Salary Range: $204,000 - $247,000