Senior Software Engineer

Neural Solutions; Columbia (MD); On-site; USD 204,000 - 247,000; Full time

Job summary

Neural Solutions in Columbia, MD is seeking a platform engineer to deploy and manage containerized AI/ML services on on-premises infrastructure. You will implement observability with Prometheus and Grafana, and build CI/CD pipelines to automate deployments.

You will design resilient infrastructure patterns, ensuring high availability for mission-critical capabilities while collaborating with stakeholders to translate requirements into platform solutions.

Qualifications

• 12+ years of experience in a technical discipline with a Bachelor's degree, or 16+ years without a degree.
• Experience deploying and managing services in on-premises infrastructure.
• Proficient with Docker/Kubernetes in production.
• Experience with Prometheus/Grafana and related observability tooling.
• Experience with CI/CD pipelines and GitOps.
• Familiarity with Atlassian tools (Jira, Confluence).

Responsibilities

• Deploy and manage containerized AI/ML services using Kubernetes in on-premises environments.
• Implement observability and monitoring solutions using Prometheus, Grafana, and related tooling to track system health and usage metrics.
• Build and maintain CI/CD pipelines and infrastructure-as-code to enable reliable, automated deployment of platform services.
• Design and implement resilient infrastructure patterns to ensure high availability and performance of mission-critical capabilities.
• Collaborate with stakeholders to translate operational and reliability requirements into platform engineering solutions.

Skills

Docker & Kubernetes

Observability & monitoring

CI/CD pipelines

GitOps workflows

Jira & Confluence

Education

Bachelor's degree in a technical discipline

16+ years of experience without degree

Tools

Docker

Kubernetes

Prometheus

Grafana

Jira

Confluence

Job description

You will be part of a high-impact mission delivering AI/ML capabilities to end users, focusing on building reliable and scalable infrastructure and deployment pipelines rather than application development.

Responsibilities:

• Deploy and manage containerized AI/ML services using Kubernetes in on-premises environments.
• Implement observability and monitoring solutions using Prometheus, Grafana, and related tooling to track system health and usage metrics.
• Build and maintain CI/CD pipelines and infrastructure-as-code to enable reliable, automated deployment of platform services.
• Design and implement resilient infrastructure patterns to ensure high availability and performance of mission-critical capabilities.
• Collaborate with stakeholders to translate operational and reliability requirements into platform engineering solutions.

Required Skills:

• Experience deploying and managing services in on-premises infrastructure environments.
• Service containerization and orchestration with Docker/Kubernetes in production environments.
• Experience with observability and monitoring tools such as Prometheus, Grafana, or equivalent platforms.
• Knowledge of CI/CD pipelines, GitOps workflows.
• Atlassian Tools (Jira, Confluence).

Nice to Have:

• Experience with model serving technologies (vLLM, TorchServe, TensorFlow Serving, Triton Inference Server).
• Knowledge of AI infrastructure tools and frameworks (LiteLLM, Bifrost, Ray, Ollama).

Experience Required: 12 years with Bachelor's degree in a technical discipline or 16 years without degree

Location: Columbia, MD

Clearance: TS/SCI with Polygraph required

Salary Range: $204,000 - $247,000

Questions about this role or want to learn more about Neural Solutions?