Senior AI Systems & Infra Engineer - Scalable LLMs

Bytoa; Columbia (MD); On-site; USD 235,000 - 255,000; Full time

Job summary

Bytoa is seeking a Senior Software Engineer to join a full-stack LLM integration and delivery team in Columbia, MD. You will architect and develop scalable AI-powered applications and the infrastructure that supports them, ensuring enterprise-scale reliability and rapid iteration.

The role emphasizes ownership, learning, and building robust systems that enhance user workflows. 12+ years of experience with strong cloud, containerization, and observability skills are expected.

Qualifications

• 12+ years of software engineering experience focused on scalable systems.
• Strong full-stack development experience for user-facing applications.
• Proficient in Python, Go, or Java.
• Extensive cloud platform experience (AWS, GCP, Azure).
• Expertise with Docker and Kubernetes.
• Familiarity with infrastructure-as-code tools.
• Experience with monitoring and observability tools.
• Knowledge of CI/CD practices.
• Excellent problem-solving and communication skills.
• Experience delivering AI-powered features with strong UX focus.

Responsibilities

• Lead design and development of scalable LLM-powered applications and services.
• Architect infrastructure to enable rapid iteration and deployment of AI features.
• Collaborate with product teams to translate user needs into solutions.
• Build platforms to ship AI features reliably.
• Develop automation tools to improve reliability and efficiency.
• Implement monitoring, logging, and alerting systems.
• Perform capacity planning and performance tuning for AI workloads.
• Lead incident response and post-mortems.
• Mentor junior engineers and contribute to team growth.
• Continuously improve systems and development processes.

Skills

12+ years of software engineering

Full-stack development

Python/Go/Java

Cloud platforms (AWS/GCP/Azure)

Docker/Kubernetes

Terraform/Ansible/Puppet

Prometheus/Grafana/ELK

CI/CD pipelines

Problem solving

Communication skills

User experience focus

Education

Bachelor's degree in a technical discipline

Tools

Docker

Kubernetes

Terraform

Ansible

Puppet

Prometheus

Grafana

ELK

CI/CD tooling

Job description

Bytoa is seeking a Senior Software Engineer to join a full-stack LLM integration and delivery team in Columbia, MD. You will architect and develop scalable AI-powered applications and the infrastructure that supports them, ensuring enterprise-scale reliability and rapid iteration.

The role emphasizes ownership, learning, and building robust systems that enhance user workflows. 12+ years of experience with strong cloud, containerization, and observability skills are expected.