GenAI Backend Engineer — Scale Production AI Apps

BayOne Solutions; Waltham (MA); On-site; USD 130,000 - 170,000; Full time

Job summary

BayOne Solutions in Waltham, MA seeks an experienced AI Engineer with a strong backend foundation and Generative AI expertise to build, deploy, and scale production-grade AI-powered applications. You will integrate LLMs into backend systems, design scalable APIs, and ensure reliability and performance throughout the lifecycle.

The role combines software engineering excellence with hands-on ML/LLM experience, focusing on real-time infrastructure, observability, and cross-functional collaboration

Qualifications

• 4+ years backend software engineering with Python/Go/Java.
• 4+ years ML/LLM integration in production.
• Experience deploying or maintaining backend services and APIs.
• Strong knowledge of distributed systems and scalable architectures.
• Cloud infrastructure, observability, logging, and troubleshooting.

Responsibilities

• Design, develop, and maintain scalable backend services and APIs.
• Integrate LLMs and ML models into production systems.
• Own AI features from design to deployment and optimization.
• Develop testing and evaluation frameworks for AI quality.
• Monitor system health, latency, and model performance.
• Troubleshoot issues across model-serving and backend layers.
• Collaborate with product managers and ML engineers.
• Drive continuous improvement of AI-powered products.

Skills

Backend engineering

ML/LLM integration

Distributed systems

Cloud infrastructure

Observability & monitoring

Problem solving

Independent work

Communication

Tools

APIs & microservices

Job description

BayOne Solutions in Waltham, MA seeks an experienced AI Engineer with a strong backend foundation and Generative AI expertise to build, deploy, and scale production-grade AI-powered applications. You will integrate LLMs into backend systems, design scalable APIs, and ensure reliability and performance throughout the lifecycle.

The role combines software engineering excellence with hands-on ML/LLM experience, focusing on real-time infrastructure, observability, and cross-functional collaboration