Artificial Intelligence Engineer

BayOne Solutions; Waltham (MA); On-site; USD 130,000 - 170,000; Full time

Job summary

BayOne Solutions in Waltham, MA seeks an experienced AI Engineer with a strong backend foundation and Generative AI expertise to build, deploy, and scale production-grade AI-powered applications. You will integrate LLMs into backend systems, design scalable APIs, and ensure reliability and performance throughout the lifecycle.

The role combines software engineering excellence with hands-on ML/LLM experience, focusing on real-time infrastructure, observability, and cross-functional collaboration

Qualifications

• 4+ years backend software engineering with Python/Go/Java.
• 4+ years ML/LLM integration in production.
• Experience deploying or maintaining backend services and APIs.
• Strong knowledge of distributed systems and scalable architectures.
• Cloud infrastructure, observability, logging, and troubleshooting.

Responsibilities

• Design, develop, and maintain scalable backend services and APIs.
• Integrate LLMs and ML models into production systems.
• Own AI features from design to deployment and optimization.
• Develop testing and evaluation frameworks for AI quality.
• Monitor system health, latency, and model performance.
• Troubleshoot issues across model-serving and backend layers.
• Collaborate with product managers and ML engineers.
• Drive continuous improvement of AI-powered products.

Skills

Backend engineering

ML/LLM integration

Distributed systems

Cloud infrastructure

Observability & monitoring

Problem solving

Independent work

Communication

Tools

APIs & microservices

Job description

We are looking for an experienced AI Engineer with a strong foundation in backend development and Generative AI to build, deploy, and scale intelligent, production-ready applications. This role involves developing AI-powered services, integrating Large Language Models (LLMs) into backend systems, establishing evaluation and quality frameworks, and ensuring the reliability and performance of AI solutions in production environments.

The ideal candidate combines solid software engineering principles with hands‑on experience delivering ML/LLM-powered capabilities, building scalable APIs and microservices, and monitoring AI system performance throughout the development lifecycle.

Key Responsibilities

• Backend Engineering: Design, develop, and maintain scalable backend services, APIs, and microservices that power AI-driven applications.
• GenAI Integration: Integrate LLMs and machine learning models into production systems, ensuring efficient inference, reliability, and scalability.
• End-to-End AI Development: Take ownership of AI features from technical design and implementation through deployment, evaluation, and ongoing optimization.
• LLM Harness & Quality Frameworks: Develop and improve the supporting infrastructure, testing mechanisms, and evaluation frameworks required to validate AI system behavior and output quality.
• Production Monitoring: Implement monitoring, observability, and performance evaluation mechanisms to track system health, model quality, latency, and reliability.
• System Reliability: Identify, troubleshoot, and resolve complex issues across model-serving layers, backend services, APIs, and supporting infrastructure.
• Real-Time Infrastructure: Build and optimize real-time serving systems and distributed services that support responsive, production-grade AI applications.
• Technical Design: Participate in architecture discussions, system design reviews, and code reviews to maintain high engineering standards.
• Cross-Functional Collaboration: Work closely with product managers, ML engineers, and other stakeholders to translate business requirements into practical technical solutions.
• Continuous Improvement: Identify opportunities to improve system performance, engineering efficiency, scalability, and the overall quality of AI-powered products.

Required Qualifications

• 4+ years of professional experience in backend software engineering using Python, Go, Java, or similar programming languages.
• 4+ years of hands‑on experience working with ML/LLM integration in production systems.
• Demonstrated experience developing, deploying, or maintaining backend services, APIs, and microservices.
• Strong understanding of distributed systems, high-performance applications, and scalable software architecture.
• Experience integrating AI/ML models into production environments and supporting model inference or serving workflows.
• Familiarity with model evaluation methodologies, performance metrics, and techniques for assessing AI system quality.
• Knowledge of cloud infrastructure, production observability, logging, monitoring, and troubleshooting practices.
• Strong problem-solving skills, with the ability to investigate complex technical issues across interconnected systems.
• Ability to work independently in ambiguous environments and adapt to evolving technical requirements.
• Excellent communication skills and the ability to collaborate effectively across engineering and product teams.

BayOne is an Equal Opportunity Employer and does not discriminate against any employee or applicant for employment because of race, color, sex, age, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any federal, state, or local protected class.

This job posting represents the general duties and requirements necessary to perform this position and is not an exhaustive statement of all responsibilities, duties, and skills required. Management reserves the right to revise or alter this job description.