Senior AI Backend Engineer

ByteHire; Northern, New York (KY, NY); Hybrid; USD 171,000 - 209,000; Full time

Benefits offered by this job

Competitive salary with bonus

Generous paid time off

Health, dental, and vision coverage

Life and disability insurance

Professional development budget

Wellness initiatives

Job summary

ByteHire is seeking a Senior Backend AI Engineer to design and operate backend systems powering intelligent automation across the platform. You will work on production-grade AI services with a focus on scalability, reliability, and real-world impact.

You will design and build backend systems for AI-driven workflows, optimize performance, and contribute to architecture while collaborating with cross-functional teams. This role supports remote or onsite work in a fast-paced environment.

Qualifications

• 5+ years of experience building and operating backend systems in production.
• Experience with AI-powered or data-driven systems.
• Strong understanding of distributed systems, scalability, and reliability.
• Experience working with asynchronous processing or event-driven systems.
• Proven ability to deliver production-ready systems end-to-end.
• Strong communication skills and ability to work cross-functionally.

Responsibilities

• Design and operate the backend systems that power intelligent automation across the platform.
• Design and build backend systems supporting AI-driven workflows and automation.
• Develop and maintain production AI services with strict performance and reliability requirements.
• Contribute to system architecture with a focus on scalability, modularity, and integration.
• Optimise backend performance, ensuring low latency and fault tolerance.
• Implement best practices across CI/CD, testing, monitoring, and deployment.
• Collaborate with product, data, and engineering teams to deliver end-to-end solutions.
• Support and mentor engineers, contributing to technical standards and best practices.
• Take ownership of services in production, including monitoring and incident response.

Skills

Python

Distributed systems

API design (REST/gRPC)

Asynchronous/event-driven

AI/ML systems

Observability/monitoring

PostgreSQL

Cloud platforms (GCP)

CI/CD

External APIs integration

Tools

GCP

CI/CD pipelines

REST/gRPC tooling

Job description

Salary: up to $190,000 per annum + bonus

About The Client

They are building an AI-powered care orchestration platform designed to unify fragmented healthcare systems and improve patient outcomes at scale. The platform combines agentic AI workflows with a robust backend infrastructure to automate complex clinical and operational processes.

The product is backed by significant early-stage funding and led by operators with experience scaling healthcare and technology platforms nationally. The focus is on delivering a production-grade, patient-facing AI system that operates reliably in high-stakes environments.

They are looking for staff-level engineers to help design, build, and scale the backend systems that power the platform.

They operate as a high-performing engineering team focused on delivering high-quality, impactful systems. Their values include:

Engineering Excellence: Strong ownership of technical quality, performance, and reliability

Impact-Driven Development: Building systems that solve real-world problems at scale

Continuous Growth: Learning, mentorship, and raising the bar across the team

Responsibilities

As a Senior Backend AI Engineer, you will play a key role in designing and operating the backend systems that power intelligent automation across the platform. You will work on production-grade AI services, focusing on scalability, reliability, and real-world impact.

Design and build backend systems supporting AI-driven workflows and automation

Develop and maintain production AI services with strict performance and reliability requirements

Contribute to system architecture with a focus on scalability, modularity, and integration

Optimise backend performance, ensuring low latency and fault tolerance

Implement best practices across CI/CD, testing, monitoring, and deployment

Collaborate with product, data, and engineering teams to deliver end-to-end solutions

Support and mentor engineers, contributing to technical standards and best practices

Take ownership of services in production, including monitoring and incident response

Skills & Experience

Strong experience building production backend systems using Python

Proven experience designing and operating distributed systems at scale

Experience with asynchronous or event-driven architectures

Strong knowledge of API design (REST and/or gRPC) and service-based architectures

Experience building data pipelines and workflow orchestration systems

Hands-on experience with AI/ML systems, including LLM integrations

Understanding of trade-offs in AI systems (latency, cost, performance)

Experience with observability, monitoring, and performance optimisation

Strong database experience (PostgreSQL, data modelling, performance tuning)

Experience working with cloud platforms (GCP preferred) and modern infrastructure

Familiarity with CI/CD pipelines and production operations

Experience integrating with external APIs and complex systems

Ability to contribute to system design, architecture, and technical direction

Minimum Qualifications

5+ years of experience building and operating backend systems in production

Recent experience working with AI-powered or data-driven systems

Strong understanding of distributed systems, scalability, and reliability

Experience working with asynchronous processing or event-driven systems

Proven ability to deliver production-ready systems end-to-end

Strong communication skills and ability to work cross-functionally

Location

This role can be remote or onsite, based in New York City or Boca Raton, in a fast-paced, collaborative environment where ideas move quickly from concept to production.

We offer a comprehensive and competitive benefits package designed to support your well-being and professional growth:

• Competitive salary with bonus structure
• Generous paid time off
• Comprehensive health, dental, and vision coverage
• Life and disability insurance
• Dedicated professional development budget
• Wellness initiatives supporting mental and physical health