Senior AI Backend Engineer

ByteHire Limited.; New York, Boca Raton (NY, FL); Hybrid; USD 171,000 - 209,000; Full time

Benefits offered by this job

Bonus structure

Generous PTO

Health, dental, vision

Life and disability insurance

Professional development budget

Wellness initiatives

Job summary

ByteHire Limited. is seeking a Senior Backend AI Engineer in a remote-friendly, US-based role. You will design and operate backend systems powering AI-driven automation, focusing on scalability, reliability, and real-world impact.

You’ll build production-grade AI services and collaborate across product, data, and engineering teams. Ideal candidates have 5+ years building backend systems, experience with distributed architectures, asynchronous processing, and API design, with strong Python and

Qualifications

• 5+ years of backend production experience, focusing on scalable systems.
• Recent AI-powered or data-driven system exposure is required.
• Strong understanding of distributed, scalable, reliable architectures.
• Experience with asynchronous processing or event-driven systems.
• Proven ability to deliver production-ready systems end-to-end.
• Excellent cross-functional communication and collaboration.

Responsibilities

• Design and operate backend systems powering AI-driven workflows.
• Develop production AI services with performance and reliability in mind.
• Contribute to architecture focusing on scalability and modularity.
• Optimize backend for low latency and fault tolerance.
• Implement CI/CD, testing, monitoring and deployment best practices.
• Collaborate with product, data and engineering teams on end-to-end solutions.
• Mentor engineers and uphold technical standards.
• Take ownership of services in production including monitoring and incident response.

Skills

Python

Distributed systems

APIs REST/GRPC

Data pipelines

AI/ML systems

Asynchronous architectures

CI/CD

Observability

PostgreSQL

GCP

Code quality

Mentorship

Job description

Salary: up to $190,000 per annum + bonus

About The Client:

They are building an AI-powered care orchestration platform designed to unify fragmented healthcare systems and improve patient outcomes at scale. The platform combines agentic AI workflows with a robust backend infrastructure to automate complex clinical and operational processes.

The product is backed by significant early-stage funding and led by operators with experience scaling healthcare and technology platforms nationally. The focus is on delivering a production-grade, patient-facing AI system that operates reliably in high-stakes environments.

They are looking for staff-level engineers to help design, build, and scale the backend systems that power the platform.

They operate as a high-performing engineering team focused on delivering high-quality, impactful systems. Their values include:

Engineering Excellence: Strong ownership of technical quality, performance, and reliability

Impact-Driven Development: Building systems that solve real-world problems at scale

Continuous Growth: Learning, mentorship, and raising the bar across the team

Responsibilities

As a Senior Backend AI Engineer, you will play a key role in designing and operating the backend systems that power intelligent automation across the platform. You will work on production-grade AI services, focusing on scalability, reliability, and real-world impact.

Design and build backend systems supporting AI-driven workflows and automation

Develop and maintain production AI services with strict performance and reliability requirements

Contribute to system architecture with a focus on scalability, modularity, and integration

Optimise backend performance, ensuring low latency and fault tolerance

Implement best practices across CI/CD, testing, monitoring, and deployment

Collaborate with product, data, and engineering teams to deliver end-to-end solutions

Support and mentor engineers, contributing to technical standards and best practices

Take ownership of services in production, including monitoring and incident response

Skills & Experience

Strong experience building production backend systems using Python

Proven experience designing and operating distributed systems at scale

Experience with asynchronous or event-driven architectures

Strong knowledge of API design (REST and/or gRPC) and service-based architectures

Experience building data pipelines and workflow orchestration systems

Hands-on experience with AI/ML systems, including LLM integrations

Understanding of trade-offs in AI systems (latency, cost, performance)

Experience with observability, monitoring, and performance optimisation

Strong database experience (PostgreSQL, data modelling, performance tuning)

Experience working with cloud platforms (GCP preferred) and modern infrastructure

Familiarity with CI/CD pipelines and production operations

Experience integrating with external APIs and complex systems

Ability to contribute to system design, architecture, and technical direction

Minimum Qualifications

5+ years of experience building and operating backend systems in production

Recent experience working with AI-powered or data-driven systems

Strong understanding of distributed systems, scalability, and reliability

Experience working with asynchronous processing or event-driven systems

Proven ability to deliver production-ready systems end-to-end

Strong communication skills and ability to work cross-functionally

Location

This role can be remote or onsite, based in New York City or Boca Raton, in a fast-paced, collaborative environment where ideas move quickly from concept to production.

We offer a comprehensive and competitive benefits package designed to support your well-being and professional growth:

• Competitive salary with bonus structure
• Generous paid time off
• Comprehensive health, dental, and vision coverage
• Life and disability insurance
• Dedicated professional development budget
• Wellness initiatives supporting mental and physical health