Back End Developer

NTIATIVE IT Recruitment; Town of Poland (NY); On-site; USD 120,000 - 190,000; Full time

Benefits offered by this job

Autonomy from day one

Work with AI technologies

High ownership and impact

Collaborative engineering team

Job summary

NTIATIVE IT Recruitment is seeking a Backend Engineer – AI to design, build, and operate backend systems powering AI-driven product features. You will develop inference pipelines and orchestration layers for Large Language Models, and build scalable APIs that connect AI capabilities with web and mobile applications.

You will improve performance, latency, caching, and streaming, while ensuring production reliability with monitoring, logging, and incident response.

Qualifications

• Design, build, and operate backend systems powering AI-driven product features.
• Develop inference pipelines and orchestration layers for Large Language Models.
• Build scalable APIs that connect AI capabilities with web and mobile applications.
• Improve system performance by optimising latency, throughput, caching, batching, and streaming.
• Ensure production reliability through monitoring, logging, alerting, and incident response.

Responsibilities

• Design, build, and operate backend systems powering AI-driven product features.
• Develop inference pipelines and orchestration layers for Large Language Models.
• Build scalable APIs that connect AI capabilities with web and mobile applications.
• Improve system performance by optimising latency, throughput, caching, batching, and streaming.
• Ensure production reliability through monitoring, logging, alerting, and incident response.
• Collaborate with Machine Learning, Product, and Frontend teams on end-to-end solutions.
• Drive platform scalability, observability, and operational excellence.
• Promote best practices across AI infrastructure and backend services.

Skills

Backend Engineering

Distributed systems

API design

Performance optimization

Observability

Cross-functional collaboration

Tools

Kubernetes

Docker

SQL

NoSQL

Python

Node.js

PyTorch

Job description

Imagine building the infrastructure behind an AI product designed to help billions of people get things done faster and smarter.

We're looking for a Backend Engineer – AI to develop the systems that power every AI interaction behind the scenes. You'll build the orchestration and inference layer that transforms cutting-edge AI models into reliable, production-ready services used by real users every day.

If you're passionate about distributed systems, high-performance backend engineering, and the future of AI...

Feel invited! This is your chance to help shape the next generation of intelligent products.

WHAT WE OFFER

• Opportunity to build an AI-native product with global ambitions
• Work with state-of-the-art AI technologies and modern backend infrastructure
• High ownership and autonomy from day one
• Collaboration with an exceptional engineering team passionate about innovation
• Fast-paced environment where your ideas have real impact
• Opportunity to solve complex engineering challenges at scale

YOUR ROLE

• Design, build, and operate backend systems powering AI-driven product features
• Develop inference pipelines and orchestration layers for Large Language Models
• Build scalable APIs that connect AI capabilities with web and mobile applications
• Improve system performance by optimising latency, throughput, caching, batching, and streaming
• Ensure production reliability through monitoring, logging, alerting, and incident response
• Collaborate closely with Machine Learning, Product, and Frontend teams to deliver end-to-end solutions
• Continuously improve platform scalability, observability, and operational excellence
• Drive engineering best practices across AI infrastructure and backend services

IF YOU ARE A PERSON WHO

• Has strong commercial experience in Backend Engineering
• Has built and maintained production-grade distributed systems
• Understands scalable backend architecture and API design
• Has experience with high-throughput, low-latency applications
• Is familiar with AI inference, Large Language Models (LLMs), embeddings, or multimodal systems
• Enjoys solving performance, reliability, and scalability challenges
• Takes ownership and thrives in fast-moving, product-focused environments
• Is proactive, pragmatic, and enjoys learning from real production systems
• Communicates effectively and enjoys collaborating with cross-functional teams

Nice to have:

• Experience with Python, Node.js, PyTorch
• Familiarity with OpenAI, Anthropic, or open-source LLMs
• Experience with Kubernetes, Docker, SQL, and NoSQL databases
• Exposure to AI infrastructure, model serving, or inference optimisation

Congrats! If you want to build the AI infrastructure powering intelligent products used by millions, this role is ideal for YOU!