Backend Software Engineer - AI/ML (m/f/d)

ATOSS Aloud GmbH - Crewmeister; Bengaluru; Hybrid; INR 1,500,000 - 2,100,000; Full time

Benefits offered by this job

Hybrid work model

Office in Bangalore (Whitefield)

Job summary

Crewmeister is seeking a Software Engineer - AI/ML to build scalable backend systems and AI-powered product capabilities at enterprise scale. You will work in Bangalore within our AI team, delivering reliable services on a hybrid schedule with 50% office attendance in Whitefield.

The role focuses on backend development with Java and Python, integrating LLMs and retrieval-based solutions, and collaborating with AI Engineers, Product Owners, and Cloud Operations to push innovative features into

Qualifications

• Backend apps with Java in production environments.
• Experience designing, building, and operating APIs and distributed systems.
• Proficient Python for automation and AI-related development.
• Cloud platforms (Azure/AWS/GCP) and modern CI/CD; Docker-based deployments.
• Strong observability, monitoring, and reliable systems skills.
• Hands-on AI-powered apps, LLMs, retrieval systems, or similar tech.

Responsibilities

• Design, build, and operate backend services powering AI-driven and traditional capabilities.
• Develop production-grade software in Java with Python components for automation.
• Own services end-to-end from design to deployment and operations.
• Integrate LLMs, AI agents, and retrieval-based solutions into production apps.
• Improve monitoring, observability, and evaluation for AI features.
• Contribute to CI/CD pipelines and deployment automation.
• Ensure AI-powered systems are scalable, secure, and production-ready.
• Troubleshoot production issues and drive reliability improvements.
• Collaborate with AI Engineers, Product Owners, and Cloud Ops to ship new capabilities.

Skills

Java

Python

Cloud platforms

CI/CD

Observability

Distributed systems

AI-powered applications

LLMs

Retrieval-based systems

Docker

Kubernetes

LangGraph

LangChain

Terraform

Tools

Docker

Kubernetes

Terraform

LangGraph

LangChain

Azure Cloud

AKS

Job description

Software Engineer - AI/ML

With over 20,000 customers, Crewmeister is one of the fastest-growing workforce management software providers in Germany. Our success is driven by great products, strong teamwork, and people who are passionate about building exceptional software.

As part of the ATOSS Group, we combine the agility and ownership of a scale-up with the stability and resources of a leading software company.

AI is transforming how software is built, and we're investing in engineers who can help shape that future. We believe the next generation of software development will combine strong engineering fundamentals with AI-powered workflows, tools, and product capabilities.

If you're excited about building scalable backend systems while pushing the boundaries of AI-enabled product development, we'd love to hear from you.

This role is designed for experienced software engineers whose foundation is in backend development, distributed systems, and cloud-native applications. We are looking for engineers who have already gained hands‑on experience with AI-powered applications, LLMs, AI agents, or retrieval-based systems in a professional setting. However, this is not a machine learning research or AI specialist role. Your primary focus will be designing, building, and operating reliable, scalable, and observable services that enable AI-powered functionality at enterprise scale.

Location: Bangalore (Whitefield, ITPL)

We operate in a hybrid work model with a minimum of 50% office attendance. To support onboarding, collaboration, and team integration, new team members are expected to work from our Bangalore office in Whitefield (ITPL) on a daily basis during their first six months. Following the onboarding period, the role transitions to our standard hybrid working model.

Key Responsibilities

• Design, build, and operate backend services and APIs that power AI-driven and traditional product capabilities within the ATOSS platform.
• Develop high-quality production software using Java, and secondarily Python, with a strong focus on reliability, maintainability, and performance.
• Own services end-to-end, from architecture and implementation through deployment, monitoring, and ongoing operations.
• Integrate LLMs, AI agents, and retrieval-based solutions into production applications.
• Build and improve evaluation, monitoring, and observability capabilities for AI-powered features.
• Contribute to CI/CD pipelines, deployment automation, and engineering best practices.
• Help ensure AI-powered systems are scalable, secure, and production-ready.
• Troubleshoot complex production issues and drive continuous improvements in system reliability and performance.
• Work closely with AI Engineers, Product Owners, and Cloud Operations teams to bring new capabilities into production.

Our team works with a modern AI and cloud-native technology stack including Java, Python, AWS, EKS, Docker, Kubernetes, LangGraph.

As part of Crewmeister's AI team in Bangalore, you'll work on the Cognitive Backend platform that powers AI-driven capabilities across our products. The team sits at the intersection of AI Engineering and core platform development, ensuring AI-powered features are delivered on reliable, observable, and scalable enterprise infrastructure.

Key Requirements

Mandatory

Strong experience building backend applications with Java.

• Strong experience designing, building, and operating APIs, services, and distributed systems in production environments.
• Proficient Python skills for automation, integrations, and AI-related development.
• Hands-on experience with cloud platforms such as Azure, AWS, or GCP, as well as modern CI/CD practices and containerized applications using Docker.
• Strong understanding of monitoring, logging, and observability, with a focus on building reliable and maintainable systems.
• Practical experience building, integrating, deploying, or operating AI-powered applications, LLM-based solutions, retrieval systems, agentic frameworks, or similar technologies in a professional environment.

Preferred

• Experience with frameworks such as LangChain, LangGraph, CrewAI, or similar technologies for building AI-powered applications.
• Familiarity with vector databases such as Pinecone, Weaviate, Milvus, Chroma, or pgvector.
• Experience working with Retrieval-Augmented Generation (RAG) architectures and AI evaluation frameworks such as Ragas, Promptfoo, or similar tools.
• Hands-on experience with Kubernetes, ideally within Azure Kubernetes Service (AKS) environments.
• Experience with Infrastructure as Code using Terraform or similar technologies.
• Experience building multi-tenant SaaS platforms or enterprise software products.
• Join one of Europe's fastest-growing SaaS companies.
• Help shape the future of AI-enabled software development.
• Work on meaningful products used by thousands of businesses.
• Be part of a collaborative engineering culture focused on learning, ownership, and continuous improvement.