(Senior) Software Engineer – AI/ML (m/f/d)

ATOSS Software SE; Bengaluru; Hybrid; INR 2,400,000 - 3,600,000; Full time

Benefits offered by this job

Competitive salary

Meal cards

In-house refreshments

Professional growth

Job summary

ATOSS Software SE in Bengaluru is looking for a (Senior) Software Engineer – AI/ML to design, build, and operate backend services powering AI-driven capabilities in our SaaS platform.

You will integrate LLMs, AI agents, and retrieval-based solutions using Java and Python, with a strong focus on reliability, performance, and scalable cloud infrastructure in a hybrid work model.

Qualifications

• Strong backend development experience with Java or a statically-typed language.
• Solid Python skills for automation and AI-related development.
• Experience designing, building, and operating APIs and distributed systems in production.
• Hands-on cloud experience (Azure, AWS, or GCP) and modern CI/CD practices with containers.

Responsibilities

• Design, build, and operate backend services and APIs powering AI-driven features.
• Develop production software with a focus on reliability, maintainability, and performance.
• Own services end-to-end from architecture to deployment and monitoring.
• Integrate LLMs, AI agents, and retrieval-based solutions into production applications.
• Build observability and monitoring for AI-powered capabilities.
• Contribute to CI/CD pipelines and deployment automation.
• Ensure AI-powered systems are scalable, secure, and production-ready.
• Troubleshoot complex production issues and drive improvements.
• Collaborate with AI Engineers, Product Owners, and Cloud Operations.

Skills

Java

Python

APIs

Distributed systems

Cloud platforms

CI/CD

Observability

AI-powered apps

Tools

Azure

AKS

Docker

Kubernetes

LangGraph

LangChain

LiteLLM

Langfuse

Ragas

Promptfoo

Keycloak

Job description

About Us ATOSS Software SE is one of Germany’s most successful tech growth stories. As the market leader in Workforce Management Software, we help companies work more intelligently, creatively, and humanely optimizing the balance between profitability and people. We’re a rare company: according to Handelsblatt (10/24), just 309 public companies worldwide achieved over 20% return on sales for ten consecutive years. Only one based in Germany: ATOSS Software SE. With 20 years of record‑breaking growth, over €2 billion market cap, and listings in SDAX and TecDAX, we’re scaling globally and we’re growing. If you’re ready to drive impact in a high‑performing B2B SaaS environment, this is your chance to elevate your career.

The Person You are At ATOSS, we hire for both character and skill, seeking individuals who embody resilience, a pioneering spirit, and the passion to grow.

We Value Those Who

• Think like entrepreneurs – taking ownership, pushing boundaries, and driving impact.
• Challenge the status quo – bringing fresh ideas and bold execution to the table.
• Thrive in change – seeing growth as a lifelong journey, both professionally and personally.
• We don’t just equip you for work—we prepare you for life.

The Role ATOSS is building AI‑powered capabilities for workforce management used by thousands of organizations worldwide. As a (Senior) Software Engineer – AI/ML, you will help bring these capabilities into production by combining strong backend engineering expertise with practical experience working with LLMs, AI agents, and retrieval‑based systems.

Location Bangalore (Whitefield, ITPL). We operate in a hybrid work model with a minimum of 50% office attendance. New team members are expected to work from our Bangalore office on a daily basis for the first six months. After onboarding, the role transitions to the standard hybrid model.

Key Responsibilities

• Design, build, and operate backend services and APIs that power AI‑driven and traditional product capabilities within the ATOSS platform.
• Develop high‑quality production software using Java and Python, with a strong focus on reliability, maintainability, and performance.
• Own services end‑to‑end, from architecture and implementation through deployment, monitoring, and ongoing operations.
• Integrate LLMs, AI agents, and retrieval‑based solutions into production applications.
• Build and improve evaluation, monitoring, and observability capabilities for AI‑powered features.
• Contribute to CI/CD pipelines, deployment automation, and engineering best practices.
• Help ensure AI‑powered systems are scalable, secure, and production‑ready.
• Troubleshoot complex production issues and drive continuous improvements in system reliability and performance.
• Work closely with AI Engineers, Product Owners, and Cloud Operations teams to bring new capabilities into production.
• Mentor engineers through code reviews, technical guidance, and knowledge sharing.

Our Technology Stack Our team works with a modern AI and cloud‑native technology stack including Java, Python, Azure, Azure Kubernetes Service (AKS), Docker, Kubernetes, LangGraph, LangChain, LiteLLM, Langfuse, Ragas, Promptfoo, Keycloak, and Azure Content Safety. As part of ATOSS’s AI team in Bangalore, you’ll work on the Cognitive Backend platform that powers AI‑driven capabilities across our products. The team sits at the intersection of AI Engineering and core platform development, ensuring AI‑powered features are delivered on reliable, observable, and scalable enterprise infrastructure.

Key Requirements

Mandatory

• Strong experience building backend applications with Java or another statically‑typed language.
• Strong experience designing, building, and operating APIs, services, and distributed systems in production environments.
• Solid Python skills for automation, integrations, and AI‑related development.
• Hands‑on experience with cloud platforms such as Azure, AWS, or GCP, and modern CI/CD practices and containerized applications using Docker.
• Strong understanding of monitoring, logging, and observability, with a focus on building reliable and maintainable systems.
• Practical experience building, integrating, deploying, or operating AI‑powered applications, LLM‑based solutions, retrieval systems, agentic frameworks, or similar technologies in a professional environment.

Preferred

• Experience with frameworks such as LangChain, LangGraph, CrewAI, or similar technologies for building AI‑powered applications.
• Familiarity with vector databases such as Pinecone, Weaviate, Milvus, Chroma, or pgvector.
• Experience working with Retrieval‑Augmented Generation (RAG) architectures and AI evaluation frameworks such as Ragas, Promptfoo, or similar tools.
• Hands‑on experience with Kubernetes, ideally within Azure Kubernetes Service (AKS) environments.
• Experience with Infrastructure as Code using Terraform or similar technologies.
• Experience building multi‑tenant SaaS platforms or enterprise software products.

Our Benefits

• Competitive salary and benefits package, including comprehensive insurance & wellness support, meal cards, and in‑house refreshments.
• Opportunities for professional growth and development.
• A collaborative and innovative work environment.
• Over 15 000 well‑known customers, sustainable growth of over 10 %, over 30 % EBIT, listed on the German Stock Market: SDAX & TecDAX, security & stability.

At ATOSS, great talent knows no limits. We welcome professionals from all backgrounds and empower their growth through an inclusive, skill‑focused environment. Join us and be part of a high‑growth, future‑focused company!