(Senior) Software Engineer AI/ML (m/f/d)

ATOSS Software AG; Bengaluru; On-site; INR 3,000,000 - 6,000,000; Full time

Benefits offered by this job

Competitive salary

Hybrid work model

Meal cards

In-house refreshments

Job summary

ATOSS Software SE in Bangalore is seeking a (Senior) Software Engineer – AI/ML to design, build, and operate backend services powering AI-driven capabilities across our platform. You will work with Java and Python, integrate LLMs and retrieval-based systems, and own services end-to-end in a hybrid office-first model in Bengaluru.

This role is for engineers with strong backend, cloud, and observability skills, focused on scalable enterprise software and AI-powered capabilities.

Qualifications

• Strong backend experience with Java or a statically typed language.
• Proficient Python for automation and AI-related development.
• Hands-on cloud experience (Azure/AWS/GCP) and containerized apps using Docker.
• Experience designing, building, and operating APIs, services, and distributed systems in production.
• Practical experience with AI-powered apps, LLMs, retrieval systems, or agent frameworks.

Responsibilities

• Design, build, and operate backend services and APIs powering AI-driven capabilities.
• Develop production-grade software in Java and Python with reliability and performance focus.
• Own services end-to-end from architecture to deployment and monitoring.
• Integrate LLMs, AI agents, and retrieval-based solutions into production apps.
• Improve evaluation, monitoring, and observability for AI-powered features.
• Contribute to CI/CD pipelines and deployment automation.
• Ensure AI-powered systems are scalable, secure, and production-ready.
• Troubleshoot production issues and drive reliability improvements.
• Collaborate with AI Engineers, Product Owners, and Cloud Ops.
• Mentor engineers through code reviews and knowledge sharing.

Skills

Java

Python

Azure

AWS

GCP

CI/CD

Docker

Observability

LangChain

Tools

Kubernetes

AKS

LangGraph

LangChain

Ragas

Promptfoo

Docker

Job description

About us

ATOSS Software SE is one of Germany’s most successful tech growth stories. As the market leader in Workforce Management Software, we help companies work more intelligently, creatively, and humanely, optimizing the balance between profitability and people.

We’re a rare company: according to Handelsblatt (10/24), just 309 public companies worldwide achieved over 20% return on sales for ten consecutive years. Only one based in Germany: ATOSS Software SE.

With 20 years of record‑breaking growth, over €2 billion market cap, and listings in SDAX and TecDAX, we’re scaling globally and growing.

If you’re ready to drive impact in a high‑performing B2B SaaS environment, this is your chance to elevate your career.

The Person You Are

At ATOSS, we hire for both character and skill, seeking individuals who embody resilience, a pioneering spirit, and the passion to grow.

We value those who:

• Think like entrepreneurs – taking ownership, pushing boundaries, and driving impact.
• Challenge the status quo – bringing fresh ideas and bold execution to the table.
• Thrive in change – seeing growth as a lifelong journey, both professionally and personally.

We don’t just equip you for work – we prepare you for life.

The Role

ATOSS is building AI‑powered capabilities for workforce management used by thousands of organizations worldwide. As a (Senior) Software Engineer – AI/ML, you will help bring these capabilities into production by combining strong backend engineering expertise with practical experience working with LLMs, AI agents, and retrieval‑based systems.

This role is designed for experienced software engineers whose foundation is in backend development, distributed systems, and cloud‑native applications. We are looking for engineers who have already gained hands‑on experience with AI‑powered applications, LLMs, AI agents, or retrieval‑based systems in a professional setting. This is not a machine‑learning research or AI specialist role. Your primary focus will be designing, building, and operating reliable, scalable, and observable services that enable AI‑powered functionality at enterprise scale.

We are hiring at both Software Engineer and Senior Software Engineer levels; candidates will be assessed based on overall experience, technical depth, ownership, and impact.

Location: Bangalore (Whitefield, ITPL)

We operate in a hybrid work model with a minimum of 50% office attendance. To support onboarding, collaboration, and team integration, new team members are expected to work from our Bangalore office in Whitefield (ITPL) on a daily basis during their first six months. Following the onboarding period, the role transitions to our standard hybrid working model.

Key Responsibilities

• Design, build, and operate backend services and APIs that power AI‑driven and traditional product capabilities within the ATOSS platform.
• Develop high‑quality production software using Java and Python, with a strong focus on reliability, maintainability, and performance.
• Own services end‑to‑end, from architecture and implementation through deployment, monitoring, and ongoing operations.
• Integrate LLMs, AI agents, and retrieval‑based solutions into production applications.
• Build and improve evaluation, monitoring, and observability capabilities for AI‑powered features.
• Contribute to CI/CD pipelines, deployment automation, and engineering best practices.
• Help ensure AI‑powered systems are scalable, secure, and production‑ready.
• Troubleshoot complex production issues and drive continuous improvements in system reliability and performance.
• Work closely with AI Engineers, Product Owners, and Cloud Operations teams to bring new capabilities into production.
• Mentor engineers through code reviews, technical guidance, and knowledge sharing.

Our Technology Stack

Our team works with a modern AI and cloud‑native technology stack including Java, Python, Azure, Azure Kubernetes Service (AKS), Docker, Kubernetes, LangGraph, LangChain, LiteLLM, Langfuse, Ragas, Promptfoo, Keycloak, and Azure Content Safety.

As part of ATOSS’s AI team in Bangalore, you’ll work on the Cognitive Backend platform that powers AI‑driven capabilities across our products. The team sits at the intersection of AI Engineering and core platform development, ensuring AI‑powered features are delivered on reliable, observable, and scalable enterprise infrastructure.

Key Requirements

Mandatory

• Strong experience building backend applications with Java or another statically typed language.
• Strong experience designing, building, and operating APIs, services, and distributed systems in production environments.
• Solid Python skills for automation, integrations, and AI‑related development.
• Hands‑on experience with cloud platforms such as Azure, AWS, or GCP, as well as modern CI/CD practices and containerised applications using Docker.
• Strong understanding of monitoring, logging, and observability, with a focus on building reliable and maintainable systems.
• Practical experience building, integrating, deploying, or operating AI‑powered applications, LLM‑based solutions, retrieval systems, agentic frameworks, or similar technologies in a professional environment.

Preferred

• Experience with frameworks such as LangChain, LangGraph, CrewAI, or similar technologies for building AI‑powered applications.
• Familiarity with vector databases such as Pinecone, Weaviate, Milvus, Chroma, or pgvector.
• Experience working with Retrieval‑Augmented Generation (RAG) architectures and AI evaluation frameworks such as Ragas, Promptfoo, or similar tools.
• Hands‑on experience with Kubernetes, ideally within Azure Kubernetes Service (AKS) environments.
• Experience with Infrastructure as Code using Terraform or similar technologies.
• Experience building multi‑tenant SaaS platforms or enterprise software products.

Our Benefits

• Competitive salary and benefits package, including comprehensive insurance & wellness support, meal cards, and in‑house refreshments.
• Opportunities for professional growth and development.
• A collaborative and innovative work environment.
• Over 15,000 well‑known customers | Sustainable growth of over 10% | Over 30% EBIT | Listed on the German Stock Market: SDax & TecDax | Security & stability.

At ATOSS, great talent knows no limits. We welcome professionals from all backgrounds and empower their growth through an inclusive, skill‑focused environment.

Join us and be part of a high‑growth, future‑focused company!