Agentic AI Software Engineer

Machine Learning Reply GmbH; Berlin; Hybrid; EUR 90.000 - 130.000; Vollzeit

Zusammenfassung

Machine Learning Reply GmbH in Berlin seeks a skilled Consultant blending software engineering with hands-on AI system experience, including agentic and generative AI. You will design and deliver production-ready AI solutions for clients, leveraging LLMs, autonomous workflows, and scalable cloud architectures.

Responsibilities include building cloud-native services (AWS/GCP/Azure), developing agentic AI components, leading PoC to production, integrating LLMs and vector databases, setting up

Qualifikationen

• Completed university studies with a strong quantitative or technical background (e.g., Computer Science, Data Science, Engineering, or similar).
• Solid programming experience in at least two languages (Python, Java, Rust, JavaScript).
• Experience deploying ML/AI models into production (on-premises or cloud).
• Experience with SQL and NoSQL databases; data modeling and management.
• Experience with LLMs, prompt engineering, fine-tuning, and generative AI integration.

Aufgaben

• Design, build, and deploy scalable, production-grade systems on cloud platforms (AWS, GCP, Azure).
• Develop and operate agentic AI systems with multi-step workflows and autonomous decision-making components.
• Lead end-to-end AI features from PoC to production deployment.
• Build high-performance APIs/backend services for AI apps using FastAPI, Flask, or Spring Boot.
• Integrate generative AI (LLMs, vector DBs, RAG pipelines) into enterprise environments.
• Design and implement orchestration and retrieval pipelines for scalable AI apps.
• Set up and maintain MLOps/LLMOps pipelines and CI/CD workflows.
• Ensure software quality via testing, monitoring, observability, and performance optimization.
• Collaborate with clients and cross-functional teams to deliver impactful AI solutions.

Kenntnisse

Python

Java

Rust

JavaScript

LLMs

Prompt engineering

MLOps

CI/CD

Cloud platforms

Ausbildung

Bachelor's degree in CS/DS/Engineering

Tools

FastAPI

Flask

Spring Boot

Jobbeschreibung

We are looking for a skilled and motivated Consultant to join our team. The ideal candidate combines strong software engineering expertise with hands-on experience in modern AI systems, including agentic AI and generative AI applications. You will support our clients in designing and building intelligent, production-ready systems that leverage LLMs, autonomous agents, and scalable cloud architectures.

Responsibilities:

• Design, build, and deploy scalable, production-grade systems on cloud platforms such as AWS, GCP, or Azure.
• Develop and operate agentic AI systems, including multi-step workflows, tool integration, and autonomous decision-making components.
• Lead end-to-end implementation of AI-driven features, from prototyping (PoC) to production deployment.
• Build high-performance APIs and backend services for AI applications using frameworks such as FastAPI, Flask, or Spring Boot.
• Integrate generative AI solutions (LLMs, vector databases, RAG pipelines, orchestration frameworks like LangChain/LangGraph) into enterprise environments.
• Design and implement robust orchestration and retrieval pipelines for scalable AI applications.
• Set up and maintain MLOps / LLMOps pipelines and CI/CD workflows for continuous integration, evaluation, and deployment.
• Ensure software quality through testing, monitoring, observability, and performance optimization.
• Collaborate closely with clients and cross-functional teams to identify requirements and deliver impactful AI solutions.

What we offer you:

• Work on innovative AI and Software Engineering projects across industries (Banking, Insurance, Automotive, Retail, etc.).
• Expand your skills in areas such as MLOps, cloud architecture, data engineering, and generative AI.
• Collaborate with top technology partners in the cloud, AI, and automation ecosystem.
• Access to training, certifications, and interdisciplinary projects.
• Join a vibrant community with hackathons, conferences, and knowledge-sharing events.
• Award-winning office space in downtown Munich with great transport connections.
• Flexible working model between client site, Reply office, and remote work.

Deutschlandticket for public

Job Requirements

Minimum Qualifications:

• Completed university studies with a strong quantitative or technical background (e.g., Computer Science, Data Science, Engineering, or similar).
• Ideally, you have already gained some initial consulting and project management experience Teamwork & Collaboration – ability to work effectively with others toward common objectives.
• Adaptability – flexibility in taking on different roles within a team and understand the need of the costumer
• Solid programming experience in at least two programming languages such as Python, Java, Rust, or JavaScript.
• Practical experience deploying ML/AI models into production environments (on-premises or cloud).
• Experience with different database technologies, including SQL and NoSQL, with knowledge of database design, data modeling, and data management.
• Experience with large language models (LLMs), prompt engineering, fine-tuning, and integrating generative AI into actual solutions.
• Strong communication skills for explaining technical concepts to both technical and business stakeholders.
• Fluent in English and at least C1-level German. This requirement is mandatory.

Desired Qualifications:

• Hands-on experience with cloud AI services.
• Understanding of MLOps concepts (model registry, monitoring, CI/CD).
• Knowledge of modern AI/ML frameworks and tools such as PyTorch, TensorFlow, Hugging Face, LangChain, or OpenAI APIs.
• Awareness of software engineering principles (SOLID, testing, version control).
• Familiarity with containerization and orchestration (Docker, Kubernetes).
• Cloud certifications are a plus.
• Teamwork & Collaboration – ability to work effectively with others toward common objectives.
• Adaptability – flexibility in taking on different roles within a team and understand the need of the costumer