Senior Software Engineer – Sichere KI-Infrastruktur

Edgeless Systems GmbH; Berlin, Bochum; Hybrid; EUR 70.000 - 90.000; Vollzeit

Zusammenfassung

A leading cybersecurity startup is looking for a Senior Software Engineer to work on the Privatemode platform. The role involves extending APIs, building confidential processing features, and optimizing LLMs. Ideal candidates will have strong technical skills, experience in related technologies, and thrive in a fast-paced environment. Flexible working arrangements are provided.

Leistungen

Competitive compensation (salary and stock options)

Opportunity to learn and grow

Flexible working arrangements

Exciting tasks in a dynamic environment

Qualifikationen

• Extensive experience in relevant technologies and a passion for continuous improvement.
• Ability to contribute to both front-end and back-end development.
• High motivation to deliver quality work in a startup environment.

Aufgaben

• Extend the OpenAI-compatible API for the Privatemode platform.
• Build features for confidential processing and RAG functionalities.
• Optimize performance of open-source LLMs in the platform.
• Automate CI/CD processes and maintain documentation.
• Mentor less experienced engineers on the team.

Kenntnisse

Outstanding technical capabilities

Experience with Go

Experience with Python

Experience with Kubernetes

Agile software-development practices

Tools

TypeScript

React

Electron

Jobbeschreibung

Hi there, we are Edgeless Systems

We are a fast-growing cybersecurity startup. Join us in developing the next generation of secure AI and cloud software, explore cutting-edge technologies like confidential computing, and grow in and alongside a world-class team

Our product
Privatemode AI is our secure alternative to ChatGPT. It enables AI workflows with sensitive data by keeping all data encrypted—even during processing—using confidential computing. You can access it via a user-friendly app or a fully OpenAI-compatible API.

See for yourself: Most of our code is available on GitHub.

Our tech stack

• API: Go, Kubernetes
• RAG: Python, Qdrant
• Model hosting: Python, vLLM
• Scaling: pipeline/tensor parallelism, optimization for Nvidia H100 and B200
• Portal and app: TypeScript, React, Electron

Your mission

As part of our team, you’ll work on the Privatemode platform across frontend, backend, and model hosting. Tasks include:

• Extending our OpenAI-compatible API and confidential processing stack
• Building RAG features, embedding pipelines, and agent functionality
• Hosting and optimizing the performance of cutting-edge open-source LLMs
• Scaling models using parallelism and efficient GPU orchestration
• CI/CD automation and documentation
• Prototyping and iterating on new features

As a Senior Software Engineer, you also help less experienced team members with their personal development.

Your profile

We are looking for team members who…

• have outstanding technical capabilities
• are experienced in a relevant subset of the technologies outlined above
• are excited about the challenges of a fast-paced, innovative startup environment
• are experienced in professional agile software-development practices
• are inherently motivated to deliver high-quality work

Why us?

• Competitive compensation (salary and stock options)
• Opportunity to learn and grow within an outstanding team
• Flexible working arrangements—remote or in our offices in Bochum and Berlin
• Exciting tasks in a dynamic environment

Contact