Sr. AI Engineer

Zylon; Santander; A distancia; EUR 50.000 - 70.000; Jornada completa

Descripción de la vacante

A leading company in AI technology is seeking an experienced AI Engineer to enhance their Private AI platform. The role involves developing AI systems for on-premise environments, optimizing performance, and ensuring security for enterprise clients. Join a collaborative team focused on innovation and make a direct impact on product development and company growth.

Servicios

Competitive salary and equity package

Work with cutting-edge AI technologies

Flexible schedule (40h/week)

23 days of PTO

Necessary equipment provided

Periodic on-site team-building events

Formación

• 5+ years of experience in software or AI engineering roles.
• Experience with on-premise deployment of AI systems.

Responsabilidades

• Design, develop, and deploy AI systems for on-premise environments.
• Optimize Small Language Models for private deployments.

Conocimientos

Problem Solving

Communication

Adaptability

Herramientas

Python

PyTorch

Docker

Kubernetes

Descripción del empleo

About Us
Zylon transforms company knowledge into immediate productivity gains through a secure, private AI workspace. Our on-premise deployment ensures complete data sovereignty, cost control, and full customization by running local AI models with no vendor lock-in. As creators and maintainers of the popular open-source project PrivateGPT (with more than 55K Github stars), we are committed to leveraging the latest AI technologies to drive innovation and deliver exceptional value to our customers. As an early-stage startup serving clients in financial, manufacturing, engineering, and other regulated industries, we're looking for talented individuals to help drive our growth in a company where we celebrate diversity and are committed to creating an inclusive environment for all employees.

Role Overview
We're seeking an experienced AI Engineer to join our team and play a crucial role in developing and enhancing our Private AI platform. You'll work on the entire AI stack, from GPU management and inference servers to leveraging and optimizing open-source AI models for on-premise bare-metal deployments, where we have complete control of the data pipeline and the agentic system built on top of it. All of this while ensuring high performance and security for our enterprise clients in regulated industries.

Key Responsibilities

1. Design, develop, and deploy AI systems that can run efficiently in on-premise environments with local models, without depending on third parties like OpenAI or Amazon Bedrock.
2. Optimize Small Language Models (SLMs) for private deployments focusing on performance and resource constraints.
3. Contribute to the architecture of our AI platform, ensuring scalability and security.
4. Implement advanced prompt engineering techniques and secure data processing pipelines for knowledge extraction and transformation.
5. Research, design, and implement agentic strategies to improve AI model interaction and user experience.
6. Stay current with the latest advancements in GenAI research and identify opportunities to add value to our product, developing a deep understanding of AI models' capabilities and limitations.
7. Collaborate with Product & Engineering teams in implementation, product definition, prioritization, scoping, and validation.
8. Work closely with client success teams to troubleshoot and resolve technical issues.

Requirements

• 5+ years of experience in software or AI engineering roles, with a focus on GenAI in the last 2 years.
• Experience with on-premise deployment of AI systems.
• Strong background in integrating and fine-tuning open-source LLMs.
• Proficient in Python and relevant ML/AI frameworks (PyTorch, LlamaIndex, LangChain, etc.).
• Familiarity with Agent strategies, agentic frameworks, and RAG implementations.
• Experience with vector databases and efficient retrieval systems.
• Knowledge of containerization and deployment technologies (Docker, Kubernetes).
• Strong problem-solving skills and attention to detail.
• Excellent English communication skills and ability to collaborate effectively.
• Eager to stay updated with new techniques, models, and advances in GenAI.
• Creative, adaptable, and customer-focused mindset.

Nice to Have

• Experience with vLLM + NVIDIA Triton architecture.
• Understanding of NVIDIA drivers and CUDA for powering GPUs.
• Knowledge of evaluation and observability frameworks for GenAI.
• Familiarity with Model Context Protocol (MCP) for building agentic systems.
• Experience with model quantization and optimization techniques.
• Background working in startups or early-stage companies.
• Experience in financial, manufacturing, or engineering domains.

What We Offer

• The opportunity to shape the future of private AI in regulated industries.
• Competitive salary and equity package.
• Work with cutting-edge AI technologies.
• Direct impact on product development and company growth.
• Collaborative team environment focused on innovation.
• Full-remote position within Europe.
• Flexible schedule (40h/week).
• 23 days of PTO.
• Necessary equipment provided.
• Periodic on-site team-building events.