Senior AI/ML Engineer, Zurich

vector8

Zürich

On-site

CHF 120,000 - 190,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive salary
25 days vacation
Development budget
Flat hierarchy

Job summary

vector8 is hiring for a hands-on AI engineering role in Zurich. You will design and build agentic AI workflows, integrate LLMs with client systems, and ensure reliable production deployments.

The role emphasizes security, compliance, and scalable architectures within regulated industries. You will collaborate closely with engineers, project managers, and client teams to deliver end-to-end AI-powered solutions across Europe.

Qualifications

  • 5+ years in AI/ML engineering or related field.
  • Experience with LLM integrations and enterprise software.
  • Strong software engineering practices and CI/CD.
  • Experience with multi-cloud and security/compliance constraints.

Responsibilities

  • Design and build LLM agents and AI workflows with tool integration.
  • Integrate LLMs, retrieval and ML/speech models with client data.
  • Ensure production reliability with testing, monitoring, and governance.
  • Develop and maintain CI/CD pipelines, documentation, and architecture diagrams.
  • Collaborate with product, DevOps, and client teams for end-to-end delivery.

Skills

LLM architectures
Python (FastAPI)
MLOps
German & English fluency
System design

Education

Bachelor/Master in CS/Math/Physics

Tools

Docker
Kubernetes
Terraform
Vector databases
Model serving

Job description

Job Description

At vector8 we design, develop and deliver production grade AI Solutions, leveraging our deep understanding and specialism in the Swiss Banking and Insurance sectors. Our solutions are varied depending on the problem we are solving, ranging from agentic systems to more traditional AI-powered solutions based on LLMs, classical ML or speech models. Every solution meets the same impeccable standard of performance, robustness and long-term maintainability.

This is a hands-on engineering role where you will:

  • Design and build agents and AI workflows, including tool integration, orchestration, guardrails and human validation steps.
  • Integrate LLMs, retrieval and classical ML or speech models with clients' existing systems and data.
  • Make these solutions reliable in production through systematic evaluation, tracing, fallback strategies, and cost and latency control.
  • Apply software engineering best practices: testing, CI/CD, modular design and documentation.
  • Address the requirements of regulated industries, such as security, compliance, access control and integration with legacy systems.
  • Own solutions end to end, from scoping with the client to production monitoring and continuous improvement.
  • Work closely with vector8's engineers and project managers, as well as with client architects and business teams.

You will help build AI foundations that our clients can reuse and extend as they scale from individual use cases to company-wide capabilities.

The role is primarily based in Zurich, with occasional travel to client sites and collaboration with teams across Europe.

Job Requirements

1. Agentic systems and AI workflows

  • Design and build LLM agents that use tools and interact with enterprise systems and data
  • Orchestrate multi-step and multi-agent workflows, with human validation and hand-off where needed
  • Define clear boundaries for each agent through typed tool contracts, structured outputs, guardrails and access policies
  • Connect agents to other systems through open protocols such as MCP and A2A, and through well-designed APIs
  • Choose the most appropriate architecture for each problem, whether an agent, a deterministic workflow or a classical ML solution
  • Evaluate AI solutions systematically against datasets to generate meaningful performance metrics.

2. Software Engineering for AI

  • Write clean, modular, and well-documented code in Python (FastAPI, Pydantic, asyncio).
  • Apply best practices in:
  • Testing (unit, integration, end-to-end)
  • CI/CD (GitHub Actions, GitLab CI, Argo CD)
  • Observability (logging, monitoring, tracing).
  • Ensure security and compliance (data protection, access controls, encryption).
  • Integrate models and code into CI/CD pipelines for seamless deployment.

3. Enterprise AI & MLOps

  • Deploy and monitor AI solution in production
  • Design and implement MLOps pipelines for:
  • Model training, fine-tuning, and evaluation
  • Model versioning and lineage tracking
  • A/B testing and canary deployments.
  • Ensure scalability and reliability (auto-scaling, fault tolerance, disaster recovery).
  • Collaborate with data engineers to build data pipelines (batch, streaming, real-time).

4. Collaboration & Technical Leadership

  • Work closely with product owners, DevOps, and quality assurance in an agile, cross-functional team.
  • Mentor junior engineers and promote best practices in AI/ML and software engineering.
  • Translate product requirements into technical solutions and architectural decisions
  • Document architectures, decisions, and best practices for internal and client-facing use.
  • Develop relationships with internal and external stakeholders, including clients and partners.

5. End-to-End AI-powered Solutions Development (less frequent but can occur)

  • Design, implement, and deploy distributed, high-volume, high-performance, low-latency machine learning solutions, with a focus on GenAI models, and especially LLM integrations and API-driven architectures.
  • Take ownership of your models throughout their entire lifecycle:
  • Data exploration and cleaning to build reproducible, versioned datasets
  • State-of-the-art research to identify the best architectures for the problem (e.g., transformers, RAG, fine-tuning).
  • Implementation, training, and optimization in reproducible environments
  • Deployment, monitoring, and maintenance in production.
  • Optimize models for performance, latency, and cost efficiency, especially in LLM serving and inference.

6. Innovation & Continuous Improvement

  • Stay ahead of the latest AI and ML architectures (transformers, Mixture of Experts, sparse attention).
  • Experiment with cutting-edge techniques (quantization, distillation, speculative decoding).
  • Evaluate and benchmark open-source and proprietary models (Llama, Mistral, Mixtral, GPT-4, Claude).
  • Bring your own ideas through vector8’s ideation process.
  • Contribute to vector8’s AI accelerators (reusable components for common industry problems).
  • Embrace a strategic and continuous improvement mentality to drive innovation.
What you bring
  • 5 + years of experience in AI/ML engineering, software development, or related field.
  • Expertise in LLM architectures and training methodologies:
    • Transformers, attention mechanisms, fine-tuning, RAG, quantization
    • Prompt engineering, model evaluation, bias detection
  • Strong knowledge of machine learning architectures: fully connected, CNN, LSTM, transformers and classical ML models.
  • Strong software engineering skills:
    • Proficient in Python (FastAPI, Pydantic, asyncio, type hints)
    • Experience with API development
    • Familiarity with modern toolchains (Docker, Kubernetes, Terraform)
  • Hands-on experience with LLM integrations:
    • LLM providers
    • Vector databases (Pinecone, Weaviate, Milvus)
    • Model serving (vLLM, TGI, KServe)
  • Experience with MLOps and production deployments
  • Understanding of enterprise challenges:
    • Security, compliance, scalability, cost optimization.
  • Experience with relational and non-relational databases.
  • Strong problem-solving and debugging skills.
  • Bachelor’s or Master’s degree in Computer Science, Mathematics, Physics, or a related field.
  • Experience with multi-cloud environments (AWS, Azure, GCP).
  • Experience with code optimization (e.g., model quantization, parallelization).
  • Excellent communication and collaboration skills – in this role you must be fluent in English and German. Swiss German is a plus.
What we offer
  • A role at the forefront of AI transformation for leading Swiss enterprises in financial services, insurance, and beyond.
  • Work with cutting-edge AI technologies and innovative solutions that create real, measurable business value.
  • A dynamic, entrepreneurial work environment where your contributions directly drive company growth.
  • Supportive team culture that prioritises continuous learning, professional development, and personal growth.
  • A leadership ethos focused on empowering people, fostering collaboration, excellence, authenticity, and diversity.
  • Competitive salary package, 25 days of vacation, development budget, and a flat hierarchy.
Why This Role is Unique
  • You will work at the intersection of AI research and enterprise software engineering, with a strong focus on AI-driven solutions.
  • You will shape the future of AI adoption in Switzerland’s most complex organizations.
  • You will bridge the gap between cutting-edge AI and real-world enterprise constraints (security, compliance, legacy systems).
  • You will have the opportunity to mentor teams, drive innovation, and represent vector8 as a thought leader.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior DevOps Engineer, CH
Senior DevOps Engineer, CH

vector8 • Zürich

Hybrid
CHF 120,000 - 180,000
Hybrid working model
On-site gym and wellness facilities
Technical Lead, Data & AI, CH
Technical Lead, Data & AI, CH

vector8 • Zürich

On-site
CHF 120,000 - 160,000
Competitive salary package
25 days of vacation
Supportive team culture
+1
AI Governance Lead / Head - Banking, CH
AI Governance Lead / Head - Banking, CH

vector8 • Zürich

Hybrid
CHF 180,000 - 240,000
Hybrid working model
Zurich office access with on-site gym
Professional development opportunities
+4
Lead Business Analyst
Lead Business Analyst

vector8 • Zürich

Hybrid
CHF 120,000 - 180,000
Bonus package
Zurich office
Hybrid work
+6
AI & Sales Consultant
AI & Sales Consultant

Dreamleap Ag • Winterthur

On-site
CHF 140,000 - 180,000
Growth opportunities
Direct impact
Client collaboration
+3
Senior AI/ML Engineer - Enterprise AI & MLOps (Zurich)
Senior AI/ML Engineer - Enterprise AI & MLOps (Zurich)

vector8 • Zürich

On-site
CHF 120,000 - 190,000
Competitive salary
25 days vacation
Development budget
+1
Principal Enterprise Architect, CH
Principal Enterprise Architect, CH

vector8 • Zürich

Hybrid
CHF 180,000 - 260,000
Competitive base salary with bonus
Zurich office
Hybrid work model
+3
Data & AI Engineer (Lausanne / Zurich, Switzerland)
Data & AI Engineer (Lausanne / Zurich, Switzerland)

Unit8 • Lausanne

Hybrid
CHF 110,000 - 150,000
Impactful client work
Open-source contributions
Mentorship program
+3
Software Engineer Java Backend
Software Engineer Java Backend

Swissquote • Vaud

On-site
CHF 120,000 - 170,000
AI Specialist
AI Specialist

MDW group • Genf, Lausanne

Hybrid
CHF 120,000 - 190,000
Hybrid working
30 days vacation
Training budget
+2
Top locations