Lead Data Platform Engineer

avec compétence GmbH; Ecublens; Hybrid; CHF 150,000 - 210,000; Full time

Benefits offered by this job

Hybrid work model

Home office up to 2 days/week

Job summary

Photonics technology is seeking a Senior/Lead Data Platform Architect to drive the architecture, development and scaling of an enterprise data platform. You will bridge data engineering, full-stack application design and DevOps workflows to deliver scalable ETL/ELT pipelines and a central data lakehouse.

You will own CI/CD pipelines, deploy dashboards and automation, and mentor engineers while collaborating across engineering teams.

Qualifications

• Senior or Lead level experience owning data platform architectures and end-to-end pipelines in production.
• Proficiency in Python and ETL/ELT pipeline orchestrators such as Airflow, Dagster or Prefect.
• Experience with analytical databases such as PostgreSQL and DuckDB.
• Hands-on experience developing backend services and APIs with FastAPI.
• Strong foundation in containerization (Docker, Docker Swarm) and automated CI/CD workflows using GitLab.
• Experience utilizing AI agentic coding tools and LLM-based documentation servers.
• Proven capability leading technical roadmaps and mentoring engineers.
• English required.

Responsibilities

• Architect, build and optimize scalable ETL/ELT pipelines and a central data lakehouse.
• Integrate operational, fab and product quality datasets across engineering teams.
• Design, build and maintain full-stack internal data applications and REST APIs with Python and FastAPI.
• Oversee application deployment with Docker Swarm and administer PostgreSQL database servers.
• Own company-wide GitLab CI/CD pipelines and security configurations.
• Define and execute the roadmap for enterprise data and automation initiatives.
• Deploy and scale dashboarding solutions, process automation and AI-assisted developer tooling.

Skills

Python

Airflow

Dagster

Prefect

PostgreSQL

DuckDB

FastAPI

Docker

Docker Swarm

GitLab CI/CD

AI agentic coding tools

LLM-based docs servers

Mentoring engineers

English

Tools

FastAPI

PostgreSQL

DuckDB

Airflow

Dagster

Prefect

GitLab

Docker

Docker Swarm

AI coding tools

LLM documentation servers

Job description

You will drive the architecture, development, and scaling of an enterprise data platform, bridging data engineering, full-stack application design and DevOps workflows.

Tasks

• Architect, build and optimize scalable ETL/ELT pipelines and a central data lakehouse
• Integrate operational, fab and product quality datasets across engineering teams
• Design, build and maintain full-stack internal data applications and REST APIs with Python and FastAPI
• Oversee application deployment with Docker Swarm and administer PostgreSQL database servers
• Own company-wide GitLab CI/CD pipelines and security configurations
• Define and execute the roadmap for enterprise data and automation initiatives
• Deploy and scale dashboarding solutions, process automation and AI-assisted developer tooling

Profile

• Senior or Lead level experience owning data platform architectures and end-to-end pipelines in production
• Advanced proficiency in Python and ETL/ELT pipeline orchestrators such as Airflow, Dagster or Prefect
• Experience with analytical databases such as PostgreSQL and DuckDB
• Hands-on experience developing backend services and APIs with FastAPI
• Strong foundation in containerization (Docker, Docker Swarm) and automated CI/CD workflows using GitLab
• Experience utilizing AI agentic coding tools and LLM-based documentation servers
• Proven capability leading technical roadmaps and mentoring engineers
• English required

Offer

• Work percentage: 100%
• Home office up to two days per week
• Start date: as soon as possible
• 3-6 months interim, then a permanent position

Company

Photonics technology