Senior AI-Driven Data Engineering Architect

databricks; Amsterdam; Híbrido; EUR 120 000 - 180 000; Tempo integral

Resumo da oferta

Databricks is seeking a Specialist Solutions Architect - Data Engineering to guide strategic customers in designing and optimizing production-grade data workloads on the Databricks Data Intelligence Platform. You will lead end-to-end designs, PoCs, and scalable pipelines using Spark and streaming technologies, while mentoring teams and driving platform adoption.

You will apply an AI-first mindset to accelerate development, build interactive data applications, and influence technical roadmaps

Qualificações

• 5+ years in data or software engineering with hands-on proficiency in distributed processing (Spark, Delta Lake, SDP) and real-time streaming technologies (Spark Streaming, Kafka, CDC).
• AI-first mindset with daily use of AI coding tools and LLMs to accelerate pipeline development and asset generation.
• Strong production programming foundations in Python, SQL, and Scala/Java; solid data modeling and system design knowledge.
• Experience in customer advisory and delivery, managing engagements with multiple stakeholders.
• Practical experience with operational/HTAP architectures including transactional data layers (Postgres/OLTP) and low-latency serving.

Responsabilidades

• Lead end-to-end technical design, PoCs, and workload sizing for strategic customer engagements.
• Architect production data systems: batch and streaming pipelines, Lakebase, and performance testing.
• Deploy interactive data applications using Databricks Apps and related tooling.
• Apply AI-native engineering practices to prototype and deliver architectural assets.
• Mentor peers, create reusable assets, and run technical workshops for broader teams.

Conhecimentos

Data engineering

AI/LLMs

Python

SQL

Scala/Java

Customer advisory

Streaming tech

Ferramentas

Apache Spark

Delta Lake

Kafka

Postgres

Lakebase

Descrição da oferta de emprego

Databricks is seeking a Specialist Solutions Architect - Data Engineering to guide strategic customers in designing and optimizing production-grade data workloads on the Databricks Data Intelligence Platform. You will lead end-to-end designs, PoCs, and scalable pipelines using Spark and streaming technologies, while mentoring teams and driving platform adoption.

You will apply an AI-first mindset to accelerate development, build interactive data applications, and influence technical roadmaps