Senior Data Engineer

Avenga

Deutschland

Presencial

EUR 85.000 - 120.000

Jornada completa

Hace 10 días

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

Avenga is seeking a Senior Data Engineer with Databricks to join our team. You will help design, develop and govern enterprise-grade data platforms for a major European energy company, integrating Unity Catalog APIs and securing authentication and authorization.

You will collaborate across engineering, product and security teams, implementing CI/CD and optimizing metadata search, data governance and performance at scale.

Formación

  • 5+ years of experience as a Data Engineer.
  • Proficiency with Databricks Apps development using React, Node.js, Python, Streamlit or similar.
  • Experience integrating with Unity Catalog APIs and metadata services.
  • Experience implementing OAuth, Microsoft Entra ID, SSO, RBAC and group-based authorisation.
  • Designing enterprise-scale web applications for large user groups.
  • Strong knowledge of Databricks SQL, Serverless SQL, Jobs, Lakehouse architecture and governance.

Responsabilidades

  • Design and develop the Enterprise Data Catalog application, including front-end and back-end components.
  • Integrate the application with Unity Catalog APIs, Databricks services, metadata sources and external systems.
  • Implement secure authentication, SSO, role-based and group-based authorisation, and user-context data access.
  • Design high-performing metadata search, caching and indexing for a large user base.
  • Implement CI/CD, automated testing, audit logging, monitoring and application observability.
  • Support deployment, security and architecture reviews, troubleshooting and performance optimisation.
  • Produce maintainable code, configuration and technical documentation, and provide knowledge transfer.

Conocimientos

Databricks
Data engineering
Full-stack skills
REST APIs
CI/CD
OAuth/SSO
Git DevOps
English proficiency

Herramientas

Unity Catalog APIs
Databricks SQL/Lakehouse
Azure DevOps or GitHub Actions
React/Node.js/Python

Descripción del empleo

Avenga is an international engineering firm helping businesses operate with AI at the core. With 6,000+ experts worldwide, we combine engineering expertise with AI-native thinking to turn ambitious ideas into real-world impact across industries, technologies, and markets.

At the core of the role

We are looking for a Senior Data Engineer with Databricks to join our team. Our client is one of the largest state-owned energy companies and a leading producer and supplier of electricity and heat in Europe.

As a Senior Data Engineer, you will take part in setting standards, establishing guidelines, and sharing best practices in order to ensure continuous learning and development.

Core skills you’ll bring
  • 5+ years of experience as a Data Engineer
  • Proficiency in Databricks Apps development experience using React, Node.js, Python, Streamlit or similar technologies
  • Experience integrating with Unity Catalog APIs and metadata services
  • Proven experience implementing OAuth, Microsoft Entra ID, SSO, RBAC and group-based authorisation
  • Experience designing enterprise-scale web applications supporting large user groups
  • Strong knowledge of Databricks SQL, Serverless SQL, Jobs, Lakehouse architecture and governance
  • Familiarity with integrating external systems through REST APIs
  • Experience with CI/CD, Git, and Azure DevOps or GitHub Actions
  • English – Upper-intermediate or higher
Nice-to-have
  • Experience with MCP / JSON-RPC integration patterns
  • Familiarity with Databricks Genie and Genie Ontology
  • Knowledge of Unity Gateway or comparable governed data-access patterns
The impact you'll create
  • Design and develop the Enterprise Data Catalog application, including front-end and back-end components
  • Integrate the application with Unity Catalog APIs, Databricks services, metadata sources and external systems
  • Implement secure authentication, SSO, role-based and group-based authorisation, and user-context data access
  • Design high-performing metadata search, caching and indexing for a large user base
  • Implement CI/CD, automated testing, audit logging, monitoring and application observability
  • Support deployment, security and architecture reviews, troubleshooting and performance optimisation
  • Produce maintainable code, configuration and technical documentation, and provide knowledge transfer

People are at the core of Avenga. We provide equal opportunities regardless of race, ethnicity, gender identity, sexual orientation, disability, age, religion, or any other characteristic. We are committed to a respectful environment where everyone can be themselves, share their ideas, and feel that they belong.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior Backend Engineer(Ruby on Rails / Go)
Senior Backend Engineer(Ruby on Rails / Go)

Avenga • Köln

Presencial
EUR 70.000 - 110.000
Data Architect
Data Architect

Veritas Code • Alemania

Híbrido
EUR 90.000 - 140.000
Social benefits package
Mentorship program
Health insurance coverage
+2
Staff Data Engineer (Databricks specialist)
Staff Data Engineer (Databricks specialist)

Jobgether • Alemania

A distancia
EUR 150.000 - 190.000
Fully remote
Flexible hours
Global collaboration
Lead Data Engineer (Spark)
Lead Data Engineer (Spark)

Addepto • Alemania

A distancia
EUR 70.000 - 110.000
Remote work options
Training and conference sponsorship
Integration budget
+2
Senior Manager, AI Forward Deployed Engineering
Senior Manager, AI Forward Deployed Engineering

databricks • München

Presencial
EUR 180.000 - 280.000
Senior Staff Software Engineer - Delta
Senior Staff Software Engineer - Delta

Databricks Inc. • Berlin

Presencial
EUR 90.000 - 120.000
Comprehensive benefits
Inclusive culture
Manager, Forward Deployed Engineering
Manager, Forward Deployed Engineering

FDE Times • München

Híbrido
EUR 120.000 - 180.000
Staff Data Engineer (all genders)
Staff Data Engineer (all genders)

Eurowings Digital • Köln

Presencial
EUR 70.000 - 90.000
Sr. Solutions Architect - FSI
Sr. Solutions Architect - FSI

Databricks Inc. • München

Presencial
EUR 140.000 - 210.000
Manager, Forward Deployed Engineering
Manager, Forward Deployed Engineering

Neon • München

Presencial
EUR 140.000 - 190.000
Comprehensive benefits
Career growth opportunities
Remote-friendly travel support