We are looking for a Senior Data Engineer with Databricks to join our team. Our client is one of the largest state-owned energy companies and a leading producer and supplier of electricity and heat in Europe.
As a Senior Data Engineer, you will take part in setting standards, establishing guidelines, and sharing best practices in order to ensure continuous learning and development.
Core skills you'll bring
- 5+ years of experience as a Data Engineer
- Proficiency in Databricks Apps development experience using React, Node.js, Python, Streamlit or similar technologies
- Experience integrating with Unity Catalog APIs and metadata services.
- Proven experience implementing OAuth, Microsoft Entra ID, SSO, RBAC, and group-based authorisation
- Strong knowledge of Databricks SQL, Serverless SQL, Jobs, Lakehouse architecture and governance
- Familiarity with integrating external systems through REST APIs
- Experience with CI/CD, Git, and Azure DevOps or GitHub Actions
- English – Upper-intermediate or higher
Nice-to-have
- Experience with MCP / JSON-RPC integration patterns
- Familiarity with Databricks Genie and Genie Ontology
- Knowledge of Unity Gateway or comparable governed data-access patterns
The impact you'll create
- Design and develop the Enterprise Data Catalog application, including front-end and back-end components
- Integrate the application with Unity Catalog APIs, Databricks services, metadata sources and external systems
- Implement secure authentication, SSO, role-based and group-based authorisation, and user-context data access
- Design high-performing metadata search, caching and indexing for a large user base
- Implement CI/CD, automated testing, audit logging, monitoring and application observability
- Support deployment, security and architecture reviews, troubleshooting and performance optimisation
- Produce maintainable code, configuration and technical documentation, and provide knowledge transfer