Senior Data Engineer (f/m/d)

TN Germany; Berlin; Remote; EUR 70.000 - 90.000; Vollzeit

Zusammenfassung

A leading company in the energy sector seeks a Data Engineer to enhance their data and AI capabilities. The role involves building enterprise-grade data pipelines and collaborating with architects to shape data architecture. Enjoy flexible working arrangements and numerous benefits including 30 holidays per year and opportunities for professional growth.

Leistungen

30 holidays per year

Work from home flexibility

Car and bike leasing

Company pension scheme

Salary exchange for more holidays

Qualifikationen

• At least 5 years of experience in building enterprise-grade Python data pipeline applications.
• Experience with AWS Data Engineering services and Azure.

Aufgaben

• Integrate cross-cloud Data Platforms using Data Mesh and Data Fabric architecture.
• Build robust data pipeline applications with AWS and Azure data services.

Kenntnisse

Python

Data Engineering

Communication

Tools

AWS

Azure

Databricks

GitLab

Terraform

Jobbeschreibung

About the team

The chapter Technology & Engineering - Data & AI Engineering represents experts delivering data and AI engineering capabilities to our product teams. They focus on enhancing functional skillsets, improving E.ON’s MLOps & AIOps tech stack, and delivering high levels of data delivery & model automation.

The products you will work on belong to our team Digital Solutions | Future Energy Home. This team develops and operates software to manage home energy devices such as photovoltaic systems, inverters, batteries, EV charging stations, heat pumps, and meters as a cloud-based solution for our units to deploy to end-customers. We integrate with various vendors’ devices and apply centralized insights, analytics, and control mechanisms.

Meaningful & challenging - Your tasks

1. Integrate cross-cloud Data Platforms (AWS & Azure), using Data Mesh and Data Fabric architecture concepts.
2. Implement data sharing interfaces or connectors to share business data (e.g., solar telemetry, electric vehicle charging data) with regional data consumers.
3. Build robust data pipeline applications with AWS and Azure data services, applying software principles such as Clean Code and SOLID.
4. Collaborate closely with Data Solutions Architects to shape overarching Data Architecture for data sharing interfaces and connectors.
5. Mentor and coach colleagues, conduct pair programming sessions, review merge requests, and actively contribute to the „Community of Practice“.

Authentic & ambitious - Your profile

• At least 5 years of experience in building enterprise-grade Python data pipeline (ETL) applications using best practices in AWS/Azure.
• At least 3 years of experience with relevant AWS Data Engineering services (e.g., Athena, Lambda, Glue, IAM, CloudWatch) and background in Azure.
• Profound knowledge in Databricks (e.g., PySpark), Snowflake, Python Pandas, Pytest, and Behave.
• Experience in building DataOps pipelines with GitLab, CloudFormation, Terraform, or CDK, and orchestration tools like AWS Step Functions.
• Preferable experience in Data Modelling concepts such as Data Vault 2.0 and Dimensional Data Modelling.
• Excellent communication skills and the ability to mentor and coach developers.

We provide full flexibility: Work from home or any location in Germany, including offices from Hamburg to Munich. Up to 20 days per year of workation within Europe.

Recharge your battery: 30 holidays per year plus Christmas and New Year’s Eve. Additional options include salary exchange for more holidays or a sabbatical.

Your development: Opportunities for growth through on-the-job learning, training, and knowledge exchange.

Let’s empower each other: Engage in Digital Empowerment Communities for collaboration and networking.

We elevate your mobility: Car and bike leasing, subsidized Deutschland-Ticket.

Think ahead: Company pension scheme and insurance packages.

And much more: Further benefits will be discussed during the recruiting process.