Senior Data Engineer

GridBeyond; Dublin; Hybrid; EUR 85,000 - 120,000; Full time

Job summary

GridBeyond in Ireland is seeking a Senior Data Engineer to design and implement a Data Lake and Data Warehouse to support Data Science and Business Management teams.

You will integrate data from IoT sensors, CRM, Billing, and other IT systems, using Azure Data Platform services and Power BI for reporting.

Join an agile team focused on energy optimization and predictive analytics, with opportunities to shape data strategy across the organisation.

Qualifications

• Minimum 3 years’ professional data engineering experience.
• Experience with Azure or AWS (3+ years); Azure Data Certification a plus.
• Experience with data warehouse design using Kimball methodology.
• ETL experience with SSIS and Azure Data Factory.
• Experience with SQL Server, SQL Data Warehouse, and Azure Data Lake.
• Python programming for data engineering; Spark/Databricks a plus.
• Power BI and DAX experience.
• Understanding of data security options on Azure.
• Ability to translate complex business requirements into scalable data systems.

Responsibilities

• Lead design and delivery of innovative data solutions on Azure.
• Collaborate with stakeholders to collect and document requirements.
• Develop a data lake/warehouse to support data science and BI.
• Deliver Power BI reports for internal and external stakeholders.

Skills

Data engineering

Problem solving

Team collaboration

Education

Bachelor's/ Master's in Maths, Physics, Engineering, Computer Science or related field

Tools

Azure

Azure Data Factory

SSIS

SQL Server

Power BI

Python

Spark/Databricks

Job description

Location: GridBeyond HQ: Citywest, Dublin

Company Overview

GridBeyond is an innovative Smart Grid company. We develop systems that aggregate end customer site assets as part of Virtual Powerplant, so they can take part in new energy services which facilitate the decarbonisation of the energy system. We optimise the use of our customers’ energy resources, using our in house developed software and hardware platform. Our system consists of embedded controllers with rich sensor data harvesting and control systems deployed on customer sites, and on the back end we have a suite of in house developed applications managing control, automation and data analytics up to customer facing visualisation and reporting tools.

GridBeyond is a leader in the evolving smart grid offering Load Shifting, Demand Response and Frequency Response services. The smart grid is the next generation electricity network. Its aim is to utilise any possible electricity producing or consuming resource connected to the grid, from small residential to large industrial loads, to ensure a flexible and adaptive response to the changing energy landscape. This fast paced and evolving area requires new solutions to be developed to meet the needs of the end customer and evolving energy grid.

As we move to the next level of growth and position ourselves for the future, we are growing our IT team.

Job Overview

We are seeking a Senior Data Engineer to join our Data and Analytics IT Team. This candidate will work in an agile development environment and build a Data Lake and Data Warehouse solution to meet the needs of Data Science and Business Management teams. The solution will integrate data from external sources, IOT sensors from GridBeyond’s install base and business data from CRM, Billing and other IT systems. This integrated data will be used by Data science teams to create and test solutions for energy optimization, energy trading and predictive fault detection. Moreover, the solution will be used to develop Power BI reports for internal and external stakeholders.

You will have an opportunity to contribute to GridBeyond’s Smart Grid Platform development through analysis, design, implementation and delivery of industry leading big data and data warehousing solutions. The solution will be developed using Azure’s Cloud services and the candidate should have hands on experience of using Azure Data Platform. Ideally the candidate would have gone through the whole development life cycle from design to implementation to production on Azure during his previous projects.

Main Responsibilities

• Leading the design and delivery of innovative data solutions using latest services from Azure eco-system.
• Exploiting industry best practices and your experience to create a data platform to enable business growth.
• Liaise with internal and external stakeholders in order to collect and document technical requirements.
• Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance and innovate solutions and improve process efficiency.

Required Experience and Skills

• A minimum of 3 years’ professional experience is required.
• Azure/AWS Experience (3+ years). Azure Data Certification a plus
• Experience with Data Warehouse design and Kimball methodology
• ETL experience using SSIS and Azure Data Factory
• Experience working with SQL Server, SQL Data Warehouse and Azure Data Lake
• SQL server schema design and optimization to meet performance requirements
• Python programming for Data engineering and clean up. Spark/Data bricks experience will be a plus
• Experience of working with Power BI and DAX programming.
• Good understanding and experience of working with data security options on Azure.
• Proven ability to translate complex business requirements into design of end-to-end data systems including scalability, HA and DR Technologies

Desired Qualifications and Other Experience

• Previous experience working in the renewable energy sector.
• A minimum of a third level degree in Maths, Physics, Engineering, Computer Sciences or a related discipline
• Commercial experience in Data Warehousing and business intelligence projects.
• Experience in handling large and complex datasets using multiple programming languages (T-SQL, Python, R etc.) is essential
• Experience analysing multiple business domains and translating them to dimensional designs for analytics and reporting
• Basic knowledge of or exposure to machine learning, data visualisation, and artificial intelligence techniques. Experience working with Data Scientists and Machine Learning teams.

The following experience would be advantageous but not essential:

• Experience working in an energy related industry combined with a passion for energy sustainability and innovation

Term and Benefits

• Full Time - Hybrid (3 days in office)
• Working alongside a highly motivated team
• Delivering cutting edge technology and services
• Competitive salary, pension, healthcare and life cover benefits
• The successful candidate will gain extensive knowledge and experience in the evolving Smart Grid and energy industries across multiple jurisdictions.