Senior Data Engineer

GridBeyond Limited; Dublin; Hybrid; EUR 85,000 - 110,000; Full time

Benefits offered by this job

Competitive salary

Pension

Healthcare

Life cover

Job summary

GridBeyond Limited in Dublin is seeking a Senior Data Engineer to join our Data and Analytics IT Team. You will design, build and operate a Data Lake and Data Warehouse to serve Data Science and Business Management needs, integrating data from IoT sensors, CRM and billing systems.

The role uses Azure Data Platform, SQL Server and Power BI, with a focus on scalable, secure solutions and end-to-end data workflows. Hybrid work arrangement and exposure to energy sector projects are offered.

Qualifications

• 3+ years of professional data engineering experience.
• Experience with Azure/AWS cloud services (Azure preferred).
• Experience in data warehouse design using Kimball methodology.
• ETL tooling: SSIS and Azure Data Factory.
• Hands-on with SQL Server, Data Lake and Data Warehouse.
• Proficient with Python; Spark/Databricks a plus.
• Experience with Power BI and DAX.
• Knowledge of Azure security options and data governance.
• Ability to translate business requirements into scalable end-to-end data systems.
• Core technologies include SQL Server, Data Lake, Data Factory, Synapse.

Responsibilities

• Lead design and delivery of data solutions using Azure services.
• Build data platform to enable business growth and analytics.
• Collect and document technical requirements from stakeholders.
• Promote standards, process improvements and efficiency in data projects.

Skills

Azure Cloud

SQL

Python

Power BI

DAX

Big Data

ETL

Data Warehousing

Education

Third-level degree in Maths/Physics/Engineering/CS

Tools

Azure Data Factory

SSIS

Azure Data Lake

Azure Synapse

SQL Server

Power BI

Databricks

Spark

Job description

Reporting to: Chief Information Officer

Location: GridBeyond HQ: Citywest, Dublin

Company Overview

GridBeyond is an innovative Smart Grid company. We develop systems that aggregate end customer site assets as part of Virtual Powerplant, so they can take part in new energy services which facilitate the decarbonisation of the energy system. We optimise the use of our customers’ energy resources, using our in house developed software and hardware platform. Our system consists of embedded controllers with rich sensor data harvesting and control systems deployed on customer sites, and on the back end we have a suite of in house developed applications managing control, automation and data analytics up to customer facing visualisation and reporting tools.

GridBeyond is a leader in the evolving smart grid offering Load Shifting, Demand Response and Frequency Response services. The smart grid is the next generation electricity network. Its aim is to utilise any possible electricity producing or consuming resource connected to the grid, from small residential to large industrial loads, to ensure a flexible and adaptive response to the changing energy landscape. This fast paced and evolving area requires new solutions to be developed to meet the needs of the end customer and evolving energy grid.

As we move to the next level of growth and position ourselves for the future, we are growing our IT team.

Job Overview

We are seeking a Senior Data Engineer to join our Data and Analytics IT Team. This candidate will work in an agile development environment and build a Data Lake and Data Warehouse solution to meet the needs of Data Science and Business Management teams. The solution will integrate data from external sources, IOT sensors from GridBeyond’s install base and business data from CRM, Billing and other IT systems. This integrated data will be used by Data science teams to create and test solutions for energy optimization, energy trading and predictive fault detection. Moreover, the solution will be used to develop Power BI reports for internal and external stakeholders.

You will have an opportunity to contribute to GridBeyond’s Smart Grid Platform development through analysis, design, implementation and delivery of industry leading big data and data warehousing solutions. The solution will be developed using Azure’s Cloud services and the candidate should have hands on experience of using Azure Data Platform. Ideally the candidate would have gone through the whole development life cycle from design to implementation to production on Azure during his previous projects.

Main Responsibilities

• Leading the design and delivery of innovative data solutions using latest services from Azure eco-system.
• Exploiting industry best practices and your experience to create a data platform to enable business growth.
• Liaise with internal and external stakeholders in order to collect and document technical requirements.
• Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance and innovate solutions and improve process efficiency.

Required Experience and Skills

• A minimum of 3 years’ professional experience is required.
• Azure/AWS Experience (3+ years). Azure Data Certification a plus
• Experience with Data Warehouse design and Kimball methodology
• ETL experience using SSIS and Azure Data Factory
• Experience working with SQL Server, SQL Data Warehouse and Azure Data Lake
• SQL server schema design and optimization to meet performance requirements
• Python programming for Data engineering and clean up. Spark/Data bricks experience will be a plus
• Experience of working with Power BI and DAX programming.
• Good understanding and experience of working with data security options on Azure.
• Proven ability to translate complex business requirements into design of end-to-end data systems including scalability, HA and DR Technologies
• Technologies: SQL Server, data integration, ETL Design, Azure Data Lake, Azure Data Factory, Azure SQL Server and Azure Synapse
  Core Programming languages: T-SQL, Power Shell, Azure API, DAX

Desired Qualifications and Other Experience

• Previous experience working in the renewable energy sector.
• A minimum of a third level degree in Maths, Physics, Engineering, Computer Sciences or a related discipline
• Commercial experience in Data Warehousing and business intelligence projects.
• Experience in handling large and complex datasets using multiple programming languages (T-SQL, Python, R etc.) is essential
• Experience analysing multiple business domains and translating them to dimensional designs for analytics and reporting
• Basic knowledge of or exposure to machine learning, data visualisation, and artificial intelligence techniques.
• Experience working with Data Scientists and Machine Learning teams.
• Data governance experience desirable

The following experience would be advantageous but not essential:

Experience working in an energy related industry combined with a passion for energy sustainability and innovation

Term and Benefits

• Full Time - Hybrid (3 days in office)
• Agile workflow, two week sprints, code reviews
• Working alongside a highly motivated team
• Delivering cutting edge technology and services
• Competitive salary, pension, healthcare and life cover benefits
• The successful candidate will gain extensive knowledge and experience in the evolving Smart Grid and energy industries across multiple jurisdictions.