Data Engineer-Data Flows

Vallum Associates; London; Hybrid; GBP 40,000 - 80,000; Full time

Job description

Job Title: Data Engineer (Data Flows)

Location: London - 2 days/week

Duration: Permanent

Energy Sector Client Experience Required

Job Description

We are seeking a Data Engineer with a strong emphasis on energy industry expertise to join our dynamic team. This role is ideal for candidates who possess deep knowledge of energy sector operations, data flows, and business processes, while being adept at applying this industry insight to support data-driven decision-making. The successful candidate will bridge the gap between technical data management and energy sector strategy, enabling the organization to leverage data as a critical asset.

As a Data Engineer, you’ll be part of an Agile and skilled team of other engineers and analysts working on delivering best-in-class data solutions for our customers. Working with powerful data processing technologies, you will combine the power of your industry knowledge and industry data flows with the full capabilities of AWS, creating the ultimate data services platform.

Responsibilities

1. Work as part of a cross-functional team to design, develop and deploy complex data solutions.
2. Provide expert technical advice and recommend solutions to the development resources in the planning, strategizing, and execution of high-profile and complex data processing initiatives.
3. Consistently develop with performance in mind to optimize end-user experience.
4. Work with architects and senior team members to identify new tools and technologies where applicable to expand customer offerings.
5. Research and take advantage of new technology to improve and expand solutions.
6. Participate in peer code reviews, troubleshoot and correct software defects.
7. Work with the internal testing team to ensure appropriate testing is built into the development and ongoing delivery.
8. Develop efficient queries to retrieve appropriate datasets from relational databases.
9. Design, implement and maintain performance of reliable data pipelines and integrations that feed various applications, using both structured and unstructured data.
10. Create, implement, and maintain data transformation processes.

Skills & Knowledge You Will Need:

1. Proven experience in the energy sector with a focus on data-driven projects.
2. Strong understanding of energy industry concepts, terminology, and key performance indicators.
3. Energy Industry Knowledge, specifically around D-Flows, their purpose and content.
4. Familiarity with data analysis tools and visualization platforms (e.g., Power BI, Tableau) is a plus, but core technical programming skills are secondary to industry knowledge.
5. SQL coding skills.
6. Ability to translate complex energy datasets into actionable insights for non-technical stakeholders.
7. Excellent communication and collaboration skills, with the ability to work effectively across multidisciplinary teams.
8. Experience with cloud computing such as Azure or AWS.

Nice to Have:

1. Experience in data modeling.
2. Experience of working with large datasets.
3. Experience with cloud computing such as Azure or AWS.
4. SDLC or Product Development experience.
5. Pentaho Experience.
6. Knowledge of BI tools such as Tableau.
7. Python in Data Engineering Experience.
8. Vertica Experience.
9. Experience with developing REST APIs and microservices.
10. Experience in relational database design.

Contact:

Priyanka Sharma

Senior Delivery Consultant

Office: 020 3375 9240

Email: [email protected]