Lead Data Engineer

EPAM Systems; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Employee Stock Purchase Plan (ESPP)

Private medical insurance

Pension plan

Commute/season ticket loans

Job summary

EPAM Systems in London is seeking a Lead Data Engineer to design and implement data foundations and end-to-end data solutions within a hybrid work setup. You will mentor junior engineers and drive data strategy across IT and business units.

You will collaborate with cross-functional teams, leverage cloud data services, and deliver impactful data programs with a focus on reliability, performance, and value for energy trading and related sectors.

Qualifications

• 8+ years of experience in data engineering and related domains.
• Experience with AWS or Azure cloud platforms and data tools.
• Strong communication skills for technical and business audiences.

Responsibilities

• Design and build data foundations and end-to-end data solutions.
• Create a data-driven mindset across IT and business stakeholders.
• Mentor junior engineers and champion data best practices.
• Convert data strategy into IT solutions and deliver results.
• Lead and coordinate data foundation initiatives and projects, including change, incident and problem management.
• Present reports and findings to stakeholders as data analysis experts.

Skills

ELT

Data modeling

Data integration

Data manipulation

GitHub Actions

Azure DevOps

Data platforms

Communication

Hybrid teamwork

Scrum / project management

Tools

Azure Data Factory

Databricks

SQL Database

Synapse Analytics

Stream Analytics

AWS Glue

Airflow

Kinesis

Redshift

SonarQube

PyTest

Job description

We're looking for a Lead Data Engineer to join our team in London in a hybrid working mode. If you thrive on building connections across disciplines and shaping how organizations use data, this role puts you at the center of change. You will influence how data-driven thinking takes hold beyond IT, reaching into every business decision. The work matters because reliable, accessible data is what keeps the business moving forward.ResponsibilitiesDesign and build data foundations and end-to-end solutions to maximize value from dataCreate a data-driven mindset within both IT and business stakeholder communitiesServe as a subject matter expert and mentor junior engineersConvert vision and data strategy into IT solutions and deliver resultsDeliver and embed Data Foundation initiatives to support key business programsCoordinate change management, incident management and problem management processesPresent reports and findings to key stakeholders as the subject matter expert on data analysis and designDrive implementation efficiency and effectiveness across pilots and future projects to minimize cost, increase speed and maximize valueRequirementsMinimum 8+ years of experience in data engineeringTechnology expertise in AWS or AzureStrong proficiency in ELT processesStrong proficiency in data modelingSkill in data integration and ingestionSkill in data manipulation and processingProficiency with GitHub Actions and Azure DevOpsExperience with data platforms and tools such as Azure Data Factory, Databricks, SQL Database, Synapse Analytics, Stream Analytics, AWS Glue, Airflow, Kinesis, Redshift, SonarQube and PyTestExperience in commodity trading and supply operations, ideally within the energy sectorStrong communication skills with both technical and business audiences and ability to work effectively in hybrid teamsNice to haveExperience in project management or running a scrum teamExperience working with BPC or PlanningExposure to working with external technical ecosystemsExperience with MKDocs documentationWe offerEPAM Employee Stock Purchase Plan (ESPP)Protection benefits including life assurance, income protection and critical illness coverPrivate medical insurance and dental careEmployee Assistance ProgramCompetitive group pension planCyclescheme, Techscheme and season ticket loansVarious perks such as free Wednesday lunch in-office, on-site massages and regular social eventsLearning and development opportunities including in-house training and coaching, professional certifications, and coursesIf otherwise eligible, participation in the discretionary annual bonus programIf otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program