Data Engineer

Prevail; City Of London; On-site; GBP 60,000 - 80,000; Full time

Job summary

A strategic advisory firm in London is seeking a Data Engineer to establish data engineering capabilities. You will design data infrastructures, ensuring reliable and scalable data pipelines while collaborating with mission teams to convert data into actionable insights. The ideal candidate has strong experience in AWS services, modeling data systems, and excellent communication skills. The role offers competitive benefits and a supportive team environment.

Benefits

Gym Access & Wellness Discounts

Cycle to Work Scheme

Season Ticket Loans

Private Medical Insurance

Employee Assistance Programme

Enhanced Leave Entitlements

Professional Development Days

Pension Scheme

Values-led culture with social events

Qualifications

• Proven experience in building and maintaining data pipelines.
• Strong Python or other object-oriented programming language skills.
• Experience with data warehousing and ETL data pipelines.

Responsibilities

• Transform large datasets for mission teams.
• Identify improvements to data processes.
• Implement data flows for analytics and business intelligence.

Skills

Building data pipelines

Python programming

AWS services (EC2, S3, Lambda, ECS, Redshift)

ETL processes

Apache Spark or Databricks

Excellent communication skills

Education

Experience as AWS Solutions Architect or similar

Tools

Terraform

CloudFormation

Job description

The role:

We are looking for a Data Engineer to establish our internal data engineering capability and play a key role in designing and developing the data infrastructure and systems, ensuring that our data pipelines are reliable, scalable, and efficient.

Reporting into the Head of Data & Spatial Intelligence, you will be responsible for designing data infrastructure to support modelling and data analytics, with strong competence in Python, and work with stakeholders to understand their data needs and help design data solutions.

The Technology team within Prevail underpins all of our mission focused teams. No two days are the same and the real-world problems we seek to solve are complicated. You will get the opportunity to interact with a wide range of datasets and support both the wider tech team and mission teams turning this data into insights to drive our customers decision making. The team structure is flat with a network centric approach to leadership. A small team, we rely on strong communication and the ability to mutually support each other whilst working at pace.

Responsibilities/ deliverables:

These are the key things that you are responsible for delivering within your role. There will be activities and tasks in addition to this list that are expected from you but the majority of your time will be:

• Receiving large datasets and transforming them to enable our mission teams to rapidly exploit the data.
• Identifying improvements to our current data processes and implementing solutions.
• Implementing data flows to connect operational systems, data for analytics, and business intelligence systems
• Creation and development of data pipelines
• Documenting source-to-target mappings
• Re-engineering manual data flows to enable scaling and repeatable use
• Support the build of data streaming systems
• Build and maintain ETL scripts and pipelines and code to ensure the ETL process performs optimally and ensures data is accurate and easy to use
• Develop business intelligence reports that can be used for multiple audiences
• Build accessible data for analysis
• Automate data processing tasks and workflows
• Collaborate with cross functional teams to advocate for high-quality data solutions

You:

You will have previous proven experience:

• Building, modelling, and maintaining data pipelines
• With a range of Amazon Web Service products and technologies such as EC2, S3, Lambda, ECS and Redshift
• Designing data infrastructure to support modelling and data analytics
• As an AWS Solutions Architect or Lead, or similar
• Strong Python experience or other object oriented or a functional programming language such as Java, Scala, C#, or R
• Data warehousing – building operation ETL data pipelines across several sources, and constructing relation and dimensional data models
• Built and maintained scalable infrastructure through IaC frameworks (e.g., Terraform, CloudFormation) and CI/CD workflows
• If you have previous exposure to geospatial data, that would be advantageous but is not a requirement for the position.
• Familiarity with Apache Spark or Databricks
• Excellent communication and collaboration skills

About Prevail Partners

Prevail Partners delivers strategic advice, intelligence, specialist capabilities, and managed services to clients ranging from governments and multinational corporations to non-governmental organisations. Our services span Europe, the Middle East, and Africa.

We are united by a shared mission: to deliver Unrelenting Excellence in everything we do. That means operating with integrity, curiosity, accountability, and care.

What We Offer

At Prevail, we believe in recognising and rewarding our people. Our benefits are designed to support your wellbeing, development, and life beyond work:

• Gym Access & Wellness Discounts: Access to discounted memberships and gym facilities for London-based employees
• Cycle to Work Scheme: Tax-efficient savings on bikes and accessories, available post-probation
• Season Ticket Loans: Interest-free loans for annual commuting costs
• Private Medical Insurance: Fully funded cover through Vitality Health after two years’ service
• Employee Assistance Programme (EAP): Confidential mental health, legal, financial and wellbeing support via Health Hero
• Enhanced Leave Entitlements: Supporting you through important life moments with flexibility
• Professional Development Days: Dedicated time off to focus on your personal and professional growth through training, courses, or self-directed learning
• Pension Scheme: Access to a flexible defined contribution pension through NatWest Cushon, with a salary exchange option. Contributions start at 5% employee and 3% employer, with the potential to adjust based on your requirements and financial goals.
• Culture & Development: A values-led culture with regular social events, collaborative initiatives, and meaningful opportunities for personal and professional development