Senior Data Engineer - End-to-End Financial Pipelines PySpark

Pharos Resource Partners; England; On-site; GBP 75,000 - 110,000; Full time

Job summary

Pharos Resource Partners in the United Kingdom is seeking an experienced Data Engineer to design, build and operate data pipelines and models powering analytics across Investment teams and back-office functions.

You will own data end-to-end from ingestion of vendor sources to modelling in a lakehouse, ensuring discoverability, reliability and cost efficiency while collaborating with BAs/PMs and quants.

Qualifications

• Min 5 Years of experience in IT/Data within a financial services environment.
• Bachelor in IT or related field (mandatory).

Responsibilities

• Participate in requirements clarification and sprint planning sessions.
• Design technical solutions and implement them, inc ETL Pipelines.
• Build robust data pipelines in PySpark
• Optimize ETL Processes
• Writing unit and integration tests.
• Support QA teammates in the acceptance process.

Skills

PySpark

Python

SQL

Data Warehousing

ETL Tools

Data Modelling

Git

Data Pipeline Monitoring

Education

Bachelor's degree in IT or related field

Tools

DataBricks

Job description

Pharos Resource Partners in the United Kingdom is seeking an experienced Data Engineer to design, build and operate data pipelines and models powering analytics across Investment teams and back-office functions.

You will own data end-to-end from ingestion of vendor sources to modelling in a lakehouse, ensuring discoverability, reliability and cost efficiency while collaborating with BAs/PMs and quants.