Senior Data Engineer

Bloomberg; London; On-site; GBP 70,000 - 90,000; Full time

Job summary

A leading company in financial services is seeking a Data Engineer in London. You will design and develop scalable data pipelines, implement data transformations, and collaborate with teams to support data-driven decision-making. This role offers the opportunity to mentor junior engineers, fostering their professional growth.

Qualifications

• 7+ years of experience in data engineering or similar role.
• Proficiency in Python programming.
• Experience with building and managing data pipelines.

Responsibilities

• Design and develop scalable data pipelines using Python from APIs.
• Implement data transformations using Pandas and Pydantic.
• Provide mentorship and guidance to junior team members.

Skills

Python

Data pipelines

Data warehousing

ETL processes

Problem-solving

Communication

Tools

Pandas

Pydantic

Job description

Social network you want to login/join with:

• Design and develop scalable data pipelines using Python to read from APIs and structured files (Excel, Parquet).
• Translate domain and source specific business logic into efficient code implementations to turn source data into usable structured data for downstream applications.
• Implement data transformations and structuring using tools like Pandas and Pydantic to ensure data quality, consistency, and adherence to business logic requirements.
• Collaborate with data scientists and analysts to support data-driven decision-making.
• Document data engineering processes, including data lineage, data dictionaries, and system architectures
• Maintain best practices through code reviews, version control, and adherence to industry standards.
• Deploy production quality code through CI/CD pipelines into our cloud environment.
• Provide mentorship and guidance to junior team members, fostering their growth and development in data engineering practices.

Responsibilities

:

Design and develop scalable data pipelines using Python to read from APIs and structured files (Excel, Parquet).

Translate domain and source specific business logic into efficient code implementations to turn source data into usable structured data for downstream applications.

Implement data transformations and structuring using tools like Pandas and Pydantic to ensure data quality, consistency, and adherence to business logic requirements.

Collaborate with data scientists and analysts to support data-driven decision-making.

Document data engineering processes, including data lineage, data dictionaries, and system architectures

Maintain best practices through code reviews, version control, and adherence to industry standards.

Deploy production quality code through CI/CD pipelines into our cloud environment.

Provide mentorship and guidance to junior team members, fostering their growth and development in data engineering practices.

Qualifications

7+ years of experience in data engineering or a similar role.

Proficiency in Python programming.

Experience with building and managing data pipelines.

Knowledge of data warehousing and ETL processes.

Excellent problem-solving andmunication skills.

Job ID 3171_10043243