Senior Data Engineer

Bloomberg L.P.; Greater London; On-site; GBP 70,000 - 90,000; Full time

Job summary

A leading financial data provider in London is looking for a Senior Data Engineer to enhance and maintain scalable data pipelines for its Net-Zero Data Public Utility. The role demands extensive experience in data engineering, proficiency in Python, and the ability to manage data transformations. You will work closely with cross-functional teams to ensure data integrity and drive data quality, while mentoring junior engineers. Join a diverse, inclusive company committed to equal opportunities in a supportive work environment.

Qualifications

• Proficiency in Python programming is required.
• Experience with building and managing data pipelines is essential.
• Knowledge of data warehousing and ETL processes is necessary.

Responsibilities

• Design and develop scalable data pipelines using Python.
• Translate business logic into code implementations.
• Collaborate with data scientists to support data-driven decisions.
• Document data engineering processes.

Skills

Python programming

Data pipeline management

Problem-solving

Communication skills

Education

7+ years of experience in data engineering or a similar role

Tools

Pandas

Pydantic

Job description

Senior Data Engineer

Location: London

Business Area: Engineering and CTO

Ref #: 10043243

Description & Requirements

The NZDPU Tech Team is actively searching for an experienced Senior Data Engineer to play a pivotal role in the design, implementation, enhancement, and maintenance of scalable data pipelines for the Net‑Zero Data Public Utility. These pipelines are essential for the Utility's mission of providing open and accessible public good data through both the NZDPU website and APIs.

A successful candidate will face the challenge of working with data originating from a wide array of sources, each with its own formats, fields, and access protocols. Your responsibilities will encompass the full data lifecycle from the extraction of data from sources, transforming it according to source and domain specific business logic, and pushing it through the Utility’s ingestion process. Additionally, you will be expected to implement data quality checks and validation procedures to ensure the accuracy and reliability of the data provided by the Utility.

Responsibilities:

• Design and develop scalable data pipelines using Python to read from APIs and structured files (Excel, Parquet).


• Translate domain and source specific business logic into efficient code implementations to turn source data into usable structured data for downstream applications.


• Implement data transformations and structuring using tools like Pandas and Pydantic to ensure data quality, consistency, and adherence to business logic requirements.


• Collaborate with data scientists and analysts to support data‑driven decision‑making.


• Document data engineering processes, including data lineage, data dictionaries, and system architectures.


• Maintain best practices through code reviews, version control, and adherence to industry standards.


• Deploy production quality code through CI/CD pipelines into our cloud environment.


• Provide mentorship and guidance to junior team members, fostering their growth and development in data engineering practices.

Qualifications

• 7+ years of experience in data engineering or a similar role.


• Proficiency in Python programming.


• Experience with building and managing data pipelines.


• Knowledge of data warehousing and ETL processes.


• Excellent problem‑solving and communication skills.

Discover what makes Bloomberg unique – watch our for an inside look at our culture, values, and the people behind our success.

Bloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.

Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process. If you would prefer to discuss this confidentially, please email [e-mail]