Data Engineer

Rimes; Greater London; On-site; GBP 70,000 - 110,000; Full time

Benefits offered by this job

AXA Gym Membership Discount

Healthshield Cashback plan

Healthshield Perks platform (Breeze)

MetLife Afterlife Support

Metalife GP 24 hour virtual GP service

Annual 'purchase holiday' scheme

Chubbs Travel Insurance

Group Income Protection scheme

Death in Service Funds

Referral bonus

Job summary

Rimes is seeking a Data Engineer to actively participate in building and modernising the data platform that underpins our data ecosystem. You will work with the Data Engineering Team Lead to shape the platform roadmap and deliver scalable, reusable data pipelines.

The role focuses on performance, quality assurance, and automation, with exposure to Snowflake, Databricks, and AI-assisted development. Collaboration with product, onboarding, quality, and operations is essential.

Qualifications

• 3–5 years hands-on experience in data engineering or a closely related discipline.
• Experience building shared tooling, frameworks, or reusable components, not only end-to-end pipelines.
• Experience with financial or enterprise data environments is a plus.

Responsibilities

• Platform Development and Modernisation: Transform the data platform using Snowflake and Databricks to improve scalability and efficiency.
• Tooling and Automation: Build tooling for ingestion and data quality checks; automate repetitive tasks to reduce toil.
• Data Model Design: Create scalable, reusable data models for financial data across use cases.
• Hands-On Engineering: Code, review, and share knowledge; contribute to engineering excellence.
• Operational Efficiency: Reduce costs and improve reliability across data pipelines and ingestion.
• Collaboration: Work with Product, Data Onboarding, Data Quality, and Operations to meet business needs.

Skills

Python

SQL

Databricks & Spark

Cloud Data Platforms

Orchestration

Cloud Infrastructure

DevOps & CI/CD

Data Quality

AI-Assisted Development

Tools

Airflow

Git

Docker

Dagster

Prefect

Snowflake

Job description

About Rimes

Rimes provides the Intelligence Fabric for Capital Markets, a trusted data network and intelligence architecture that transforms fragmented data, operations and workflows into decision-grade intelligence. The world's leading institutional investors, asset managers, and service providers rely on Rimes to help them make better investment decisions that power more than US$ 75 trillion in AUM annually.

The Opportunity

Rimes is looking for a Data Engineer to actively participate in building and modernising the data platform that underpins our entire data ecosystem. You will work alongside the Data Engineering Team Lead, who sets overall direction and owns the platform roadmap, contributing hands‑on engineering across platform development, tooling, data modelling, and operational improvement. The core of this role is building reusable, scalable capabilities that allow the team to craft high‑quality financial data pipelines efficiently, rather than building pipelines one by one. We are also looking for engineers curious about agentic AI workflows and how they can automate and enhance the way data platforms operate.

Core Responsibilities

• Platform Development and Modernisation: Actively participate in the transformation of our existing data platform and pipelines, leveraging modern technologies such as Snowflake and Databricks to improve scalability, performance, and efficiency.
• Tooling and Automation: Build and extend tooling to support the seamless ingestion and quality assurance of financial data. Automate repetitive or error‑prone processes to reduce manual intervention and improve operational efficiency across the data engineering workflow.
• Data Model Design: Contribute to the design and implementation of scalable, reusable data models for financial data, ensuring the data architecture supports a wide range of business use cases. Work within the standards and patterns set by the team to maximise consistency and the long‑term value of the company's data products.
• Hands‑On Engineering: Play an active role in day‑to‑day engineering tasks, coding, reviewing, and designing complex data solutions. Share knowledge and best practices with peers through code review and technical discussion, contributing to a culture of engineering excellence without a formal management remit.
• Operational Efficiency: Take part in efforts to minimise the operational costs of data ingestion and pipeline support. Identify and implement optimisations in both technical workflows and the processes used by support personnel, reducing toil and improving reliability.
• Collaboration: Work closely with cross‑functional teams including Product, Data Onboarding, Data Quality, and Operations to ensure data engineering solutions meet both technical and business needs. Communicate clearly about trade‑offs, timelines, and dependencies.
• Financial Data: Apply an understanding of financial data pricing, benchmarks, reference data, corporate actions, to ensure that data models, pipelines, and tooling are optimised for the characteristics and compliance requirements of this domain.
• Agentic Workflows: Explore and prototype agentic workflow patterns where autonomous agents can trigger, monitor, or adapt data pipelines based on data signals or events. Stay current with emerging LLM‑based tooling and bring relevant ideas to the team, integrating them where they add measurable value to platform automation.

Requirements

Core Experience

• 3–5 years of hands‑on experience in data engineering or a closely related discipline.
• Demonstrated experience building shared tooling, frameworks, or reusable components, not only end‑to‑end pipelines.
• Experience working with financial or enterprise data environments is a plus.

Technical Skills

• Python: Strong proficiency; comfortable writing production‑quality, well‑tested code.
• SQL: Advanced SQL for data modelling, query optimisation, and analytical work.
• Databricks & Apache Spark: Hands‑on, mandatory experience with Databricks and Spark for large‑scale distributed data processing, including Delta Lake, Spark SQL, and cluster optimisation.
• Cloud Data Platforms: Experience with Snowflake or equivalent cloud warehouses (BigQuery, Redshift, Synapse) alongside Databricks.
• Orchestration: Working knowledge of at least one workflow orchestrator Airflow, Prefect, or Dagster.
• Cloud Infrastructure: Practical experience on AWS, Azure, or GCP object storage, compute, serverless, IAM.
• DevOps & CI/CD: Comfortable with Git, Docker, and CI/CD pipelines for data platform deployments.
• Data Quality: Experience implementing data quality checks, schema validation, or contract testing.
• AI‑Assisted Development: Proficient in using AI coding tools such as GitHub Copilot and Claude to accelerate development, generate boilerplate, review code, and navigate complex codebases. Comfortable integrating these tools into a daily engineering workflow.

Nice to Have

• Hands‑on experience with agentic AI frameworks (LangChain, LlamaIndex, AutoGen, CrewAI, or the Anthropic Agent SDK).
• Knowledge of streaming data processing (Kafka, Kinesis, or Flink).
• Exposure to financial data types pricing, reference data, benchmarks, indices, or corporate actions.
• Experience with metadata catalogues (Unity Catalog, DataHub, OpenMetadata, Alation, or similar).
• Familiarity with data contract patterns.

What we Offer

• AXA Gym Membership Discount
• Healthshield Cashback plan
• Healthshield Perks platform (Breeze)
• MetLife Afterlife Support
• Metalife GP 24 hour virtual GP service
• Annual 'purchase holiday' scheme
• Chubbs Travel Insurance
• Group Income Protection scheme
• Death in Service Funds
• Referral bonus

Only selected candidates will be contacted for interviews. We appreciate your understanding. Thank you for considering a career with us.

Rimes is committed to promote the values of diversity and inclusion throughout the business. Whether it's through recruitment, retention, career progression or training and development, we are committed to improving opportunities for people regardless of their background or circumstances.

Visit our Careers page to see our complete listings.