Senior Data Engineer — Databricks, AI Tools, Equity

Hidden Road; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Bonuses and equity

Professional development budget

Mobile phone stipend

Generous vacation policy

Job summary

Ripple is seeking a Senior Software Engineer in London to help shape the Caspian Data Platform. You will architect and deliver production-grade data pipelines powering analytics for multiple business units, including finance and payments.

You will own end‑to‑end data modeling and pipeline design, drive architecture decisions, and ensure robust observability. A hybrid, collaborative environment offers growth and impact.

Qualifications

• 5–8 years of hands-on data engineering experience building and maintaining production pipelines and data models.
• Deep proficiency with Databricks or similar platforms — Delta Live Tables, Unity Catalog, Delta Lake, and PySpark or Spark SQL as primary tools.
• Strong SQL skills: complex transformations, incremental materialization, schema evolution, and data quality validation.
• Solid AWS experience relevant to building and operating data systems at scale.
• Proficiency in Python for data engineering — ingestion, transformation, testing, and utility tooling.
• Experience with CI/CD tooling such as GitLab and infrastructure‑as‑code with Terraform.
• Exposure to AI tooling in a data context — whether building agents, using LLMs for code generation, or enabling self‑serve analytics workflows.
• The ability to take ambiguous requirements, define the right data model and pipeline design, and deliver with minimal oversight.

Responsibilities

• Design, build, and operate production ETL pipelines on Databricks using Delta Live Tables and Spark, applying medallion architecture patterns across Finance, Payments, Product, and GTM domains.
• Own data modeling in different layers — defining governed, reusable table structures that serve as reliable sources of truth for business metrics and downstream consumption.
• Drive technical design for projects spanning multiple teams, writing clear design documents that articulate architecture, tradeoffs, and rollout plans.
• Build pipeline observability into your work — failure detection, alerting, retry logic, and the operational hygiene that keeps oncall burden low.
• Integrate AI tooling into data workflows: agentic systems for pipeline triage, automated code generation for transformations, and natural language interfaces for data access.
• Mentor engineers, reviewing their code and designs and helping them grow into more complex ownership.
• Contribute to platform infrastructure through Terraform, and work with Unity Catalog to establish data contracts, access controls, and lineage.

Skills

Databricks

Delta Live Tables

Unity Catalog

PySpark

Spark SQL

SQL

AWS

Python

Terraform

CI/CD

Tools

Fivetran

Job description

Ripple is seeking a Senior Software Engineer in London to help shape the Caspian Data Platform. You will architect and deliver production-grade data pipelines powering analytics for multiple business units, including finance and payments.

You will own end‑to‑end data modeling and pipeline design, drive architecture decisions, and ensure robust observability. A hybrid, collaborative environment offers growth and impact.