Senior Data Engineer - Databricks & AI Pipelines

Jackalope Digital LLC; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Competitive salary

Bonuses

Equity

Healthcare benefits

Retirement plan

Family planning

Family support

Employee giving match

Mobile stipend

R&R days

Wellness reimbursements

Parental leave

Job summary

Ripple is hiring a data engineer to design and run production ETL pipelines on Databricks, owning data models and governance across multiple domains. You will drive architectural designs, implement robust observability, and mentor peers while integrating AI tooling into data workflows.

You will work with Terraform and Unity Catalog to enforce data contracts and access controls, applying medallion architecture and scalable solutions in a high-growth environment.

Qualifications

• 5–8 years of hands‑on data engineering experience building and maintaining production pipelines and data models.
• Deep proficiency with Databricks or similar platforms — Delta Live Tables, Unity Catalog, Delta Lake, and PySpark or Spark SQL as primary tools.
• Strong SQL skills: complex transformations, incremental materialization, schema evolution, and data quality validation.

Responsibilities

• Design, build, and operate production ETL pipelines on Databricks using Delta Live Tables and Spark, applying medallion architecture patterns across Finance, Payments, Product, and GTM domains.
• Own data modeling in different layers — defining governed, reusable table structures that serve as reliable sources of truth for business metrics and downstream consumption.
• Drive technical design for projects spanning multiple teams, writing clear design documents that articulate architecture, tradeoffs, and rollout plans.
• Build pipeline observability into your work — failure detection, alerting, retry logic, and the operational hygiene that keeps oncall burden low.
• Integrate AI tooling into data workflows: agentic systems for pipeline triage, automated code generation for transformations, and natural language interfaces for data access.
• Mentor engineers, reviewing their code and designs and helping them grow into more complex ownership.
• Contribute to platform infrastructure through Terraform, and work with Unity Catalog to establish data contracts, access controls, and lineage.

Skills

Databricks

Delta Live Tables

Unity Catalog

PySpark / Spark SQL

SQL

AWS

Python

GitLab CI/CD

Terraform

AI tooling in data context

Data modeling

Mentoring

Tools

Terraform

GitLab CI/CD

Delta Lake

Job description

Ripple is hiring a data engineer to design and run production ETL pipelines on Databricks, owning data models and governance across multiple domains. You will drive architectural designs, implement robust observability, and mentor peers while integrating AI tooling into data workflows.

You will work with Terraform and Unity Catalog to enforce data contracts and access controls, applying medallion architecture and scalable solutions in a high-growth environment.