Senior Data Engineer

73 Strings SAS; City of Westminster; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

73 Strings SAS is seeking a Senior Data Engineer to design, build and operate the pipelines and warehouse that support valuation and monitoring. You will own production pipelines from source capture through transformation to client delivery, under GitHub, automated tests and CI/CD.

The role uses Azure Databricks, Snowflake and SQL Server, with data contracts, quality rules and lineage. You will evolve architecture across ingestion, processing and delivery for a scalable, secure data platform.

Qualifications

• 10+ years of data engineering experience on production systems.
• Snowflake or Databricks as a primary platform, with modelling, performance tuning and cost management.
• Python and SQL for pipeline development and testing.
• Experience with change data capture and event processing.
• Azure ecosystem including Databricks, ADLS and private network connectivity.
• GitHub and CI/CD for data workloads, using GitHub Actions or an equivalent system.
• Data quality, reconciliation, monitoring and production incident response.
• Experience building multi-tenant, secure data platforms with tenant isolation and data protection.

Responsibilities

• Redesign platform architecture across ingestion, processing and delivery for scalability and security.
• Build and operate batch and streaming pipelines from databases, APIs and event streams.
• Implement CDC and incremental load including ordering, deletes and slowly changing dimensions.
• Create medallion datasets and models delivered to Snowflake, SQL Server and Databricks.
• Apply data contracts and reconciliation before publication.
• Own GitHub workflow and CI/CD, including tests and environment promotion.
• Investigate production data issues and translate requirements into operable pipelines.

Skills

Data engineering

Production systems

Collaboration

Tools

Snowflake

Databricks

Azure Databricks

ADLS

GitHub Actions

CI/CD

SQL

Python

Kafka

Airflow

dbt

Job description

OVERVIEW OF 73 STRINGS:

73 Strings is an innovative platform providing comprehensive data extraction, monitoring, and valuation solutions for the private capital industry. The company's AI-powered platform streamlines middle-office processes for alternative investments, enabling seamless data structuring and standardization, monitoring, and fair value estimation at the click of a button. 73 Strings serves clients globally across various strategies, including Private Equity, Growth Equity, Venture Capital, Infrastructure and Private Credit.

Our 2025 $55M Series B, the largest in the industry, was led by Goldman Sachs, with participation from Golub Capital and Hamilton Lane, with continued support from Blackstone, Fidelity International Strategic Ventures and Broadhaven Ventures.

About the role

We are hiring a Senior Data Engineer to build and operate the pipelines, integrations and warehouse that support valuation and monitoring.

You will own production pipelines from source capture through transformation, reconciliation and client delivery, and put them under GitHub, automated test and CI/CD. The platform currently captures change data from relational systems, processes it on Azure Databricks, and delivers it to Snowflake, Microsoft SQL Server and Databricks. The capture method may change. Copied client pipelines are being replaced by metadata-driven components, with data contracts, quality rules and lineage.

What you will do

• Help redefine the platform’s architecture across ingestion, processing and delivery, so it’s stable, secure and fast enough to support advanced use cases for the business.
• Build and operate batch and streaming pipelines from databases, APIs, event streams and semi-structured sources.
• Implement change data capture and incremental load, including ordering, deletes, replay and slowly changing dimensions.
• Build medallion datasets and dimensional models, and deliver them to Snowflake, Microsoft SQL Server and Databricks.
• Apply data contracts, reconciliation and row-level quarantine before publication.
• Own the GitHub workflow and CI/CD, including tests, review, environment promotion and deployment as code.
• Investigate production data failures, and turn requirements from product, valuation and client-facing teams into operable pipelines.

Requirements

• 10+ years in data engineering on production systems.
• Snowflake or Databricks as a primary platform, including modelling, performance tuning and cost management.
• Python and SQL for pipeline development and testing.
• Change data capture and event processing, including ordering, replay and schema change.
• Azure, including Databricks, ADLS and private network connectivity.
• GitHub and CI/CD for data workloads, using GitHub Actions or an equivalent system.
• Data quality, reconciliation, monitoring and production incident response.
• Experience building multi-tenant, secure data platforms, including tenant isolation, access control and data protection.

Desirable

• Databricks Lakeflow, Auto CDC, Declarative Automation Bundles and DQX, or the Snowflake equivalents: Dynamic Tables, Streams and Tasks, Snowpark, Snowflake CLI deployments and Data Metric Functions.
• Debezium, Kafka Connect or Confluent Kafka. This is the current ingestion path. It may be replaced.
• Apache Airflow, or an equivalent workflow orchestrator.
• Kafka or Spark Structured Streaming, Apache Iceberg or Delta Sharing, and dbt for analytical models on curated data.
• Private markets data: valuations, funds, portfolio companies or capital activity.
• Comfortable working directly with client technical teams, and collaborating across field engineering, product and other stakeholders.