Senior Data Engineer: Build Secure, Scalable Data Pipelines

73 Strings SAS; City of Westminster; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

73 Strings SAS is seeking a Senior Data Engineer to design, build and operate the pipelines and warehouse that support valuation and monitoring. You will own production pipelines from source capture through transformation to client delivery, under GitHub, automated tests and CI/CD.

The role uses Azure Databricks, Snowflake and SQL Server, with data contracts, quality rules and lineage. You will evolve architecture across ingestion, processing and delivery for a scalable, secure data platform.

Qualifications

• 10+ years of data engineering experience on production systems.
• Snowflake or Databricks as a primary platform, with modelling, performance tuning and cost management.
• Python and SQL for pipeline development and testing.
• Experience with change data capture and event processing.
• Azure ecosystem including Databricks, ADLS and private network connectivity.
• GitHub and CI/CD for data workloads, using GitHub Actions or an equivalent system.
• Data quality, reconciliation, monitoring and production incident response.
• Experience building multi-tenant, secure data platforms with tenant isolation and data protection.

Responsibilities

• Redesign platform architecture across ingestion, processing and delivery for scalability and security.
• Build and operate batch and streaming pipelines from databases, APIs and event streams.
• Implement CDC and incremental load including ordering, deletes and slowly changing dimensions.
• Create medallion datasets and models delivered to Snowflake, SQL Server and Databricks.
• Apply data contracts and reconciliation before publication.
• Own GitHub workflow and CI/CD, including tests and environment promotion.
• Investigate production data issues and translate requirements into operable pipelines.

Skills

Data engineering

Production systems

Collaboration

Tools

Snowflake

Databricks

Azure Databricks

ADLS

GitHub Actions

CI/CD

SQL

Python

Kafka

Airflow

dbt

Job description

73 Strings SAS is seeking a Senior Data Engineer to design, build and operate the pipelines and warehouse that support valuation and monitoring. You will own production pipelines from source capture through transformation to client delivery, under GitHub, automated tests and CI/CD.

The role uses Azure Databricks, Snowflake and SQL Server, with data contracts, quality rules and lineage. You will evolve architecture across ingestion, processing and delivery for a scalable, secure data platform.