Senior Data Engineer - Build Scalable Pipelines & Valuation

73 Strings SAS; Greater London; In loco; GBP 90.000 - 130.000; Tempo pieno

Descrizione del lavoro

73 Strings SAS is seeking a Senior Data Engineer to design and operate pipelines and warehousing that support valuation and monitoring. You will own production pipelines from source to client delivery, placing code under GitHub, automated tests, and CI/CD.

The platform currently uses Azure Databricks, Snowflake, and SQL Server, with evolving metadata-driven components. You will redefine architecture across ingestion, processing, and delivery to be stable, secure, and scalable for advanced use

Competenze

• Minimum 10+ years in data engineering on production systems.
• Proficiency with Snowflake or Databricks as primary platform.
• Strong Python and SQL for pipelines and testing.
• Experience with change data capture and event processing.
• Knowledge of Azure (Databricks, ADLS) and CI/CD tooling.

Mansioni

• Redesign architecture for ingestion, processing and delivery.
• Build and operate batch and streaming pipelines from diverse sources.
• Implement CDC and incremental loading with ordering and replays.
• Create medallion datasets and models for Snowflake and Databricks.
• Apply data contracts, reconciliation and data quality controls.
• Own GitHub workflow, CI/CD and deployment as code.
• Troubleshoot production data issues and translate requirements into pipelines.

Conoscenze

10+ years of experience

Snowflake

Databricks

Python

SQL

Change data capture

GitHub Actions

CI/CD

Data quality

Multi-tenant security

Strumenti

Snowflake

Databricks

Azure

GitHub

Airflow

Kafka

dbt

Descrizione del lavoro

73 Strings SAS is seeking a Senior Data Engineer to design and operate pipelines and warehousing that support valuation and monitoring. You will own production pipelines from source to client delivery, placing code under GitHub, automated tests, and CI/CD.

The platform currently uses Azure Databricks, Snowflake, and SQL Server, with evolving metadata-driven components. You will redefine architecture across ingestion, processing, and delivery to be stable, secure, and scalable for advanced use