Senior Data Engineer: Data Platforms & ML Pipelines

ATG (Auction Technology Group); Greater London; On-site; GBP 110,000 - 140,000; Full time

Job summary

ATG (Auction Technology Group) is seeking a Senior Data Engineer to strengthen the Data Enablement team in London. You will build durable data products serving analytics, search, recommendations, and ML with a focus on reliability, quality, and scalable data models.

You will collaborate with product, analytics, software, and ML teams to deliver well-documented datasets, use cases, and pipelines. The role emphasizes maintainability, governance, and efficient data platforms.

Qualifications

• Five or more years of experience building and operating production data pipelines or data platforms.
• Strong Python and advanced SQL skills including testing, debugging, and performance tuning.
• Hands-on experience with Snowflake or another modern cloud data platform and dimensional/analytical modeling.
• Experience with dbt or comparable transformation framework and with Airflow, Dagster, or similar tooling.
• Experience with AWS data services and cloud storage; other major clouds welcome.

Responsibilities

• Design, build, and operate batch and event-driven pipelines for auction, inventory, customer, and transaction data.
• Develop reusable transformation models and curated datasets in Snowflake and dbt for analytics and operational use cases.
• Orchestrate complex dependencies with Airflow or a comparable workflow platform.
• Define data contracts, validation rules, lineage, and SLAs for critical datasets and implement automated testing.

Skills

Python

SQL

Snowflake

dbt

Airflow

AWS

Education

Bachelor's degree

Tools

Dagster

Prefect

Git

CI/CD

Job description

ATG (Auction Technology Group) is seeking a Senior Data Engineer to strengthen the Data Enablement team in London. You will build durable data products serving analytics, search, recommendations, and ML with a focus on reliability, quality, and scalable data models.

You will collaborate with product, analytics, software, and ML teams to deliver well-documented datasets, use cases, and pipelines. The role emphasizes maintainability, governance, and efficient data platforms.