Senior Data Engineer — Build Scalable AI Data Platforms

Dex; Greater London; On-site; GBP 70,000 - 120,000; Full time

Job summary

Dex is seeking a Platform Data Engineer to own end-to-end data platform work within a software engineering context. The role focuses on designing scalable data ingestion, validation, and storage architectures for varied datasets used in AI training environments.

You will tackle data quality, safety, and cost considerations, and collaborate across teams to ensure reliable data availability for AI researchers and platform engineers.

Qualifications

• Built and operated substantial production data systems end-to-end.
• Hands-on with code, not just configuring tools.
• Experience with large, complex, messy datasets.
• Ability to discuss trade-offs in storage, processing, reliability.
• Comfortable with cloud infrastructure and debugging production systems.

Responsibilities

• Design and build scalable systems for acquiring, ingesting, and integrating large, messy, and varied datasets.
• Develop robust validation, sanitisation, and PII-removal layers to ensure data safety and quality.
• Tackle complex data problems: duplication, corruption, inconsistent formats, and provenance.
• Make critical architectural decisions across storage, reliability, observability, security, and cost.
• Ensure reliable, high-quality data availability for AI training environment engineers.

Skills

Production data systems

Software engineering fundamentals

Large datasets experience

Cloud infrastructure

Data quality & governance

Job description

Dex is seeking a Platform Data Engineer to own end-to-end data platform work within a software engineering context. The role focuses on designing scalable data ingestion, validation, and storage architectures for varied datasets used in AI training environments.

You will tackle data quality, safety, and cost considerations, and collaborate across teams to ensure reliable data availability for AI researchers and platform engineers.