Data Engineer, Lakehouse & AI Platform

Goldman Sachs; Greater London; On-site; GBP 90,000 - 120,000; Full time

Job summary

Goldman Sachs is seeking a Data Engineer to join the Lakehouse and AI Data Platform team in London. You will design, build, test and support data pipelines and curated datasets across ingestion, transformation, modelling and quality checks.

The role requires strong Python or Java programming, solid SQL skills and experience with modern data technologies. Collaboration with engineers and data consumers is essential, and senior engineers may shape design standards and delivery approaches.

Qualifications

• Bachelor’s or master’s degree in a relevant discipline, or equivalent practical experience.
• Strong hands-on programming experience in Python or Java.
• Good working knowledge of SQL, including troubleshooting, optimisation and data analysis.
• Ability to learn new tools, internal platforms and delivery workflows quickly.
• Familiarity with version control, testing, release discipline and CI/CD practices.

Responsibilities

• Build, test and support batch and streaming data pipelines on the Lakehouse and AI data platform.
• Develop raw, refined and curated datasets that support analytics, reporting and AI use cases.
• Apply sound data modelling principles to represent business entities, relationships and historical change accurately.
• Work with consumers to shape data products that are usable, well documented and aligned to business needs.
• Contribute to shared tooling or framework components that improve platform usability and reliability.

Skills

Python

Java

SQL

CI/CD practices

Distributed data processing

Apache Spark

Education

Bachelor's or Master's in a relevant discipline

Tools

Snowflake

Databricks

Apache Iceberg

Hadoop ecosystem

Kafka

Job description

Goldman Sachs is seeking a Data Engineer to join the Lakehouse and AI Data Platform team in London. You will design, build, test and support data pipelines and curated datasets across ingestion, transformation, modelling and quality checks.

The role requires strong Python or Java programming, solid SQL skills and experience with modern data technologies. Collaboration with engineers and data consumers is essential, and senior engineers may shape design standards and delivery approaches.