Lead Data Engineer — AI Data Platform & Pipelines

Resume Skip; Greater London; Sur place; GBP 90 000 - 130 000; Plein temps

Avantages offerts par ce poste

Unlimited leaves

Life insurance & private health

No hierarchy

Open Salaries

Résumé du poste

Sahaj is seeking a hands-on Data Engineer to deliver comprehensive data solutions across the data platform, pipelines, and architecture. You’ll own end-to-end delivery in a fast-growth environment and work with cross-functional teams.

The role emphasizes building scalable data products from diverse sources, leveraging Databricks, Spark, HDFS, and Snowflake, with a strong focus on code quality, CI/CD, and cloud platforms.

Qualifications

• Senior Data Engineer with experience in complex enterprise environments.
• Strong coding skills in Python or functional languages like Scala.
• Experience designing and developing big data apps with Spark, Databricks, HDFS, HBase and Snowflake.
• Able to integrate data from many sources and ensure code quality with tests and CI/CD.
• Understanding of cloud platforms and DevOps practices.

Responsabilités

• Collaborate with data scientists and engineers to deliver production AI/ML systems.
• Build data ingestion pipelines from diverse sources and data frameworks.
• Consult with clients on data strategy and modernising data infrastructure.
• Model data for visibility and performance; own end-to-end delivery.
• Work in short sprints and contribute to building data engineering capability.

Connaissances

Senior Data Engineer

Python

Scala

Databricks

Apache Spark

Data modeling

CI/CD

Cloud platforms

DevOps / GitOps

HDFS

HBase

Snowflake

Outils

Databricks

Apache Spark

HDFS

HBase

Snowflake

Description du poste

Sahaj is seeking a hands-on Data Engineer to deliver comprehensive data solutions across the data platform, pipelines, and architecture. You’ll own end-to-end delivery in a fast-growth environment and work with cross-functional teams.

The role emphasizes building scalable data products from diverse sources, leveraging Databricks, Spark, HDFS, and Snowflake, with a strong focus on code quality, CI/CD, and cloud platforms.