Lead Data Engineer: Build Scalable Data Platforms & Pipelines

Sahaj Software; Greater London; On-site; GBP 90,000 - 120,000; Full time

Benefits offered by this job

Unlimited leaves

Life insurance

Private health insurance

No hierarchy

Open salaries

Job summary

Sahaj Software in London is seeking a hands-on Data Engineer to build a full data platform and scalable pipelines. You will collaborate with data scientists and engineers to deliver production AI/ML solutions, design data models, and modernise client data infrastructure.

You’ll own your work, work in short sprints and contribute to Sahaj’s data engineering capability across the organisation. The role requires strong Python/Scala skills, experience with Databricks, Spark, HDFS, HBase and

Qualifications

• Senior Data Engineer with experience in complex enterprise environments.
• Strong Python or Scala programming background.
• Experience building big data apps with Databricks, Spark, HDFS, HBase and Snowflake.
• Proven ability to integrate data from hundreds of sources and deliver data products.
• Commitment to code quality with Test Driven Development and end-to-end delivery using CI/CD.
• Knowledge of Cloud platforms, DevOps, GitOps, and containers.

Responsibilities

• Collaborate with data scientists and engineers to deliver production AI and Machine Learning systems
• Build data ingestion frameworks from diverse sources
• Advise clients on data strategy and modernising data infrastructure
• Model data for increased visibility and performance
• Own your work and advocate for better design; work in short sprints
• Work with Sahaj data engineers to grow Data Engineering capability across the organisation
• You will be given ownership of your work and are encouraged to propose alternatives and make a case for doing things differently; our clients trust us and we manage ourselves.

Skills

Python

Scala

Databricks

Apache Spark

HDFS

HBase

Snowflake

Data ingestion

CI/CD

Cloud platforms

DevOps

GitOps

Containers

Test Driven Development

Job description

Sahaj Software in London is seeking a hands-on Data Engineer to build a full data platform and scalable pipelines. You will collaborate with data scientists and engineers to deliver production AI/ML solutions, design data models, and modernise client data infrastructure.

You’ll own your work, work in short sprints and contribute to Sahaj’s data engineering capability across the organisation. The role requires strong Python/Scala skills, experience with Databricks, Spark, HDFS, HBase and