Lead Data Engineer

Sahajsoftware; Greater London; On-site; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Unlimited leaves

Life insurance & private health

No hierarchy

Open Salaries

Job summary

Sahaj is seeking a hands-on Data Engineer to deliver comprehensive data solutions across the data platform, pipelines, and architecture. You’ll own end-to-end delivery in a fast-growth environment and work with cross-functional teams.

The role emphasizes building scalable data products from diverse sources, leveraging Databricks, Spark, HDFS, and Snowflake, with a strong focus on code quality, CI/CD, and cloud platforms.

Qualifications

• Senior Data Engineer with experience in complex enterprise environments.
• Strong coding skills in Python or functional languages like Scala.
• Experience designing and developing big data apps with Spark, Databricks, HDFS, HBase and Snowflake.
• Able to integrate data from many sources and ensure code quality with tests and CI/CD.
• Understanding of cloud platforms and DevOps practices.

Responsibilities

• Collaborate with data scientists and engineers to deliver production AI/ML systems.
• Build data ingestion pipelines from diverse sources and data frameworks.
• Consult with clients on data strategy and modernising data infrastructure.
• Model data for visibility and performance; own end-to-end delivery.
• Work in short sprints and contribute to building data engineering capability.

Skills

Senior Data Engineer

Python

Scala

Databricks

Apache Spark

Data modeling

CI/CD

Cloud platforms

DevOps / GitOps

HDFS

HBase

Snowflake

Tools

Databricks

Apache Spark

HDFS

HBase

Snowflake

Job description

About the role

As a Data Engineer, you’ll feel at home if you are hands on, grounded, opinionated and passionate about delivering comprehensive data solutions that align with modern data architecture approaches. Your work will range from building a full data platform to building data pipelines or helping with data architecture and strategy. This role is ideal for those looking to have a large impact and huge scope for growth, while still being hands on with technology. We aim to allow growth without becoming “post-technical”

Responsibilities

• Collaborate with Data Scientists and Engineers to deliver production quality AI and Machine Learning systems
• Build frameworks and supporting tooling for data ingestion from a complex variety of sources
• Consult with our clients on data strategy, modernising their data infrastructure, architecture and technology
• Model their data for increased visibility and performance
• You will be given ownership of your work, and are encouraged to propose alternatives and make a case for doing things differently; our clients trust us and we manage ourselves.
• You will work in short sprints to deliver working software
• You will be working with other data engineers in Sahaj and work on building Data Engineering capability across the organisation

Skills you’ll need

• Demonstrated experience as a Senior Data Engineer in complex enterprise environments.
• Deep understanding of technology fundamentals and experience with languages like Python, or functional programming languages like Scala
• Demonstrated experience in design and development of big data applications using tech stacks like Databricks, Apache Spark, HDFS, HBase and Snowflake
• Commendable skills in building data products, by integrating large sets of data from hundreds of internal and external sources would be highly critical
• A nuanced understanding of code quality, maintainability and practices like Test Driven Development
• Ability to deliver an application end to end; having an opinion on how your code should be built, packaged and deployed using CI/CD
• Understanding of Cloud platforms, DevOps, GitOps, Containers

Give yourself an opportunity to

• Experience a culture of trust, respect and transparency powered by holacracy.
• An environment that will allow you to hone your craft.
• Collaborate with multi-disciplinary teams to solve some real business problems.
• Solve problems across different domains. Level-up on difficult problems.
• Find your balance between work and life’s ups and downs with unlimited leave when you really need it.
• Not be exploited, as everyone knows everyone’s salary. Radical pay transparency.
• Own what you build. When Sahaj grows in impact and value, you’ll have a share in that upside.

What will you experience in terms of culture at Sahaj?

• A culture of trust, respect and transparency
• Opportunity to collaborate with some of the finest minds in the industry
• Work across multiple domains

What are the benefits of being at Sahaj?

• Unlimited leaves
• Life insurance & private health insurance
• No hierarchy
• Open Salaries