Lead Data Engineer

Sahaj Software Solutions Pvt Ltd; Chennai, Tiruchirappalli, Coimbatore District, Bengaluru, Hyderabad; On-site; INR 1,500,000 - 2,300,000; Full time

Benefits offered by this job

Unlimited leaves

Life Insurance & Private Health

Stock options

Job summary

Sahaj Software Solutions Pvt Ltd in Chennai seeks a Senior Data Engineer who will design and build comprehensive data platforms and pipelines. You’ll collaborate with data scientists and engineers to deliver production-grade AI/ML systems, while shaping data strategy and architecture across the organization.

You will own end-to-end data solutions, implement robust data ingestion, modeling, and governance, and drive modern data practices using Databricks, Spark, HDFS/HBase and Snowflake in cloud

Qualifications

• Experience as Senior Data Engineer in complex enterprise environments.
• Strong coding skills in Python and/or Scala.
• Hands-on with data pipelines, data platforms and data architecture strategy.
• Familiarity with modern data stacks, cloud platforms and DevOps practices.
• Ability to own end-to-end data solutions and deliver in sprints.

Responsibilities

• Collaborate with Data Scientists and Engineers to deliver production quality AI/ML systems.
• Build frameworks and tooling for data ingestion from diverse sources and modernise data infrastructure.
• Model data for visibility and performance.
• Own your work and advocate for better approaches, delivering in short sprints.
• Contribute to building Data Engineering capability across the organisation.

Skills

Python/Scala

Big data

Data modeling

CI/CD & DevOps

Cloud platforms

Tools

Databricks

Apache Spark

HDFS

HBase

Snowflake

Job description

Sahaj Software is an artisanal software engineering firm built on the values of trust, respect, curiosity, and craftsmanship, and delivering purpose-built solutions to drive data-led transformation for organisations. Our emphasis is on craft as we create purpose-built solution, leveraging Data Engineering, Platform Engineering and Data Science with a razor‑sharp focus to solve complex business and technology challenges, and provide customers with a competitive edge

About The Role

As a Data Engineer, you’ll feel at home if you are hands on, grounded, opinionated and passionate about delivering comprehensive data solutions that align with modern data architecture approaches. Your work will range from building a full data platform to building data pipelines or helping with data architecture and strategy. This role is ideal for those looking to have a large impact and huge scope for growth, while still being hands on with technology. We aim to allow growth without becoming “post-technical”.

Responsibilities

• Collaborate with Data Scientists and Engineers to deliver production quality AI and Machine Learning systems
• Build frameworks and supporting tooling for data ingestion from a complex variety of sources Consult with our clients on data strategy, modernising their data infrastructure, architecture and technology
• Model their data for increased visibility and performance
• You will be given ownership of your work, and are encouraged to propose alternatives and make a case for doing things differently; our clients trust us and we manage ourselves. You will work in short sprints to deliver working software
• You will be working with other data engineers in Sahaj and work on building Data Engineering capability across the organisation

You can read more about what we do and how we think here: https://sahaj.ai/client-stories/

Skills you’ll need

• Demonstrated experience as a Senior Data Engineer in complex enterprise environments Deep understanding of technology fundamentals and experience with languages like Python, or functional programming languages like Scala
• Demonstrated experience in design and development of big data applications using tech stacks like Databricks, Apache Spark, HDFS, HBase and Snowflake
• Commendable skills in building data products, by integrating large sets of data from hundreds of internal and external sources would be highly critical
• A nuanced understanding of code quality, maintainability and practices like Test Driven Development
• Ability to deliver an application end to end; having an opinion on how your code should be built, packaged and deployed using CI/CD
• Understanding of Cloud platforms, DevOps, GitOps, Containers

What will you experience as a culture at Sahaj?

• Creativity
• Ownership
• Craftsmanship
• A culture of trust, respect and transparency
• Opportunity to collaborate with some of the finest minds in the industry

What are the benefits of being at Sahaj?

• Unlimited leaves
• Life Insurance & Private Health insurance paid by Sahaj
• Stock options