Senior Data Engineer

Ness Group; Bengaluru; On-site; INR 1,400,000 - 2,200,000; Full time

Job summary

Ness Group seeks an experienced Data Engineer to design and optimize data pipelines using Python, Spark/PySpark on AWS. You will build scalable data solutions across Databricks and Snowflake on modern data platforms.

Ideal candidates have hands-on AWS experience, strong Python skills, and production data pipeline expertise, with a disciplined approach to testing, debugging, and performance tuning. Bengaluru-based; remote options may apply.

Qualifications

• Around 5 years of hands-on Data Engineering experience.
• Strong Python-first programming and debugging skills.
• Experience with AWS and Databricks/Snowflake.
• Production experience building and supporting data pipelines.

Responsibilities

• Build scalable data pipelines using Python and Spark/PySpark.
• Develop, debug, test, and optimize production data solutions.
• Work with Databricks, Snowflake, and modern data platforms.
• Build and deploy solutions on AWS.
• Apply strong software engineering and coding practices.

Skills

Python

Spark

PySpark

AWS

Databricks

Snowflake

Tools

Dagster

Job description

Key Responsibilities

• Build scalable data pipelines using Python and Spark/PySpark.


• Develop, debug, test, and optimize production data solutions.


• Work with Databricks, Snowflake, and modern data platforms.


• Build and deploy solutions on AWS.


• Apply strong software engineering and coding practices.

Required Skills

• ~5 years of hands-on Data Engineering experience.


• Strong Python-first programming and debugging skills.


• Experience with AWS and Databricks/Snowflake.


• Production experience building and supporting data pipelines.

Good to Have

• Dagster or other data orchestration platforms.