Senior Data Engineer

Ness Digital Engineering; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Ness Digital Engineering in Bengaluru seeks a Senior Data Engineer to design and optimize data platforms using Python, Spark, and cloud-native tools.

You will build scalable pipelines on AWS, collaborate with Databricks and Snowflake, and apply rigorous software engineering practices across the data lifecycle.

Qualifications

• Minimum ~5 years hands-on data engineering experience.
• Strong Python-first programming and debugging skills.
• Hands-on Spark/PySpark experience.
• Experience with AWS and Databricks/Snowflake.
• Production experience building and supporting data pipelines.

Responsibilities

• Build scalable data pipelines using Python and Spark/PySpark.
• Develop, debug, test, and optimize production data solutions.
• Work with Databricks, Snowflake, and modern data platforms.
• Build and deploy solutions on AWS.
• Apply strong software engineering and coding practices.

Skills

Data engineering

Python programming

Spark PySpark

AWS

Databricks

Snowflake

Data pipelines

Job description

Senior Data Engineer – Python / AWS / Modern Data Platforms

Key Responsibilities

• Build scalable data pipelines using Python and Spark/PySpark.
• Develop, debug, test, and optimize production data solutions.
• Work with Databricks, Snowflake, and modern data platforms.
• Build and deploy solutions on AWS.
• Apply strong software engineering and coding practices.

Required Skills

• ~5 years of hands-on Data Engineering experience.
• Strong Python-first programming and debugging skills.
• Hands-on Spark/PySpark experience.
• Experience with AWS and Databricks/Snowflake.
• Production experience building and supporting data pipelines.

Good to Have

• Financial Services domain experience.
• Dagster or other data orchestration platforms.
• Cloud-native data engineering experience.