Data Engineer

Indium Software; Bengaluru; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Indium Software in Bengaluru, India is seeking a skilled Data Engineer. You will build and maintain ETL pipelines using SQL, Python and PySpark, handling large, complex datasets and ensuring data quality for insights.

You will collaborate with stakeholders to translate business needs into scalable data solutions within the Hadoop ecosystem, schedule data jobs, and optimize processing performance. Strong problem solving and communication skills are essential.

Qualifications

• 3-4 years hands-on experience with SQL, Python and PySpark.
• Strong understanding of data structures, processing and pipeline development.
• Familiarity with the Hadoop ecosystem (basic level).

Responsibilities

• Develop and maintain ETL pipelines using SQL, Python and PySpark.
• Work with high-volume, complex data sets across various sources.
• Ensure data accuracy, consistency and performance in processing workflows.
• Collaborate with stakeholders to understand business needs and deliver insights.
• Write efficient and optimised code for large-scale data processing tasks.
• Schedule and monitor data jobs using schedulers or orchestration tools.
• Contribute to scalable data solutions within the Hadoop ecosystem.

Skills

SQL

Python

PySpark

Tools

Hadoop

Job description

We are looking for a skilled and motivated Data Engineer to join our team. The ideal candidate will have strong technical expertise in SQL, Python, and PySpark, along with experience working with large, complex datasets. You will play a critical role in building and maintaining data pipelines, ensuring high data quality, and enabling strategic insights for stakeholders.

Responsibilities:

• Develop and maintain ETL pipelines using SQL, Python, and PySpark.
• Work with high-volume, complex data sets across various sources.
• Ensure data accuracy, consistency, and performance in processing workflows.
• Collaborate directly with stakeholders to understand business needs and deliver actionable insights.
• Write efficient and optimised code for large-scale data processing tasks.
• Schedule and monitor data jobs using job schedulers or orchestration tools.
• Contribute to designing scalable data solutions within the Hadoop ecosystem.

Requirements:

• 3-4 years of hands-on experience with SQL, Python, and PySpark.
• Strong understanding of data structures, data processing, and pipeline development.
• Familiarity with the Hadoop ecosystem (basic level).
• Excellent problem-solving and data comprehension skills.
• Strong communication skills and ability to work directly with stakeholders.