Data Engineer

wits inovation lab; Hyderabad, Pune District, Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

wits inovation lab is seeking a data engineer to design, build and optimize scalable data pipelines and ETL processes, while collaborating with analytics and engineering teams in a rapidly evolving data-centric environment. The role emphasizes data quality, reliability, and governance across large datasets and multiple sources.

The ideal candidate will have strong Python/SQL skills, hands-on ETL experience, familiarity with Spark/Hadoop, and a background in cloud-based data warehousing

Qualifications

• Strong experience with Python and SQL
• Hands-on experience with ETL tools and data pipeline development
• Experience with Big Data technologies (Spark, Hadoop)
• Knowledge of Cloud platforms (AWS, Azure, GCP)
• Experience with Data Warehousing solutions (Snowflake, Redshift, BigQuery)
• Understanding of data modeling and database design

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL processes. Develop and optimize data architectures and data models.
• Work with large datasets to ensure data quality, reliability, and performance.
• Collaborate with data analysts, data scientists, and engineering teams. Implement data integration from multiple sources.
• Ensure security, compliance, and data governance best practices.

Skills

Python

SQL

ETL tools

Data pipeline development

Spark

Hadoop

AWS

Azure

GCP

Snowflake

Redshift

BigQuery

Data modeling

Database design

Education

Bachelor's degree in Computer Science, Engineering, or related field

Job description

Key Responsibilities:

• Design, build, and maintain scalable data pipelines and ETL processesDevelop and optimize data architectures and data models
• Work with large datasets to ensure data quality, reliability, and performance
• Collaborate with data analysts, data scientists, and engineering teamsImplement data integration from multiple sourcesEnsure security, compliance, and data governance best practices

Required Skills:

• Strong experience with Python / SQLHands-on experience with ETL tools and data pipeline development
• Experience with Big Data technologies (Spark, Hadoop, etc
• Knowledge of Cloud platforms (AWS / Azure / GCP)
• Experience with Data Warehousing solutions (Snowflake, Redshift, BigQuery)Understanding of data modeling and database design

Education:

• Bachelors degree in Computer Science, Engineering, or related field

Location - Pune, Bangalore, Hydrabad, Mumbai