Data Engineer

wits inovation lab; Hyderabad, Pune District, Bengaluru; On-site; INR 800,000 - 1,500,000; Full time

Job summary

wits inovation lab is seeking a data engineer to design and optimize scalable data pipelines and ETL processes in a multi-city setup across India. The role focuses on building robust data architectures and collaborating with data teams to ensure reliable data delivery.

You will work with large datasets, drive data quality, and implement governance practices while leveraging cloud platforms and modern data warehousing solutions.

Qualifications

• Minimum of a bachelor's degree in a related field.
• Strong programming experience with Python and SQL.
• Hands-on ETL and data pipeline development experience.
• Familiarity with cloud data platforms and data warehousing.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL processes.
• Develop and optimize data architectures and data models.
• Work with large datasets ensuring data quality and performance.
• Collaborate with data analysts, scientists, and engineers; implement data integration and governance.

Skills

Python

SQL

ETL tools

Data pipelines

Big Data (Spark/Hadoop)

Cloud platforms (AWS/Azure/GCP)

Data warehousing (Snowflake/Redshift/\

Education

Bachelors degree in Computer Science, Engineering, or related field

Tools

ETL tools

Snowflake

Redshift

BigQuery

Spark

Job description

Key Responsibilities:

• Design, build, and maintain scalable data pipelines and ETL processesDevelop and optimize data architectures and data models
• Work with large datasets to ensure data quality, reliability, and performance
• Collaborate with data analysts, data scientists, and engineering teamsImplement data integration from multiple sourcesEnsure security, compliance, and data governance best practices

Required Skills:

• Strong experience with Python / SQLHands-on experience with ETL tools and data pipeline development
• Experience with Big Data technologies (Spark, Hadoop, etc
• Knowledge of Cloud platforms (AWS / Azure / GCP)
• Experience with Data Warehousing solutions (Snowflake, Redshift, BigQuery)Understanding of data modeling and database design

Education:

• Bachelors degree in Computer Science, Engineering, or related field

Location - Pune, Bangalore, Hydrabad, Mumbai