Data Engineer

Yantran; Chennai District; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Yantran is seeking a Data Engineer to design, develop, and maintain scalable data pipelines and platforms in Chennai. The role emphasizes building ETL/ELT pipelines, data ingestion, and transformation to support analytics.

You'll design data warehouses and data lakes, integrate structured and unstructured data, and collaborate with Data Scientists and Analysts while leveraging cloud platforms such as AWS, Azure, or GCP.

Qualifications

• Proficient in Python, SQL, Spark/PySpark and ETL/ELT concepts.
• Experience designing data warehouses and data lakes.
• Familiar with cloud platforms (AWS/Azure/GCP) and data streaming tools.

Responsibilities

• Build ETL/ELT pipelines.
• Develop data ingestion and transformation processes.
• Design data warehouses and data lakes.
• Integrate structured and unstructured data.
• Develop batch and streaming pipelines.
• Optimize data processing performance.
• Implement data quality and validation.
• Work with Data Scientists and Analysts.
• Support cloud data platforms.

Skills

Python

SQL

Spark/PySpark

ETL/ELT

Data Warehousing

Data Lakes

Databricks/Snowflake

AWS/Azure/GCP

Kafka

Airflow

Tools

Databricks

Snowflake

Job description

Seeking a Data Engineer to design, develop, and maintain scalable data pipelines and data platforms.

Responsibilities:

• Build ETL/ELT pipelines.
• Develop data ingestion and transformation processes.
• Design data warehouses and data lakes.
• Integrate structured and unstructured data.
• Develop batch and streaming pipelines.
• Optimize data processing performance.
• Implement data quality and validation.
• Work with Data Scientists and Analysts.
• Support cloud data platforms.

Required Skills:

• Python.
• SQL.
• Spark/PySpark.
• ETL/ELT.
• Data Warehousing.
• Data Lakes.
• Databricks/Snowflake preferred.
• AWS/Azure/GCP.
• Kafka preferred.
• Airflow preferred.