Senior Data Engineer

Yantran; Chennai District; On-site; INR 3,500,000 - 5,500,000; Full time

Job summary

Yantran in Chennai, India is seeking a Senior Data Engineer to lead the design and development of enterprise-scale data platforms and pipelines. You will design scalable data architectures, develop complex ETL/ELT pipelines, and build batch and real-time data flows.

You will optimize Spark and SQL workloads, implement data governance, and mentor junior data engineers while collaborating with architects, analysts, and data scientists on cloud migration initiatives.

Qualifications

• 6+ years of data engineering experience.
• Proficiency in Python and SQL with strong Spark skills.
• Experience designing scalable data architectures and pipelines.

Responsibilities

• Design scalable data architectures.
• Develop complex ETL/ELT pipelines.
• Build batch and real-time data pipelines.
• Develop data lake and warehouse solutions.
• Optimize Spark and SQL workloads.
• Implement data governance and quality frameworks.
• Mentor junior data engineers.
• Lead cloud data migration initiatives.
• Collaborate with architects, analysts, and data scientists.

Skills

Python

Advanced SQL

Spark/PySpark

Databricks

Snowflake

Data Lakes/Warehouses

AWS/GCP/Azure

Kafka

Airflow

ETL/ELT architecture

Tools

Databricks

Snowflake

AWS

Azure

GCP

Kafka

Airflow

Job description

Seeking a Senior Data Engineer to lead the design and development of enterprise-scale data platforms and pipelines.

Responsibilities:

• Design scalable data architectures.
• Develop complex ETL/ELT pipelines.
• Build batch and real-time data pipelines.
• Develop data lake and warehouse solutions.
• Optimize Spark and SQL workloads.
• Implement data governance and quality frameworks.
• Mentor junior data engineers.
• Lead cloud data migration initiatives.
• Collaborate with architects, analysts, and data scientists.

Required Skills:

• 6+ years of Data Engineering experience.
• Python.
• Advanced SQL.
• Spark/PySpark.
• Databricks/Snowflake.
• Data Lakes/Warehouses.
• AWS/Azure/GCP.
• Kafka.
• Airflow.
• ETL/ELT architecture.