Lead Data Engineer

Coforge Limited; Hyderabad; Hybrid; INR 2,500,000 - 4,000,000; Full time

Job summary

Coforge in Hyderabad is seeking a senior Data Engineer to design, implement, and optimize large-scale data pipelines. You’ll work with Python, DBT, Airflow, Snowflake, and AWS to build robust data solutions that drive analytics and decision-making.

The role emphasizes data quality, governance, and performance optimization, with collaboration across business and tech teams to deliver scalable data platforms.

Qualifications

• Strong Python programming skills with hands-on DBT experience.
• Expertise in Snowflake Data Warehouse and AWS data services.
• Proficient SQL and ETL/data pipeline development experience.
• Solid understanding of data warehousing concepts and best practices.
• Experience in data modeling and performance optimization.

Responsibilities

• Design, develop, and maintain scalable data pipelines.
• Build and optimize ETL/ELT workflows using DBT, Python, and Airflow.
• Develop and manage data solutions on Snowflake.
• Integrate data from multiple sources using AWS Glue and S3.
• Ensure data quality, governance, and performance optimization.
• Collaborate with business and technical teams to deliver data solutions.
• Troubleshoot and resolve data pipeline and performance issues.

Skills

Python

SQL

ETL/Data Pipeline

Data Modeling

Data Warehousing Concepts

Tools

DBT

Snowflake

AWS S3

AWS Glue

Apache Airflow

Job description

Role & responsibilities

Position: Data Engineer
Location: Hyderabad
Experience: 12-18 Years

Required Skills:

• Strong experience in Python programming
• Hands-on experience with DBT (Data Build Tool)
• Expertise in Snowflake Data Warehouse
• Experience with AWS Services: S3, Glue
• Hands-on experience with Apache Airflow
• Strong SQL and ETL/Data Pipeline development experience
• Knowledge of Data Warehousing concepts and best practices
• Experience in data modeling and performance optimization

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines.
• Build and optimize ETL/ELT workflows using DBT, Python, and Airflow.
• Develop and manage data solutions on Snowflake.
• Integrate data from multiple sources using AWS Glue and S3.
• Ensure data quality, governance, and performance optimization.
• Collaborate with business and technical teams to deliver data solutions.
• Troubleshoot and resolve data pipeline and performance issues.