Lead Data Engineer

Ample Success HR; Pune District; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

Ample Success HR is seeking a highly skilled Lead Data Engineer to design, develop, and maintain scalable data pipelines and architectures. You will collaborate with cross-functional teams to ensure data integrity and availability.

The role emphasizes Python, PySpark, SQL, and AWS expertise to optimize data models and ETL processes. DBT and GCP familiarity are a plus as we scale analytics across the organization.

Qualifications

• 7 to 12 years of professional experience in data engineering.
• Proficiency in Python, PySpark, and SQL.
• Experience with AWS cloud services.
• Strong understanding of data modeling concepts.
• Familiarity with DBT (Data Build Tool) and GCP is a plus.

Responsibilities

• Design and implement scalable data pipelines using Python and PySpark.
• Develop and maintain data models and ETL processes.
• Utilize AWS cloud services to enhance data processing capabilities.
• Collaborate with data analysts and scientists to optimize SQL queries and data transformations.
• Implement data solutions using DBT (Data Build Tool).

Skills

Python

PySpark

SQL

Tools

AWS

DBT (Data Build Tool)

GCP

Job description

We are seeking a highly skilled Lead Data Engineer to join our team. The ideal candidate will have a strong background in data engineering and a passion for building scalable data solutions.

Role Summary

As a Lead Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and architectures. You will work closely with cross-functional teams to ensure data integrity and availability.

Key Responsibilities

• Design and implement scalable data pipelines using Python and PySpark.
• Develop and maintain data models and ETL processes.
• Utilize AWS cloud services to enhance data processing capabilities.
• Collaborate with data analysts and scientists to optimize SQL queries and data transformations.
• Implement data solutions using DBT (Data Build Tool).

Required Qualifications

• 7 to 12 years of professional experience in data engineering.
• Proficiency in Python, PySpark, and SQL.
• Experience with AWS cloud services.
• Strong understanding of data modeling concepts.
• Familiarity with DBT (Data Build Tool) and GCP is a plus.

Location

Open to Noida, Pune, Hyderabad.

Interested in this role?