Data Engineer Lead

Iris Software; Gurugram District; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

A leading tech firm in Gurugram is looking for a Data Engineer with over 8 years of experience. This role requires hands-on knowledge of AWS data services, strong skills in Python or Scala, and expertise in SQL and data modeling. The ideal candidate will have experience building ETL/ELT pipelines at scale and a solid understanding of cloud security practices. Candidates with AWS certifications and exposure to AI/ML integration will find this role especially appealing.

Qualifications

• 8+ years of experience in Data Engineering.
• 5+ years of hands-on experience with AWS data services.
• Strong proficiency in Python and/or Scala.

Skills

Data Engineering

Python

AWS data services

SQL and data modeling

ETL/ELT pipelines

Tools

Spark

Airflow

GitHub Copilot

Docker

Kubernetes

Job description

• 8+ years of experience in Data Engineering.
• 5+ years of hands-on experience with AWS data services.
• Strong proficiency in Python and/or Scala.
• Experience building ETL/ELT pipelines at scale.
• Strong SQL and data modeling expertise (OLAP, dimensional modeling, lakehouse).
• Hands-on experience with:
• Spark / PySpark
• Airflow or similar orchestration tools
• REST APIs and microservices
• Experience using GitHub Copilot or similar AI-assisted development tools in enterprise environments.
• Solid understanding of IAM, encryption, networking, and cloud security best practices.

Preferred Qualifications

• AWS Certifications (e.g., AWS Certified Solutions Architect, AWS Certified Data Analytics).
• Experience with streaming technologies (Kafka, Kinesis).
• Experience with containerization (Docker, Kubernetes).
• Knowledge of Delta Lake, Iceberg, or Hudi.
• Experience implementing data observability solutions.

Leadership & Soft Skills

• Proven ability to lead engineering teams and drive architectural decisions.
• Strong stakeholder communication skills.
• Ability to balance delivery velocity with engineering excellence.
• Experience working in Agile/Scrum environments.

Nice to Have

• Experience implementing cost governance and FinOps best practices on AWS.
• Exposure to AI/ML pipeline integration.
• Experience designing multi-account AWS architectures.