Technical Lead (AWS Data Engineering Lead)

dentsuaegis; Mumbai; On-site; INR 1,800,000 - 2,500,000; Full time

Job summary

Merkle in Mumbai, India is seeking a data engineer specialized in AWS and Spark to design, build, and optimize scalable data pipelines and storage solutions. The role focuses on cloud-native data lakes and warehouses, with strong SQL/Python capabilities for data engineering tasks.

The candidate will drive end-to-end data workflows, collaborate with global teams, and contribute to DevOps practices for data platforms, enabling reliable production systems.

Qualifications

• Experience with AWS data services (S3, Glue, Athena, Redshift).
• Design cloud-native data lakes and data warehouses.
• Strong batch and streaming data pipelines.
• Build scalable, fault-tolerant data workflows.
• Proficient in SQL and Python for data engineering.

Responsibilities

• Develop ETL pipelines and data workflows.
• Design and optimize data lakes and data warehouses.
• Collaborate with cross-functional teams and own solutions.
• Implement CI/CD and DevOps practices for data platforms.

Skills

AWS data services

SQL & Python

PySpark / Spark

Data processing

DevOps for data platforms

Collaboration & ownership

Education

Bachelor's/Master's in CS/IS/Data Eng

Tools

Databricks

Snowflake

Job description

Must-Have Skills

Cloud & Data Engineering (AWS)

• Strong hands-on experience with: Amazon S3, AWS Glue, Athena, Redshift
• Experience designing cloud-native data lakes and data warehouses
• Deep understanding of batch and streaming data pipelines
• Experience building scalable and fault-tolerant data workflows

SQL & Python (Mandatory)

• Strong expertise in SQL, including: Complex transformations and aggregations
• Performance tuning and analytics queries
• Experience working with large-scale datasets in Redshift/Athena
• Strong Python programming skills for data engineering use cases

PySpark / Spark Processing

• Hands-on experience with Spark / PySpark
• Build reusable ETL components and utilities
• Strong understanding of: Data modeling, Transformations, Performance optimization

Data Processing & Engineering

• Experience with distributed processing frameworks (Spark/PySpark)
• Handling structured, semi-structured, and unstructured data
• Expertise in: Schema design, Partitioning, Query optimization

DevOps & Platform Engineering

• Experience with Infrastructure as Code (Terraform / CloudFormation)
• Hands-on experience in building CI/CD pipelines for data platforms
• Exposure to containerization (Docker, ECS, EKS)

Collaboration & Ownership

• Strong ownership mindset for: Solution quality, Performance, Production stability
• Excellent communication and stakeholder collaboration skills

Good-to-Have Skills

• Experience with streaming technologies (Kinesis, Kafka, MSK)
• Exposure to Lakehouse architectures and modern data platforms
• Integration with BI and analytics tools
• Knowledge of: Data governance, Data quality frameworks, Metadata management
• Familiarity with FinOps (cost optimization on AWS)
• Exposure to Marketing/Customer Data Platforms (CDP / MarTech)
• Experience working in Agile delivery models with global teams

Education Qualification

• Bachelor's or master's degree in: Computer Science, Information Systems, Data Engineering, or related field

Certifications

Preferred:

• AWS Certified Data Analytics
• AWS Solutions Architect (Any two preferred)

Plus:

• Databricks
• Snowflake or other cloud data platform certifications

Location

DGS India - Mumbai - Goregaon Prism Tower

Brand

Merkle

Time Type

Full time

Contract Type

Permanent