Walk-in || Big Data Engineer

Mployee.me; Pune District; On-site; INR 1,500,000 - 2,600,000; Full time

Job summary

Mployee.me in Pune is seeking a seasoned Data Engineer to design and implement scalable data pipelines using AWS, Python and PySpark. You will focus on advanced SQL, data modeling, and robust ETL/ELT patterns across enterprise data platforms.

The ideal candidate will drive data initiatives, build data products and APIs, and contribute to data quality, governance, and real-time processing in an agile environment.

Qualifications

• Experience with AWS data services such as Aurora/MySQL/PostgreSQL, S3 Data Lake, AWS Glue, DMS, MSK, Kinesis

Responsibilities

• Advanced SQL and data modeling expertise.
• Strong Python and PySpark development experience.
• Experience implementing ETL/ELT architectures and Master Data Management solutions.
• Experience building RESTful APIs and data services; familiarity with GraphQL and microservices.

Skills

AWS

Python

PySpark

Tools

Aurora

S3

Glue

DMS

MSK

Kinesis

Job description

Mandatory Skills

Skills: AWS + python + pyspark .( AWS + Data Engineer )

Experience : 6 - 12 yrs

Location : Pune

Roles & Responsibility

Experience with AWS services such as Aurora (MySQL, PostgreSQL), Amazon S3 (Data Lake), AWS Glue, AWS DMS, Amazon MSK (Kafka), Kinesis Data Streams, Kinesis Firehose, API Gateway, Lambda, AWS Glue ETL, EMR, Partitioning, Data Skew Handling, Incremental Loading

• Advanced SQL and data modeling expertise. Strong Python and PySpark development experience.
• Deep understanding of ETL and ELT architecture patterns. Experience implementing Master Data Management solutions.
• Experience building RESTful APIs and data services. Familiarity with GraphQL and modern integration approaches. Understanding of microservices-based architectures.
• Experience implementing event-driven and real-time data processing solutions. Strong understanding of data quality frameworks, metadata management, and data lineage concepts.

8+ years of experience in data engineering, software engineering, or enterprise data platform development.

• 3+ years of technical leadership experience leading engineering teams or large-scale data initiatives.
• Proven experience designing and delivering enterprise data platforms, pipelines, and data products. Experience operating within agile software development environments.