Walk-in | Big Data Engineer

Hexaware Technologies Limited; Pune District; Hybrid; INR 1,200,000 - 1,800,000; Full time

Job summary

Hexaware Technologies Limited, Pune, is seeking a seasoned data engineer to design and implement scalable data platforms, pipelines, and data products. The role emphasizes AWS services, SQL, and real-time data processing within an enterprise data context.

The candidate should have 6–12 years of experience, strong Python and PySpark skills, and a track record of leading data initiatives in agile environments. Aimed at driving data quality, metadata, and lineage across complex environments.

Qualifications

• Advanced SQL and data modeling expertise.
• Strong Python and PySpark development experience.
• Experience implementing Master Data Management solutions.
• Experience building RESTful APIs and data services.
• Experience implementing event-driven and real-time data processing solutions.
• 8+ years of experience in data engineering, software engineering, or enterprise data platform development.
• 3+ years of technical leadership experience leading engineering teams or large-scale data initiatives.
• Proven experience designing and delivering enterprise data platforms, pipelines, and data products.
• Experience operating within agile software development environments.

Responsibilities

• Experience with AWS services such as Aurora (MySQL, PostgreSQL), Amazon S3 (Data Lake), AWS Glue, AWS DMS, Amazon MSK (Kafka), Kinesis Data Streams, Kinesis Firehose, API Gateway, Lambda, AWS Glue ETL, EMR, Partitioning, Data Skew Handling, Incremental Loading
• Advanced SQL and data modeling expertise. Strong Python and PySpark development experience.
• Deep understanding of ETL and ELT architecture patterns. Experience implementing Master Data Management solutions.
• Experience building RESTful APIs and data services. Familiarity with GraphQL and modern integration approaches. Understanding of microservices-based architectures.
• Experience implementing event-driven and real-time data processing solutions. Strong understanding of data quality frameworks, metadata management, and data lineage concepts.
• 8+ years of experience in data engineering, software engineering, or enterprise data platform development.
• 3+ years of technical leadership experience leading engineering teams or large-scale data initiatives.

Skills

AWS

Python

PySpark

Job description

Mandatory Skills

Skills: AWS + python + pyspark .( AWS + Data Engineer )

Experience : 6 - 12 yrs

Location : Pune

Roles & Responsibility

Experience with AWS services such as Aurora (MySQL, PostgreSQL), Amazon S3 (Data Lake), AWS Glue, AWS DMS, Amazon MSK (Kafka), Kinesis Data Streams, Kinesis Firehose, API Gateway, Lambda, AWS Glue ETL, EMR, Partitioning, Data Skew Handling, Incremental Loading

• Advanced SQL and data modeling expertise. Strong Python and PySpark development experience.
• Deep understanding of ETL and ELT architecture patterns. Experience implementing Master Data Management solutions.
• Experience building RESTful APIs and data services. Familiarity with GraphQL and modern integration approaches. Understanding of microservices-based architectures.
• Experience implementing event-driven and real-time data processing solutions. Strong understanding of data quality frameworks, metadata management, and data lineage concepts.

8+ years of experience in data engineering, software engineering, or enterprise data platform development.

• 3+ years of technical leadership experience leading engineering teams or large-scale data initiatives.
• Proven experience designing and delivering enterprise data platforms, pipelines, and data products. Experience operating within agile software development environments.