AWS Data Engineer

Tech Mahindra; India; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Tech Mahindra is seeking an experienced Data Engineer with 8+ years of software engineering focused on big data and cloud-based ETL pipelines. The role emphasizes AWS services (Glue, Lambda, Kinesis), NoSQL and SQL databases, and PySpark analytics to build scalable data processing applications.

Candidate should demonstrate strong Python, PySpark coding and experience delivering RESTful services, with additional exposure to Kubernetes and enterprise ETL tools.

Qualifications

• Bachelor’s or higher degree required.
• AWS experience mandatory and scalable on AEP.
• Experience with AWS Glue, Lambda, Kinesis DataStream, NoSQL DB, SQS.
• Proficient in Python, PySpark and SQL.

Skills

AWS expert

ETL pipelines

PySpark

Python

SQL

NoSQL

Distributed processing

REST APIs

Education

Bachelor's degree

Tools

Kubernetes

Enterprise ETL tools

Job description

A Bachelor’s or Higher Degree is the minimum entry required for the position

Note

• AWS experience is mandatory and can be scaled up on AEP.
• Primary services focus on AWS Glue, Lambda, Kinesis DataStream, NoSQL DB, SQS.
• Evaluation skills: Python, PySpark and SQL.

Skills Required

• 8+ years(8 year) of professional software engineering mostly focused on the following:
• Looking AWS expert
• Developing ETL pipelines involving big data.
• Developing data processing\analytics applications primarily using PySpark.
• Experience of developing applications on cloud(AWS) mostly using services related to storage, compute, ETL, DWH, Analytics and streaming.
• Clear understanding and ability to implement distributed storage, processing and scalable applications.
• Experience of working with SQL and NoSQL database.
• Ability to write and analyze SQL, HQL and other query languages for NoSQL databases.
• Proficiency is writing distributed & scalable data processing code using PySpark, Python and related libraries. Data Engineer AEP Competency
• Experience of developing applications that consume the services exposed as ReST APIs.

Special Consideration given for

• Experience of working with Container orchestration systems like Kubernetes.
• Experience of working with any enterprise grade ETL tools.
• Experience & knowledge with Adobe Experience Cloud solutions.
• Experience & knowledge with Web Analytics or Digital Marketing.
• Experience & knowledge with Google Cloud platforms.
• Experience & knowledge with Data Science, ML/AI, R or Jupyter.