Aws Data Engineer

Tech Mahindra; Dadri, Hyderabad, Bengaluru; Hybrid; INR 1,200,000 - 2,400,000; Full time

Job summary

Tech Mahindra is seeking an AWS Data Engineer/Data Analyst with 4-7 years of experience to design, build, and optimize scalable data pipelines on AWS. The role requires strong Python and SQL skills and hands-on experience with AWS services like S3, Glue, Redshift, and Athena.

You will develop ETL/ELT processes, integrate diverse data sources, ensure data quality, and collaborate with data scientists and analysts to deliver data-driven insights.

Qualifications

• 4-7 years of Data Engineering experience.
• Strong hands-on experience in Python and SQL.
• Expertise in AWS services: S3, Glue, Lambda, Redshift, Athena, RDS, EMR (preferred).
• Experience in ETL/ELT pipeline development and data warehousing.

Responsibilities

• Design, develop, and maintain scalable data pipelines on AWS.
• Build and optimize ETL/ELT workflows using Python and SQL.
• Develop data integration solutions for structured and unstructured data sources.
• Implement data transformation, validation, and quality checks.
• Work with AWS data services (S3, Glue, Lambda, Redshift, Athena, EMR, RDS).
• Monitor and troubleshoot data processing workflows; ensure data security and governance.

Skills

Python

SQL

Airflow

Git

Agile

Data Modeling

ETL/ELT

Data Visualization

Tools

Amazon S3

AWS Glue

AWS Lambda

Amazon Redshift

Amazon Athena

Amazon RDS

AWS EMR

Spark

Job description

Position Details:

Role: AWS Data Engineer/AWS Data Analyst

Experience:4-7 years

Location: Pan India

Shift Timing: 2 PM- 10 PM

Job Description

We are seeking a highly skilled AWS Data Engineer with 4+ years of experience in designing, developing, and maintaining scalable data pipelines and cloud-based data solutions. The ideal candidate should have strong expertise in AWS services, Python, and SQL, along with experience in data warehousing and ETL/ELT processes.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines on AWS.
• Build and optimize ETL/ELT workflows using Python and SQL.
• Develop data integration solutions for structured and unstructured data sources.
• Implement data transformation, validation, and quality checks.
• Work with AWS data services such as S3, Glue, Lambda, Redshift, Athena, EMR, and RDS.
• Optimize database performance and write efficient SQL queries.
• Design and maintain data warehouses and data lakes.
• Collaborate with business stakeholders, analysts, and data scientists.
• Monitor and troubleshoot data processing workflows.
• Ensure data security, governance, and compliance standards.

Required Skills

• 4-7 years of Data Engineering experience.
• Strong hands-on experience in Python and SQL.
• Expertise in AWS services:
  • Amazon S3
  • AWS Glue
  • AWS Lambda
  • Amazon Redshift
  • Amazon Athena
  • Amazon RDS
  • AWS EMR (preferred)
• Experience in ETL/ELT pipeline development.
• Knowledge of Data Warehousing concepts and dimensional modeling.
• Experience with Airflow or similar orchestration tools.
• Familiarity with Git and Agile methodologies.

Preferred Skills

• PySpark and Apache Spark.
• Databricks or Snowflake.
• CI/CD and DevOps practices.
• AWS Certifications.