AWS Engineer - Bangalore

Tech Mahindra; Bengaluru; Hybrid; INR 1,200,000 - 1,500,000; Full time

Job summary

Tech Mahindra is seeking a data engineer to design and operate configuration-driven ingestion and transformation pipelines using AWS Glue, Redshift, and Lambda in Bengaluru. You will build automated CI/CD for data products and implement robust testing frameworks for data quality and performance.

Collaboration with data modelers and architects is essential to ensure solutions meet business needs. The role emphasizes monitoring, observability, and adherence to best practices in data engineering

Qualifications

• Bachelor's degree or equivalent in Computer Science, Data Engineering, or related field.
• 5+ years of experience in data engineering and pipeline development.
• AWS Data Analytics or AWS Developer certification is a plus.

Responsibilities

• Develop configuration-driven ingestion and transformation pipelines using AWS Glue, Lambda, and Redshift.
• Implement CI/CD pipelines for automated build, test, and deployment of data products.
• Establish automated test frameworks for schema validation, data quality, and performance testing.
• Set up monitoring and observability dashboards for product-level metrics (CloudWatch, custom metrics).
• Collaborate with data modelers and architects to align with business requirements.

Skills

Python

SQL

Shell scripting

Education

Bachelor's degree in Computer Science or related field

Tools

AWS Glue

AWS Redshift

S3

AWS Lambda

CloudWatch

Terraform

Jenkins

AWS CodePipeline

Job description

Key Responsibilities

• Data Pipelines: Develop configuration-driven ingestion and transformation pipelines using AWS Glue, Lambda, and Redshift.
• Automation: Implement CI/CD pipelines for automated build, test, and deployment of data products.
• Testing: Establish automated test frameworks for schema validation, data quality, and performance testing.
• Monitoring: Set up monitoring and observability dashboards for product-level metrics (CloudWatch, custom metrics).
• Collaboration: Work with data modelers and architects to ensure alignment with business requirements.

Required Skills

• Programming: Proficiency in Python, SQL, and shell scripting.
• AWS Expertise: Hands-on experience with AWS services (Glue, Redshift, S3, Lambda, CloudWatch).
• Automation: Experience with CI/CD tools (Terraform, Jenkins, AWS CodePipeline).
• Data Integration: Strong knowledge of ETL/ELT processes and frameworks.
• Soft Skills: Strong problem-solving, collaboration, and communication skills.

Qualifications

• Bachelors degree in Computer Science, Data Engineering, or related field.
• 5+ years of experience in data engineering and pipeline development.
• AWS Certified Data Analytics or AWS Certified Developer is a plus.