AWS Data Engineer

VMC Soft Technologies, Inc; Chennai District; On-site; INR 1,080,000 - 1,320,000; Part time

Job summary

VMC Soft Technologies, Inc. in Chennai is seeking a Python Data Engineer for a contract-to-hire role. You will build and maintain scalable data pipelines on AWS using Python, PySpark, Glue, EMR, S3, and Redshift.

The ideal candidate has 7-9 years of data engineering experience, strong debugging skills, and hands-on expertise with Airflow to design and run ETL workflows. Immediate joining is preferred.

Qualifications

• 6-8 years of Data Engineering experience.
• Strong hands-on experience with Python and PySpark.
• Experience working with AWS Data & Analytics services (Glue, EMR, S3, Redshift).
• Hands-on experience with Apache Airflow.
• Good understanding of ETL, Data Warehousing, and Big Data concepts.
• Strong problem-solving and debugging skills.

Responsibilities

• Develop and maintain scalable data pipelines using Python and PySpark.
• Design and manage ETL workflows using AWS Glue, EMR, S3, and Redshift.
• Build and schedule data orchestration workflows using Apache Airflow.
• Ensure data quality, validation, monitoring, and pipeline reliability.
• Optimize data processing jobs for performance and scalability.
• Collaborate with analytics, business, and engineering teams to deliver data solutions.
• Troubleshoot production issues and support ongoing data operations.

Skills

Python

PySpark

AWS Glue

AWS EMR

Apache Airflow

AWS S3

AWS Redshift

Job description

Position: Python Data Engineer (C2H)

Location: Chennai

Experience: 7‑9 Years

Budget: Up to 12 LPA Fixed

Employment Type: Contract-to-Hire (C2H)

Notice Period: Immediate Joiners / Max 15 Days

Mandatory Skills

• Python
• PySpark
• AWS Glue
• AWS EMR
• Apache Airflow
• AWS S3
• AWS Redshift

Job Description

We are looking for a skilled Python Data Engineer with 6‑8 years of experience in building and maintaining scalable data pipelines and ETL solutions on AWS. The ideal candidate should have strong hands‑on expertise in Python, PySpark, AWS Glue, AWS EMR, and Apache Airflow.

Key Responsibilities

• Develop and maintain scalable data pipelines using Python and PySpark.
• Design and manage ETL workflows using AWS Glue, EMR, S3, and Redshift.
• Build and schedule data orchestration workflows using Apache Airflow.
• Ensure data quality, validation, monitoring, and pipeline reliability.
• Optimize data processing jobs for performance and scalability.
• Collaborate with analytics, business, and engineering teams to deliver data solutions.
• Troubleshoot production issues and support ongoing data operations.

Required Experience

• 6‑8 years of Data Engineering experience.
• Strong hands‑on experience with Python and PySpark.
• Experience working with AWS Data & Analytics services (Glue, EMR, S3, Redshift).
• Hands‑on experience with Apache Airflow.
• Good understanding of ETL, Data Warehousing, and Big Data concepts.
• Strong problem‑solving and debugging skills.

Screening Criteria (Strict)

• 6‑8 years of relevant Data Engineering experience.
• Strong hands‑on experience in Python, PySpark, AWS Glue, AWS EMR, and Airflow.
• Immediate Joiners or candidates with a notice period of up to 15 days only.
• Budget fitment: Current/Expected CTC within 12 LPA.
• Chennai-based candidates or willing to relocate immediately.