Data Engineer (AWS+Pyspark)

Zensar Technologies; Hyderabad; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

Zensar Technologies is seeking a Data Engineer to design, build, and support scalable data pipelines on AWS in Hyderabad. The role requires strong Python and PySpark skills, deep SQL expertise, and hands-on experience with core AWS services such as Lambda, RDS, Glue, and EMR.

You will implement end-to-end data ingestion, transformation, and processing with robust monitoring and security practices. Ideal candidates have 4–7 years of hands-on experience, strong debugging skills, and a track record

Qualifications

• 4-7 years of hands-on experience as a Data Engineer.
• Proficient in Python and PySpark.
• Strong SQL with large datasets across relational and analytical DBs.
• Hands-on with AWS core services (Lambda, RDS, CloudWatch, CloudTrail, SNS, SQS).
• Experience with AWS data/analytics services (IAM, EMR, Glue, Lake Formation, DynamoDB).
• Strong IAM management skills and least-privilege access enforcement.
• End-to-end data ingestion, transformation, and processing pipelines.
• Monitoring, logging, and alerting using CloudWatch and CloudTrail.
• Excellent debugging and root-cause analysis for data pipelines.

Responsibilities

• Design, build, and support data pipelines on AWS.
• Implement and optimize data ingestion and transformation processes.
• Ensure robust monitoring, logging, and alerting for pipelines and AWS services.
• Troubleshoot issues and perform root-cause analysis across data pipelines.

Skills

Python

PySpark

SQL

AWS

Data pipelines

Big data

Monitoring

Troubleshooting

Root cause analysis

Tools

AWS Lambda

RDS

CloudWatch

CloudTrail

SNS

SQS

EMR

AWS Glue

Lake Formation

DynamoDB

Job description

• 4-7 years of hands-on experience as a Data Engineer, designing, building, and supporting data pipelines on AWS.
• Strong programming skills in Python and PySpark, with hands-on experience in distributed data processing and big data frameworks.
• Strong SQL expertise, including complex query writing, performance optimization, and working with large datasets across relational and analytical databases.
• Proven experience working with AWS core services, including Lambda, RDS, CloudWatch, CloudTrail, SNS, and SQS.
• Hands-on experience with AWS data and analytics services such as: IAM, EMR, AWS Glue, Lambda, Lake Formation, RDS, DynamoDB, and related services.
• Strong expertise in IAM management, including role design, policy creation, permission boundaries, and enforcing least-privilege access.
• Experience in building and maintaining end-to-end data ingestion, transformation, and processing pipelines.
• Solid understanding of monitoring, logging, and alerting, leveraging CloudWatch and CloudTrail.
• Excellent debugging, troubleshooting, and root cause analysis skills across data pipelines and AWS services.