Data Engineer (AWS+Pyspark)

Zensar Technologies; Hyderabad; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Zensar Technologies seeks a Data Engineer (AWS + PySpark) to develop Spark-based data pipelines in Python. You will optimize large-scale Spark jobs and integrate AWS analytics and compute services.

The role requires hands-on PySpark, Python, and Git experience, with strong knowledge of data warehousing concepts and Parquet data formats.

Qualifications

• 6+ years of relevant experience in Big Data technologies.
• Hands-on Python and PySpark experience is mandatory.
• Build PySpark applications using Spark DataFrames in Python.
• Experience in optimizing Spark jobs processing large data volumes.
• Hands-on with Git version control.
• Experience with AWS Analytics: EMR, Athena, Glue.
• AWS Compute: Lambda, EC2; Storage: S3; SNS experience.
• Good understanding of data warehousing concepts (dimensions, facts, schemas).
• Familiarity with columnar formats like Parquet and compression (Snappy, GZIP).
• Knowledge of AWS databases: Aurora, RDS, Redshift, ElastiCache, DynamoDB.

Responsibilities

• Craft PySpark apps using Spark DataFrames in Python.
• Optimize Spark jobs to handle large data volumes efficiently.
• Leverage AWS analytics services (EMR, Athena, Glue) and compute services (Lambda, EC2).
• Manage version control with Git and collaborate across teams.
• Work with data warehousing concepts and columnar data formats like Parquet.

Skills

Python

PySpark

Big Data

Tools

AWS EMR

AWS Athena

AWS Glue

AWS Lambda

AWS EC2

S3

Amazon SNS

Parquet

DynamoDB

Aurora

RDS

Redshift

ElastiCache

Job description

• Having 6+ yrs years of relevant experience, which includes hands on experience in Big Data technologies.
• Mandatory - Hands on experience in Python and PySpark.
• Build pySpark applications using Spark Dataframes in Python.
• Worked on optimizing spark jobs that processes huge volumes of data.
• Hands on experience in version control tools like Git.
• Worked on Amazon's Analytics services like Amazon EMR, Amazon Athena, AWS Glue.
• Worked on Amazon's Compute services like Amazon Lambda, Amazon EC2 and Amazon's Storage service like S3 and few other services like SNS.
• Good to have knowledge of datawarehousing concepts - dimensions, facts, schemas- snowflake, star etc.
• Have worked with columnar storage formats - Parquet etc. Well versed with compression techniques - Snappy, Gzip.
• Good to have knowledge of AWS databases (atleast one) Aurora, RDS, Redshift, ElastiCache, DynamoDB.am

Job Description

• Having 6+ yrs years of relevant experience, which includes hands on experience in Big Data technologies.
• Mandatory - Hands on experience in Python and PySpark.
• Build pySpark applications using Spark Dataframes in Python.
• Worked on optimizing spark jobs that processes huge volumes of data.
• Hands on experience in version control tools like Git.
• Worked on Amazon's Analytics services like Amazon EMR, Amazon Athena, AWS Glue.
• Worked on Amazon's Compute services like Amazon Lambda, Amazon EC2 and Amazon's Storage service like S3 and few other services like SNS.
• Good to have knowledge of datawarehousing concepts - dimensions, facts, schemas- snowflake, star etc.
• Have worked with columnar storage formats - Parquet etc. Well versed with compression techniques - Snappy, Gzip.
• Good to have knowledge of AWS databases (atleast one) Aurora, RDS, Redshift, ElastiCache, DynamoDB.am

Data Engineer (AWS + pySpark)

About Us

At Zensar, we’re "experience-led everything". We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: Together, we shape experiences for better futures. Whether for our clients, our people, or the world around us, this belief powers everything we do. At the heart of our culture is ONE with Client - a set of four core values that reflect who we are and how we work: One Zensar, Nurturing, Empowering, and Client Focus.

Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. Explore Life at Zensar and join us to Grow. Own. Achieve. Learn. to be the best version of yourself.

We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to race, creed, color, ancestry, religion, sex, national origin, citizenship, age, sexual orientation, gender identity, disability, marital status, family medical leave status, or protected veteran status.