AWS Data Engineer

Zone IT Solutions Pty Ltd; Hyderabad; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Zone IT Solutions is seeking an AWS Data Engineer in Hyderabad to design scalable data pipelines and processes. You will work with AWS Lambda, Step Functions, Python, PySpark, and Databricks to transform data and build robust data solutions.

Ideal candidates have hands-on experience with ETL, large data processing, and databases like PostgreSQL or MongoDB. The role emphasizes CI/CD, testing, and collaboration with software engineers in a fast-paced environment.

Qualifications

• Experience designing data pipelines and ETL workflows.
• Hands-on with AWS Lambda and Step Functions.
• Proficient in Python, PySpark and Databricks.
• Experience with large data processing and data transformation.

Responsibilities

• Design and develop data transformation pipelines using AWS Lambda, Step Functions, Python, PySpark, and Databricks.
• Build and maintain complex data calculation engines and business logic.
• Process and manage large datasets efficiently.
• Work with PostgreSQL and/or MongoDB databases.
• Contribute to automation, testing, CI/CD, and deployment processes.
• Participate in code reviews, design discussions, and technical planning.
• Collaborate closely with Software Engineers and cross-functional teams.

Skills

AWS Lambda

AWS Step Functions

Python

PySpark

Databricks

ETL/Data Transformation

Large Data Processing

Job description

We are looking for an AWS Data Engineer with strong hands-on experience in AWS, Python, PySpark, and Databricks to build scalable data transformation pipelines and support complex data processing solutions.

Key Responsibilities

• Design and develop data transformation pipelines using AWS Lambda, Step Functions, Python, PySpark, and Databricks.
• Build and maintain complex data calculation engines and business logic.
• Process and manage large datasets efficiently.
• Work with PostgreSQL and/or MongoDB databases.
• Contribute to automation, testing, CI/CD, and deployment processes.
• Participate in code reviews, design discussions, and technical planning.
• Collaborate closely with Software Engineers and cross-functional teams.

Must-Have Skills

• AWS – Lambda & Step Functions
• Python
• PySpark & Databricks
• ETL/Data Transformation & Large Data Processing

Good to Have:

AWS Certification, CI/CD, automation, and strong software engineering practices.

About Us

We specialise in Digital, ERP, and larger IT Services. We offer flexible, efficient and collaborative solutions to any organization that requires IT, experts. Our agile, agnostic, and flexible solutions will help you source the IT Expertise you need.

Also follow our LinkedIn page for new job opportunities and more.

Zone IT Solutions is an equal opportunity employer and our recruitment process focuses on essential skills and abilities. We encourage applications from a diverse array of backgrounds, including individuals of various ethnicities, cultures, and linguistic backgrounds, as well as those with disabilities.