AWS Data Engineer

SP Staffing; New Delhi, Hyderabad; On-site; INR 1,400,000 - 2,200,000; Full time

Job summary

SP Staffing Services Pvt Ltd in New Delhi/Hyderabad is seeking a data engineer with 6-8 years of experience to design, develop, and maintain scalable data transformation pipelines using AWS services (Lambda, Step Functions) and Python.

You will build and optimize data processing workflows with PySpark and Databricks, and design and maintain complex data calculation and transformation engines to manage large-scale datasets efficiently.

Qualifications

• 6-8 years of experience in data engineering or similar roles.
• Strong ability to design scalable data pipelines and processing workflows.

Responsibilities

• Design, develop, and maintain scalable data transformation pipelines using AWS services (Lambda, Step Functions) and Python.
• Build and optimize data processing workflows using PySpark and Databricks.
• Design and maintain complex data calculation and transformation engines.
• Manage and process large-scale datasets efficiently.

Tools

Python

AWS

PySpark

Databricks

Job description

Warm Greetings from SP Staffing Services Pvt Ltd!!!!

Experience:6-8yrs

Work Location: New Delhi/Hyderabad

Job Description:

• Design, develop, and maintain scalable data transformation pipelines using AWS services (Lambda, Step Functions) and Python.


• Build and optimize data processing workflows using PySpark and Databricks.


• Design and maintain complex data calculation and transformation engines.


• Manage and process large-scale datasets efficiently.