Data Software Engineer

EPAM Systems Inc; Coimbatore District; Hybrid; INR 1,800,000 - 2,800,000; Full time

Job summary

EPAM Systems Inc is hiring an AWS / Azure Data Engineer in Coimbatore to design, build, and maintain scalable data pipelines. You will develop cloud-based data solutions on AWS and Azure, handling large-scale data processing and performance optimization.

The role requires hands-on Python and Spark/PySpark with Databricks, plus strong ETL/ELT experience and production-grade data engineering skills.

Qualifications

• 5-10 years of experience in data engineering.
• Design, develop, and maintain scalable data pipelines.
• Cloud-based data solutions on AWS and Azure.
• Strong ETL/ELT experience using Python, Spark/PySpark, and Databricks.

Responsibilities

• Design, develop, and maintain scalable data pipelines and data engineering solutions.
• Build and optimize ETL/ELT pipelines using Python, Spark/PySpark, and Databricks.
• Develop cloud-based data solutions on AWS/Azure and work with large-scale data processing.
• Implement data integration, transformation, and performance optimization across data platforms.

Skills

Python

Spark / PySpark

Databricks

ETL/ELT

AWS Glue

AWS Lambda

AWS Redshift

Azure Data Bricks

Tools

Azure Data Bricks

Databricks

Kafka

Job description

AWS / Azure Data Engineer

Experience: 5 - 10 Years
Role: Data Engineer / Data Software Engineer

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and data engineering solutions.
• Build and optimize ETL/ELT pipelines using Python, Spark/PySpark, and Databricks.
• Develop cloud-based data solutions on AWS/Azure and work with large-scale data processing.
• Implement data integration, transformation, and performance optimization across data platforms.

Mandatory Skills:

• Strong hands-on experience in Python
• Spark / PySpark
• Databricks
• AWS: Glue, Lambda, Redshift / Azure: Data Bricks
• Strong data engineering and ETL/ELT experience

Nice to Have:

• Kafka
• Snowflake
• Exposure to Azure Data Engineering services

Preferred Profile:

510 years of relevant experience in Data Engineering, with strong experience building production-grade data pipelines and cloud-based data solutions.