AWS Data Engineer

IDESLABS PRIVATE LIMITED; Hyderabad; On-site; INR 8,00,000 - 15,00,000; Full time

Job summary

A leading technology company in Hyderabad is seeking an experienced AWS Data Engineer with 6 to 7 years of experience. You will design and implement data pipelines using AWS services, ensuring data quality and compliance with standards. Ideal candidates have a strong AWS background and proficiency in programming languages like Python and Java.

Qualifications

• 6 to 7 years of experience in data engineering roles.
• Proficient in programming languages such as Python, Java, or Scala.
• Strong understanding of data modeling and ETL processes.

Responsibilities

• Design, develop, and maintain large-scale data pipelines using AWS services.
• Collaborate with cross-functional teams on project requirements.
• Develop data quality checks and validation processes.

Skills

AWS ecosystem knowledge

Python

Problem-solving

Communication

Tools

AWS S3

AWS Lambda

AWS Step Functions

Redshift

Glue

Athena

Job description

We are looking for a skilled AWS Data Engineer with 6 to 7 years of experience to join our team at IDESLABS PRIVATE LIMITED. The ideal candidate will have a strong background in designing and implementing data pipelines on AWS.

Roles and Responsibility

• Design, develop, and maintain large-scale data pipelines using AWS services such as S3, Lambda, Step Functions, etc.
• Collaborate with cross-functional teams to identify and prioritize project requirements.
• Develop and implement data quality checks and validation processes to ensure data integrity.
• Optimize data processing workflows for performance, scalability, and cost-effectiveness.
• Troubleshoot and resolve complex technical issues related to data engineering projects.
• Ensure compliance with industry standards and best practices for data security and privacy.

Job Requirements

• Strong understanding of AWS ecosystem including S3, Lambda, Step Functions, Redshift, Glue, Athena, etc.
• Experience with data modeling, data warehousing, and ETL processes.
• Proficiency in programming languages such as Python, Java, or Scala.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a fast-paced environment.
• Strong communication and interpersonal skills.