Aws Data Engineer

Crescendo Global Leadership Hiring India; Bengaluru; On-site; INR 1,500,000 - 2,600,000; Full time

Job summary

Crescendo Global Leadership Hiring India in Bengaluru is seeking a hands-on Data Engineer with 3 to 5 years of experience. You will design and develop robust ETL/ELT pipelines, and work with SQL and Python to transform and load data efficiently.

The role requires strong AWS experience (Redshift, Lambda, S3, Glue preferred, IAM, CloudWatch), Airflow for orchestration, data warehousing concepts, Git, and a mindset for best practices, testing, and collaboration.

Qualifications

• 3 to 5 years of hands-on experience in Data Engineering.
• Strong experience in designing and developing ETL/ELT pipelines.
• Proficiency in SQL and Python programming.
• Hands-on experience with AWS services, including: Amazon Redshift, AWS Lambda, Amazon S3, AWS Glue (preferred), AWS IAM, Amazon CloudWatch.
• Experience with workflow orchestration tools such as Apache Airflow (preferred).
• Understanding of data warehousing concepts and dimensional data modeling.
• Knowledge of version control systems such as Git.
• Experience writing unit tests and following software development best practices.
• Strong analytical, problem-solving, and debugging skills.
• Ability to manage multiple tasks and work effectively in a collaborative environment.

Skills

Data Engineer

SQL

Python

Problem-solving

Collaboration

Agile/Scrum

Analytical thinking

Communication skills

Multi-tasking

DevOps practices

Education

Bachelors degree in computer science, Software Engineering, MIS or equivalent combination of education and experience

Tools

Amazon Redshift

AWS Lambda

Amazon S3

AWS Glue

AWS IAM

Amazon CloudWatch

Apache Airflow

Git

Spark

PySpark

Databricks

CI/CD

Job description

3 to 5 years of hands-on experience in Data Engineering.

• Strong experience in designing and developing ETL/ELT pipelines.
• Proficiency in SQL and Python programming.
• Hands-on experience with AWS services, including:

• oAmazon Redshift
• oAWS Lambda
• oAmazon S3
• oAWS Glue (preferred)
• oAWS IAM
• oAmazon CloudWatch

• Experience with workflow orchestration tools such as Apache Airflow (preferred).
• Understanding of data warehousing concepts and dimensional data modeling.
• Knowledge of version control systems such as Git.
• Experience writing unit tests and following software development best practices.
• Strong analytical, problem-solving, and debugging skills.

• Ability to manage multiple tasks and work effectively in a collaborative environment.
• Preferred Skills

• Experience with CI/CD pipelines and DevOps practices.
• Knowledge of Spark, PySpark, or Databricks is an advantage.
• Exposure to AI/ML data pipelines and feature engineering.
• Familiarity with Agile/Scrum development methodologies.
• AWS Certification (Developer Associate or Data Engineer Associate) is a plus.
• EDUCATION: Bachelors degree in computer science, Software Engineering, MIS or equivalent combination of education and experience
• KEY SKILLS: Data Engineer, AWS, Python, Pyspark, ETL and SQL