Aws Data Engineer Lead

Teksystems; Hyderabad, Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Teksystems in Hyderabad, India is seeking an experienced data engineer with strong AWS data services focus to design and optimize large-scale ETL pipelines and data warehouses. You will work with PySpark, Python and SQL to build reliable data models, leverage Redshift, Glue, EMR, and S3, and implement scalable cloud architectures for high availability.

The role requires deep knowledge of data lakes, data warehouses, and big data processing frameworks, plus hands-on experience with Hadoop and

Qualifications

• In-depth knowledge of ETL/ELT processes, data modeling, and data warehousing.
• Knowledge of data lakes, data warehouses, and big data processing frameworks like Hadoop and Spark.
• Proficiency in handling structured and unstructured data.

Responsibilities

• Design, implement, and optimize ETL/ELT data pipelines.
• Model and organize data for scalable analytics and reporting.
• Collaborate with cloud infrastructure teams to ensure high availability and fault tolerance.

Skills

AWS Glue

Amazon EMR

Amazon Redshift

PySpark

Python

SQL

Tools

AWS Glue

Amazon EMR

Amazon Redshift

PySpark

Python

SQL

Job description

Role & responsibilities

AWS Glue, Amazon EMR, Amazon Redshift,Pyspark,Python,SQL

Cloud and AWS Expertise

In-depth knowledge of AWS services related to data engineering: EC2, S3, RDS, DynamoDB, Redshift, Glue, Lambda, Step Functions, Kinesis, Iceberg,EMR, and Athena.

Strong understanding of cloud architecture and best practices for high availability and fault tolerance.

Data Engineering Concepts

• Expertise in ETL/ELT processes, data modeling, and data warehousing.
• Knowledge of data lakes, data warehouses, and big data processing frameworks like Apache Hadoop and Spark.
• Proficiency in handling structured and unstructured data.

Programming and Scripting

• Proficiency in Python, Pyspark and SQLfor data manipulation and pipeline development.
• Expertise in working with data warehousing solutions like Redshift.

10+yrs