Aws Data Engineer(29 drive)

Tata Consultancy Services; Hyderabad, Chennai District; On-site; INR 1,200,000 - 2,100,000; Full time

Job summary

Tata Consultancy Services in Hyderabad seeks a data engineer with 4–5+ years of hands-on experience across AWS, Redshift, and cloud data platforms. You will design and maintain data warehouses, build complex ETL/ELT pipelines, and ensure scalable data integrations in an agile environment.

You should be proficient in SQL, Python (pandas, numpy, Flask), and data monitoring and validation frameworks to deliver robust data solutions for real-time and batch workloads.

Qualifications

• 4-5+ years of experience with AWS (including Redshift) and other cloud technologies.
• 4-5+ years of experience designing and maintaining data warehouses (e.g., Redshift, Big Query) as well as building complex ETL/ELT pipelines.
• Expertise in working with real-time and batch data pipelines, including API-based integration workflows.
• Experience in maintaining and executing data onboarding blueprints which map source and target data strategies and aggregations.
• Advanced SQL proficiency, including concepts such as query optimization, indexing, and partitioning.
• Hands-on experience with Python for data-related processes, using libraries like pandas, numpy, and frameworks like Flask.
• Experience with data monitoring, detection, troubleshooting as well as validation frameworks.
• Proven track record of delivering well-designed, well-tested and performant software solutions and pipelines within an agile environment.

Responsibilities

• Designing and maintaining data warehouses (e.g., Redshift, BigQuery) and building complex ETL/ELT pipelines.
• Working with real-time and batch data pipelines and API-based integration workflows.
• Maintaining and executing data onboarding blueprints mapping source and target data strategies.
• Advanced SQL proficiency including query optimization, indexing and partitioning.
• Hands-on Python for data processes using pandas, numpy, and Flask.
• Data monitoring, detection, troubleshooting, and validation frameworks.
• Delivery of well-designed, well-tested, and performant software pipelines in an agile environment.

Skills

AWS & Cloud

Data warehouse design

ETL/ELT pipelines

Real-time & batch pipelines

API integration

Data onboarding

Advanced SQL

Python for data

Data monitoring

Agile

Job description

• 4-5+ years of experience with AWS (including Redshift) and other cloud technologies
• 4-5+ years of experience designing and maintaining data warehouses (e.g., Redshift, Big Query) as well as building complex ETL/ELT pipelines.
• Expertise in working with real-time and batch data pipelines, including API-based integration workflows.
• Experience in maintaining and executing data onboarding blueprints which map source and target data strategies and aggregations.
• Advanced SQL proficiency, including concepts such as query optimization, indexing, and partitioning.
• Hands-on experience with Python for data-related processes, using libraries like pandas, numpy, and frameworks like Flask.
• Experience with data monitoring, detection, troubleshooting as well as validation frameworks.
• Proven track record of delivering well-designed, well-tested and performant software solutions and pipelines within an agile environment.