AWS Redshift Senior Data Engineer

Tata Consultancy Services; Hyderabad, Chennai District, Bengaluru; On-site; INR 2,400,000 - 4,200,000; Full time

Job summary

Tata Consultancy Services is seeking an AWS Redshift Senior Data Engineer to lead data transformation initiatives and build scalable data pipelines for diverse client projects in India.

The role requires 7+ years' experience with AWS, Redshift, and data warehouses, plus hands-on Python, SQL, and API integration skills. You will design robust ETL/ELT processes, implement data quality checks, and deliver actionable insights via dashboards.

Qualifications

• 7+ years of experience with AWS (including Redshift) and cloud technologies.
• Designing and maintaining data warehouses and ETL/ELT pipelines.
• Experience with API integrations and data onboarding.
• Advanced SQL and data modeling capabilities.

Responsibilities

• Lead the development of automated data management and reporting solutions.
• Develop Python scripts to interact with ad platforms via APIs (Facebook Ads, Google Ads, programmatic platforms).
• Provide mentorship on Python, data engineering, and API integrations.
• Develop data quality checks and validation procedures.
• Monitor automated jobs and troubleshoot data issues.
• Develop and manage interactive dashboards delivering client insights.
• Collaborate with third-party data providers for access to essential data.

Skills

AWS Redshift

Data Warehouses

ETL/ELT

Python scripting

SQL proficiency

API integrations

Real-time pipelines

Batch pipelines

Data monitoring

Agile delivery

Communication skills

Job description

Role: AWS Redshift

Exp:7+ Years

Location: Bangalore, Hyderabad, Chennai

Title: AWS Redshift Senior Data Engineer

Location: India

Reporting to: Solution Architect

Role Summary and Impact:

The Manager, Data Engineering, reports to Solutions Architect and is responsible for leading data transformation initiatives, building scalable data management and engineering solutions, and enabling data-driven decision-making for clients. This role bridges business needs, media performance, and technology by designing robust data pipelines, workflows and advanced automation solutions. You'll be part of a team that believes in doing work that matters - for people and the planet, extending this impact directly to our client's strategic objectives.

What will you do :

• Lead the development of automated data management and reporting solutions, reducing manual reporting efforts and significantly improving reporting efficiency and turnaround time.
• Develop and maintain Python scripts to interact with various advertising platforms through API integrations (e.g., Facebook Ads, Google Ads, Programmatic Ads Platforms), enabling seamless data extraction and loading to desired platforms.
• Provide mentorship and technical guidance to team members, promoting the adoption of best practices in Python scripting, data engineering, and API integrations.
• Development and maintain data quality checks and procedures, helping stakeholders overcome data issues before they impact the quality of the reporting solutions.
• Monitor automated jobs, troubleshooting data issues as-and-when they arise
• Develop and manage interactive dashboards to deliver actionable insights for clients.
• Support the development of strong working relationships with third-party data providers that we rely on for access to necessary data.

What youll need :

• Exceptional communication skills and can communicate effectively to both technical and non-technical stakeholders.
• 7+ years of experience with AWS (including Redshift) and other cloud technologies
• 7+ years of experience designing and maintaining data warehouses (e.g., Redshift, Big Query) as well as building complex ETL/ELT pipelines.
• Expertise in working with real-time and batch data pipelines, including API-based integration workflows.
• Experience in maintaining and executing data onboarding blueprints which map source and target data strategies and aggregations.
• Advanced SQL proficiency, including concepts such as query optimization, indexing, and partitioning.
• Hands-on experience with Python for data-related processes, using libraries like pandas, numpy, and frameworks like Flask.
• Experience with data monitoring, detection, troubleshooting as well as validation frameworks.
• Proven track record of delivering well-designed, well-tested and performant software solutions and pipelines within an agile environment.