Associate Data Engineer

AstraZeneca; Chennai District; On-site; INR 1,400,000 - 1,900,000; Full time

Job summary

AstraZeneca is seeking an Associate Data Engineer in Chennai to run and enhance cloud pipelines powering decisions across 85+ markets. You will ensure timely, high-quality data delivery and collaborate with global teams to keep data flowing reliably.

The role emphasizes maintaining ETL scripts in Python, API-based job orchestration with Postman, and governance of data flows across AWS services, with a strong focus on automation and quality control.

Qualifications

• Experience maintaining end-to-end ETL pipelines and Python scripts.
• Proficient in Python (Pandas, PySpark) for data transformations.
• Proficient in Postman for API-based job executions.
• SQL proficiency using tools like DBeaver to query and validate relational data.
• AWS services proficiency across Redshift, S3, and EMR.
• Familiar with secure file transfers (WinSCP).
• Strong monitoring, troubleshooting, and problem-solving skills.
• Excellent documentation and organizational abilities.
• Ability to work independently and coordinate across teams.

Responsibilities

• Implement and monitor end-to-end data pipelines and ETL jobs.
• Maintain and modify Python scripts for data quality and performance.
• Manage data storage and exchanges across AWS services like Redshift, S3, EMR.
• Trigger and validate jobs using API interfaces and Postman.
• Track inbound/outbound files and maintain observability to prevent data breaks.
• Investigate failures, remediate issues, and drive durable fixes.
• Collaborate with data providers, custodians, and DevOps teams.
• Keep pipeline docs, schedules and configurations up to date.
• Participate in data quality reviews with Data Stewards.
• Identify opportunities to standardize and automate operations.

Skills

Python

Postman

SQL

Monitoring

Troubleshooting

Documentation

Independence

Coordination

Tools

PyCharm

Pandas

PySpark

DBeaver

WinSCP

Postman

Git

AWS

EMR

S3

Redshift

Job description

Introduction To Role

Are you ready to keep mission-critical data flowing at global scale and turn incidents into improvements that boost reliability? As an Associate Data Engineer, you will run and enhance the cloud pipelines that power decisions across 85+ markets, ensuring timely, high-quality data reaches the people who need it most.

Job Title: Associate Data Engineer

GCL : C3

Are you ready to keep mission-critical data flowing at global scale and turn incidents into improvements that boost reliability? As an Associate Data Engineer, you will run and enhance the cloud pipelines that power decisions across 85+ markets, ensuring timely, high-quality data reaches the people who need it most.

Accountabilities

• Pipeline Operations: Implement and monitor end-to-end data pipelines and ETL jobs across multiple stages to ensure on-time, high-quality delivery at scale.
• Data Transformation: Maintain and modify Python (Pandas, PySpark) scripts in line with evolving business needs to improve data quality and performance.
• Cloud Data Management: Manage data storage and protected data exchanges across AWS S3, Redshift, and EMR, keeping data flows accurate and compliant.
• API Orchestration: Trigger and validate jobs using Postman and other API interfaces to keep schedules on track and detect issues early.
• Data Flow Governance: Track inbound and outbound files, log exceptions, and maintain observability to prevent and detect data breaks.
• Incident Response and Root Cause Analysis: Investigate and remediate pipeline failures or delays, implement durable fixes, and drive automation that reduces repeat incidents.
• Teamwork and Collaborator Management: Work closely with data providers, data custodians, and DevOps teams to assure pipeline health and data accuracy across global collaborators.
• Documentation and Versioning: Keep pipeline documentation, job schedules, and technical configurations up to date; support code enhancements and environment updates.
• Quality Control: Participate in data quality procedures with Data Stewards to validate releases and safeguard trust in data products.
• Continuous Improvement: Identify and implement opportunities to standardize, simplify, and automate operations, increasing reliability and throughput over time.

Essential Skills/Experience

• Python (PyCharm, Pandas, PySpark) for maintaining ETL scripts and automation routines
• Postman for testing and triggering API-based job executions
• SQL proficiency using tools such as DBeaver to query and validate relational data
• AWS services proficiency across Redshift, S3, and EMR for processing and storage
• WinSCP or equivalent tools for secure file transfers
• Proactive, structured approach to monitoring and troubleshooting
• Strong programming and analytical problem-solving abilities
• Excellent documentation and organizational skills
• Ability to work independently and coordinate across functional teams

Desirable Skills/Experience

• Familiarity with Git and version control systems
• 5-8 years of experience in data engineering, production support, or data operations
• Background handling large-scale data workflows in cloud environments
• Experience working in pharmaceutical or healthcare data ecosystems
• Consistent track record resolving performance bottlenecks and job failures
• Familiarity with DevOps principles and agile ways of working

Why AstraZeneca

Here, data engineering fuels real-world impact. You’ll work with modern cloud platforms and digital tools, side by side with unexpected combinations of experts - engineers, data stewards, and market teams in the same room - turning bold ideas into operational reality. We move with urgency and clarity, blending imagination with rigor to strengthen how the business runs today while preparing for tomorrow. Your contribution will help colleagues across the globe focus on what matters most, translating into faster, smarter decisions that ultimately benefit patients. We value patience alongside ambition, and we back curiosity with the support and autonomy needed to deliver significant results.

Date Posted

12-Aug-2026

Closing Date

27-Aug-2026

AstraZeneca embraces diversity and equality of opportunity. We are committed to building an inclusive and diverse team representing all backgrounds, with as wide a range of perspectives as possible, and harnessing industry-leading skills. We believe that the more inclusive we are, the better our work will be. We welcome and consider applications to join our team from all qualified candidates, regardless of their characteristics. We comply with all applicable laws and regulations on non-discrimination in employment (and recruitment), as well as work authorization and employment eligibility verification requirements.