Data Engineer

Biopharma Asia; Bengaluru; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Bayer is seeking a Data Engineer to design and operate reliable data pipelines that deliver high-quality data to multiple stakeholders. You will work with Spark, PySpark, SQL, and modern cloud-native tools to enable timely analytics and decision-making across the pharma value chain.

You will ingest, transform, and load data from operational and IoT sources, troubleshoot issues, and optimize cloud resources while ensuring data contracts and security policies are met.

Qualifications

• Bachelor’s degree in CS/IT with 6+ years of experience.
• Proficiency in SQL, Python, PySpark, Spark, or Java/Scala/R.
• Proven experience building scalable, performant data pipelines.
• Experience with Snowflake, Databricks, or AWS SageMaker.
• Hands-on with core AWS services (S3, IAM, Lake Formation, Glue, Lambda).
• Strong understanding of relational databases and lakehouse formats.
• Knowledge of data governance, access control, lineage, encryption, and compliance.

Responsibilities

• Build, test, and maintain reliable data pipelines and data-product components.
• Ingest, transform, and load data from systems into data platforms with SLAs.
• Troubleshoot pipeline failures, data-quality issues, and performance bottlenecks.
• Ensure pipelines meet data contracts, schemas, and access-control policies.
• Optimize pipeline performance and cloud costs.
• Document data lineage, designs, and runbooks in shared repositories.
• Coach junior engineers on data-engineering patterns and tooling.

Skills

SQL

Python

PySpark

Spark

Java

Scala

R

Education

Bachelor’s degree in Computer Science / IT

Tools

Snowflake

Databricks

AWS SageMaker

S3

IAM

Lake Formation

AWS Glue

Terraform

Job description

At Bayer we’re visionaries, driven to solve the world’s toughest challenges and striving for a world where ,Health for all, Hunger for none’ is no longer a dream, but a real possibility. We’re doing it with energy, curiosity and sheer dedication, always learning from unique perspectives of those around us, expanding our thinking, growing our capabilities and redefining ‘impossible’. There are so many reasons to join us. If you’re hungry to build a varied and meaningful career in a community of brilliant and diverse minds to make a real difference, there’s only one choice.

Data Engineer

POSITION PURPOSE:

As a Data Engineer, you are developing and operating reliable data pipelines that enable timely access to high-quality data assets.

You are part of a dynamic team of technical experts, working hand-in-hand with subject matter experts, data product managers, semantic experts and data scientists to create data products that help Bayer to accelerate time-to-market, drive innovation and enhance efficiency across the whole pharma value chain.

YOUR TASKS AND RESPONSIBILITIES:

Apply cloud and big-data engineering skills to build, test, and maintain data pipelines and data-product components using tools such as Spark, dbt, Airflow, or equivalent cloud-native services.

Execute ingestion, transformation, and loading jobs that reliably move data from operational systems, IoT devices, or clinical sources into data platforms at agreed SLAs.

Troubleshoot pipeline failures, data-quality anomalies, and performance bottlenecks, diagnosing root causes and implementing fixes without service disruption.

Validate that implemented pipelines meet data contracts, schema standards, and access-control policies defined by data architects and governance teams.

Optimize pipeline performance and cloud infrastructure costs by profiling job runtimes, partitioning strategies, and resource configurations.

Document pipeline designs, data lineage, and operational runbooks in shared repositories accessible to data consumers and support teams.

Coach less-experience colleagues on data-engineering patterns, testing practices, and cloud-platform tooling used in the assigned domain.

WHO YOU ARE:

Required -

Bachelor’s degree in Computer Science, Data Engineering, Information Technology, or a related field, 6+ years of experience

Proficiency in SQL, Python, PySpark, Spark, or another Programming language, such as Java, Scala or R

Proven experience building highly scalable, performant, resilient, and cost-optimized data pipelines

Experience with modern data processing frameworks, such as Snowflake, Databricks, or AWS SageMaker Unified Studio

Hands-on experience with core AWS services, including Amazon S3, IAM, Lake Formation, AWS Glue, Lambda, and related services required to build, operate, and secure end-to-end data solutions

Strong understanding of relational databases and modern lakehouse table formats (Apache Iceberg, Delta Lake)

Expertise in design, build, maintain and document conceptual, logical, and physical data models

Sound understanding of data governance principles, access control, data cataloging, lineage, encryption, auditability, and compliance requirements. Ability to implement secure cloud environments and role-based access controls using IAM and Lake Formation.

Preferred –

Familiarity with the concept of Retrieval-Augmented Generation (RAG) data pipelines

Familiarity with data architecture patterns, such as data hub, mesh, or fabric

Experience with RESTful APIs and data integration

Familiarit with the Data Product concept and hands-on implications

Relevant certifications (e.g., GCP Certified, AWS Certified, Azure Certified)

Demonstrated experience with Terraform for infrastructure automation, together with Git, GitHub, GitHub Actions, and CI/CD practices.

Experience with GxP and computerized system validation

Ever feel burnt out by bureaucracy? Us too. That's why we're changing the way we work- for higher productivity, faster innovation, and better results. We call it Dynamic Shared Ownership (DSO). Learn more about what DSO will mean for you in your new role here

https://www.bayer.com/enfstrategyfstrategy

YOUR APPLICATIONBayer is an equal opportunity employer that strongly values fairness and respect at work. We welcome applications from all individuals, regardless of race, religion, gender, age, physical characteristics, disability, sexual orientation etc. We are committed to treating all applicants fairly and avoiding discrimination.

Location:India : Karnataka : BangaloreDivision:Enabling FunctionsReference Code:894554Contact Us+ 022-25311234