Data Engineer

Bayer; Bengaluru; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

Bayer AG is seeking an experienced data engineer to design, build, validate, and maintain scalable data pipelines and data-product components in a cloud environment. You will ingest, transform, and load data from diverse sources, while ensuring data contracts, governance, and cost efficiency.

You will mentor teammates and optimize performance across Spark, PySpark, Snowflake, and Databricks stacks. The role requires 6+ years of experience, strong SQL/Python, and hands-on AWS experience (S3, IAM,

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, Information Technology, or a related field.
• 6+ years of experience in data engineering or a related role.
• Proficiency in SQL, Python, PySpark, Spark, or Java/Scala/R.
• Experience with Snowflake, Databricks, or AWS SageMaker Unified Studio.
• Hands-on with AWS services (S3, IAM, Lake Formation, Glue, Lambda).
• Knowledge of data governance, access control, lineage, and compliance.

Responsibilities

• Build, test, and maintain scalable data pipelines and data-product components.
• Ingest, transform, and load data from IoT devices, operational systems, or clinical sources.
• Troubleshoot pipeline failures, data-quality issues, and performance bottlenecks.
• Document data lineage, pipeline designs, and runbooks; ensure data contracts.
• Coach colleagues on data-engineering patterns and cloud tooling.

Skills

Data governance

RESTful APIs

CI/CD practices

Documentation

Education

Bachelor's degree in Computer Science or related field

Tools

SQL

Python

PySpark

Spark

Java

Scala

R

Snowflake

Databricks

AWS SageMaker

AWS S3

IAM

Lake Formation

AWS Glue

Lambda

Terraform

Git

GitHub

CI/CD

Job description

Apply cloud and big-data engineering skills to build, test, and maintain data pipelines and data-product components using tools such as Spark, dbt, Airflow, or equivalent cloud-native services. Execute ingestion, transformation, and loading jobs that reliably move data from operational systems, IoT devices, or clinical sources into data platforms at agreed SLAs. Troubleshoot pipeline failures, data-quality anomalies, and performance bottlenecks, diagnosing root causes and implementing fixes without service disruption. Validate that implemented pipelines meet data contracts, schema standards, and access-control policies defined by data architects and governance teams. Optimize pipeline performance and cloud infrastructure costs by profiling job runtimes, partitioning strategies, and resource configurations. Document pipeline designs, data lineage, and operational runbooks in shared repositories accessible to data consumers and support teams. Coach less-experience colleagues on data-engineering patterns, testing practices, and cloud-platform tooling used in the assigned domain.

Reference Code: 894554

Required - Bachelor's degree in Computer Science, Data Engineering, Information Technology, or a related field, 6+ years of experience Proficiency in SQL, Python, PySpark, Spark, or another Programming language, such as Java, Scala or R Proven experience building highly scalable, performant, resilient, and cost-optimized data pipelines Experience with modern data processing frameworks, such as Snowflake, Databricks, or AWS SageMaker Unified Studio Hands-on experience with core AWS services, including Amazon S3, IAM, Lake Formation, AWS Glue, Lambda, and related services required to build, operate, and secure end-to-end data solutions Strong understanding of relational databases and modern lakehouse table formats (Apache Iceberg, Delta Lake) Expertise in design, build, maintain and document conceptual, logical, and physical data models Sound understanding of data governance principles, access control, data cataloging, lineage, encryption, auditability, and compliance requirements. Ability to implement secure cloud environments and role-based access controls using IAM and Lake Formation. Familiarity with the concept of Retrieval-Augmented Generation (RAG) data pipelines Familiarity with data architecture patterns, such as data hub, mesh, or fabric Experience with RESTful APIs and data integration Familiarit with the Data Product concept and hands-on implications Relevant certifications (e.g., GCP Certified, AWS Certified, Azure Certified) Demonstrated experience with Terraform for infrastructure automation, together with Git, GitHub, GitHub Actions, and CI/CD practices. Experience with GxP and computerized system validation