Data Engineer II

Thermofisher; Bengaluru; On-site; INR 1,500,000 - 3,000,000; Full time

Job summary

ThermoFisher Scientific in Bangalore is seeking a Data Engineer II to design and deliver data pipelines on the Enterprise Data Platform, enabling real-time and batch processing for multiple teams. You will collaborate with admins, developers and analysts to ensure scalable, high-quality data solutions and drive data governance.

The role requires 4+ years in data engineering, 2+ years with Cloud BI on AWS/Azure, and strong PySpark/SQL/Python skills, plus familiarity with LLMs to boost

Qualifications

• 4+ years in data solutions delivery.
• 2+ years building Cloud BI solutions on AWS or Azure.
• Experience with agile DevOps/Data Ops/Data Sec Ops practices.
• 4+ years of programming in SQL, PySpark and Python.
• Strong written, verbal and interpersonal communication.

Responsibilities

• Build, test, and optimize data pipelines for real-time and batch processing.
• Collaborate with admins, developers, data engineers and analysts to deliver functionality.
• Drive data quality and integrity in DWH and AWS platforms for BI/analytics.

Skills

Data engineering

Cloud BI

SQL

PySpark

Python

DevOps

Agile

Communication

Problem solving

LLMs

Tools

Snowflake

Azure Data

Databricks

Power BI

Tableau

PostgreSQL

MySQL

MongoDB

Cassandra

Job description

Work Schedule

Standard (Mon-Fri)

Environmental Conditions

Office

Job Description

Job Title –Data Engineer II

Job Location: Bangalore, India

About Company:

ThermoFisher Scientific Inc. is the world leader in serving science, with revenues of more than $40 billion and approximately 1,20,000 employees globally. Our Mission is to enable our customers to make the world healthier, cleaner, and safer. We help our customers accelerate life sciences research, solve complex analytical challenges, improve patient diagnostics, deliver medicines to market and increase laboratory productivity.

About the Team

Our Automation, AI, and Data (AAD) team empowers Thermo Fisher Scientific colleagues to integrate cutting-edge digital solutions into their daily workflows, enhancing innovation and efficiency. Our goal is to democratize automation, AI, and data, remove bottlenecks, and to bring clarity to new ways of working that prepare us for the future. By leveraging these advancements, we are better equipped to serve our customers and support our mission to make the world healthier, cleaner and safer.

What will you do?

As a data engineer, you will play a key role in strengthening our data engineering capabilities delivering data engineering pipelines and solutions through Enterprise Data Platform (EDP) for various groups and divisions.

General Job Functions

• Perform source to target data analysis and mappings.
• Build, test, and optimize data pipelines for various use-cases, including real-time and batch processing, based on specific requirements.
• Collaborate with admins, developers, data engineers and analysts for successful functionality delivery
• Perform requirement analysis and co-ordinate with project managers and development team to drive the delivery cycle.
• Collaborate with the scrum master on product backlogs and helps with sprint planning.
• Supports the evolution of EDP architecture and takes part in roadmap activities around data platform architecture initiatives or changes.
• Collaborate with leadership and stakeholders to ensure data quality and integrity in DWH & AWS platforms for BI/Analytical reporting.
• Pre-meditate any risks well in advance and communicate to stakeholders to formulate the plan of action to mitigate any risks.
• Follow agile development methodologies to deliver solutions and product features by following DevOps practices.
• Ensure the teams follow the prescribed development processes and approaches.
• Knowledge of Large Language models and proven experience in developing LLM applications to improve the productivity of data engineering.
• Build most efficient Pyspark pipelines ensuring the operational costs are kept to a minimum.

Must have skills and experience

• 4+ years of overall work experience with 3+ years exclusively in delivering data solutions.
• 2+ years of proven experience building Cloud BI solutions using AWS or Azure.
• Experience with agile development methodologies by following DevOps, Data Ops and Dev Sec Ops practices.
• 4+ years of programming in SQL, Pyspark and Python.
• Excellent written, verbal and interpersonal and partner communication skills.
• Excellent Analysis and business requirement documentation skills.
• Ability to work with multi-functional teams from multiple regions/ time zones by optimally demonstrating multi-form communication (Email, MS Teams for voice and chat, meetings)
• Excellent prioritization and problem-solving skills.
• GPT, Large Language Models, Retreival augmented Generation.

Good to have skills

• Hands on experience with Snowflake or Azure data engineering.
• Knowledge of SQL and NoSQL databases like PostgreSQL, MySQL, MongoDB Cassandra.
• Experience in building data pipelines in Databricks.
• Data visualization experience using tools such as Power BI or Tableau.
• Knowledge of data governance practices, data quality, and data security.
• Relevant certifications in data engineering on cloud platforms.
• Basic understanding of machine learning and Generative AI concepts.

Our Mission is to enable our customers to make the world healthier, cleaner, and safer. Watch as our colleagues explain 5 reasons to work with us. As one team of 1,20,000 colleagues, we share a common set of values - Integrity, Intensity, Innovation and Involvement - working together to accelerate research, solve complex scientific challenges, drive technological innovation and support patients in need.

ThermoFisher Scientific is an EEO/Affirmative Action Employer and does not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability or any other legally protected status.