Senior Data Engineer - I

Philips; Bengaluru; On-site; INR 3,500,000 - 5,500,000; Full time

Job summary

Philips in Bengaluru seeks a Senior Data Engineer - I to build the data extraction, transformation, and loading infrastructure across diverse sources using SQL and AWS. You will optimize ETLs to boost data accuracy, stability, and pipeline performance while leveraging AWS Redshift, Hadoop, and MapReduce.

Experience with Airflow, AWS Glue, S3, EMR, and streaming pipelines (Kafka/Kinesis) is desirable to deliver scalable data solutions.

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Science or related fields.
• Minimum 10 years of experience with a Bachelor's degree, or a Master’s with no required experience.
• Office-based collaboration with in-person work at least 3 days per week.

Responsibilities

• Build infrastructure for ELT from diverse data sources using SQL and AWS.
• Develop, maintain and optimize ETLs to improve data accuracy, stability and availability.
• Utilize big data tools like Redshift, Hadoop and MapReduce to support pipelines.
• Work with Airflow, AWS Glue, S3, EMR for streaming/data integration.
• Ensure data quality and compliance through validation and governance.

Skills

SQL

Data engineering

ETL

Big data

Cloud AWS

Airflow

Kafka

Education

Bachelors/Masters in CS or Data Science

Equivalent AI/Stats degree

Tools

AWS Redshift

Hadoop

MapReduce

Airflow

AWS Glue

S3

AWS EMR

Kafka

Kinesis

Job description

• Build the infrastructure required for extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS technologies
• Develop, maintain and optimize ETLs to increase data accuracy, data stability, data availability and pipeline performance
• Strong knowledge in the Big data tools such as AWS Redshift, Hadoop, map reduce etc.
• Having knowledge in tools like Airflow, AWS Glue, S3, AWS EMR, Streaming data pipelines, Kafka/Kinesis is desirable
• Assists in solving data engineering challenges by analyzing data issues and applying simple solutions, working under general supervision.
• Helps develop technical solutions by integrating data from different sources and conducting basic feasibility checks.
• Supports complex data requests and queries by ensuring detailed and accurate responses that align with business needs and advanced technical capabilities, providing guidance and insights.
• Ensures data accuracy in reports by following validation and verification protocols, maintaining exemplary data quality standards, and ensuring compliance with industry regulations.
• Develops and optimizes algorithms to transform raw data into detailed statistical analyses to drive informed decision-making and enhance business operations.
• Automates the generation of advanced data analysis charts and graphs, enhancing reporting processes' efficiency and improving data visualizations' clarity and utility.
• Extracts detailed information on specific data sets quickly and efficiently, providing comprehensive analyses that support critical business operations and decision-making processes.
• Responds promptly to queries from various business units, offering expert guidance on data trends and providing in-depth insights on product or trend-specific concerns.
• Suggests improvements by evaluating existing tools, systems, and databases, identifying opportunities for enhancements, and recommending solutions to drive innovation.
• Documents statistical-based trending procedures and validates analysis processes in strict compliance with regulatory requirements, ensuring transparency, adherence to industry standards.

Job Title

Senior Data Engineer - I

Job Description

Your role:

• Build the infrastructure required for extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS technologies
• Develop, maintain and optimize ETLs to increase data accuracy, data stability, data availability and pipeline performance
• Strong knowledge in the Big data tools such as AWS Redshift, Hadoop, map reduce etc.
• Having knowledge in tools like Airflow, AWS Glue, S3, AWS EMR, Streaming data pipelines, Kafka/Kinesis is desirable
• Assists in solving data engineering challenges by analyzing data issues and applying simple solutions, working under general supervision.
• Helps develop technical solutions by integrating data from different sources and conducting basic feasibility checks.
• Supports complex data requests and queries by ensuring detailed and accurate responses that align with business needs and advanced technical capabilities, providing guidance and insights.
• Ensures data accuracy in reports by following validation and verification protocols, maintaining exemplary data quality standards, and ensuring compliance with industry regulations.
• Develops and optimizes algorithms to transform raw data into detailed statistical analyses to drive informed decision-making and enhance business operations.
• Automates the generation of advanced data analysis charts and graphs, enhancing reporting processes' efficiency and improving data visualizations' clarity and utility.
• Extracts detailed information on specific data sets quickly and efficiently, providing comprehensive analyses that support critical business operations and decision-making processes.
• Responds promptly to queries from various business units, offering expert guidance on data trends and providing in-depth insights on product or trend-specific concerns.
• Suggests improvements by evaluating existing tools, systems, and databases, identifying opportunities for enhancements, and recommending solutions to drive innovation.
• Documents statistical-based trending procedures and validates analysis processes in strict compliance with regulatory requirements, ensuring transparency, adherence to industry standards.

Minimum Required Education

Bachelor's / Master's Degree in Computer Science, Information Management, Data Science, Econometrics, Artificial Intelligence, Applied Mathematics, Statistics or equivalent.

Minimum Required Experience

Minimum 10 years of experience with Bachelor's in areas such as Data Handling, Data Analytics, AI Modeling or equivalent OR no prior experience required with Master's Degree.

How We Work Together

We believe that we are better together than apart. For our office-based teams, this means working in-person at least 3 days per week.

About Philips

We are a health technology company. We built our entire company around the belief that every human matters, and we won't stop until everybody everywhere has access to the quality healthcare that we all deserve. Do the work of your life to help the lives of others.

• Learn more about our business.
• Discover our rich and exciting history.
• Learn more about our purpose.