Analyst

Merck Group; Bengaluru; On-site; INR 2,600,000 - 4,200,000; Full time

Job summary

Merck Group in Bengaluru is seeking a seasoned Snowflake Data Engineer to design and maintain complex data pipelines, implement robust ETL processes, and optimize data flows across the platform. You will work with SQL, Python, DBT, and Azure DevOps to deliver scalable data solutions, ensure data quality, and support stakeholders with reliable analytics and reporting.

The role requires 5+ years of hands-on experience in data engineering, strong SQL and Python skills, and a solid understanding of

Qualifications

• Bachelor's or Master's degree in computer science, information technology, or a related field.
• At least 5 years in Snowflake development or a similar data engineering role.
• Strong SQL and Python for data manipulation and analysis.

Responsibilities

• Develop and maintain complex data pipelines and ETL processes in Snowflake.
• Write efficient SQL queries for data extraction, transformation, and loading.
• Utilize Python for advanced data processing and automation tasks.
• Implement and oversee data modelling techniques (OLTP, OLAP, Data Vault 2.0).
• Collaborate with data architects, analysts, and stakeholders to design scalable data solutions.
• Manage and optimize CI/CD pipelines using Azure DevOps for deployment of data solutions.
• Ensure data quality, integrity, and compliance throughout the data lifecycle.
• Troubleshoot, optimize, and enhance existing data processes for performance.
• Document data models, processes, and workflows for knowledge sharing.
• DBT development: models, macros, and tests for data transformations in Snowflake.
• Version control management using Git repositories for code collaboration.
• Performance tuning in Snowflake to optimize query performance and data processing time.

Skills

Snowflake

SQL

Python

DBT

Azure DevOps

ETL pipelines

Data modeling

Git

CI/CD

Data governance

Education

Bachelor's / Master's in CS / IT or related

Tools

Azure DevOps

DBT

Git

Snowflake

Job description

• Develop and maintain complex data pipelines and ETL processes in Snowflake.
• Write efficient and optimized SQL queries for data extraction, transformation, and loading.
• Utilize Python for advanced data processing, automation tasks, and integration with other systems.
• Implement and oversee data modelling techniques, including OLTP, OLAP, and Data Vault 2.0 methodologies.
• Collaborate with data architects, analysts, and stakeholders to design optimal and scalable data solutions.
• Manage and optimize CI/CD pipelines using Azure DevOps for seamless deployment of data solutions.
• Ensure data quality, integrity, and compliance throughout the data lifecycle.
• Troubleshoot, optimize, and enhance existing data processes and queries for performance improvements.
• Document data models, processes, and workflows clearly for future reference and knowledge sharing.
• Performance Tuning: Implement advanced techniques for performance tuning methodologies in Snowflake to optimize query performance and reduce data processing time.
• DBT Development: Develop and maintain DBT models, macros, and tests for managing data transformations in Snowflake.
• Version Control Management: Manage version control using Git repositories, enabling seamless code management and collaboration.
• CI/CD Pipeline Development & Automation: Design, implement, and maintain automated CI/CD pipelines using Azure DevOps for Snowflake and DBT deployment processes.
• Impacts the effectiveness of own work team through the quality and timeliness of the work produced.
• Largely works within standardized procedures and practices to achieve objectives and meet deadlines and gains some discretion in problem solving.

Key Accountabilities

• Develop and maintain complex data pipelines and ETL processes in Snowflake.
• Write efficient and optimized SQL queries for data extraction, transformation, and loading.
• Utilize Python for advanced data processing, automation tasks, and integration with other systems.
• Implement and oversee data modelling techniques, including OLTP, OLAP, and Data Vault 2.0 methodologies.
• Collaborate with data architects, analysts, and stakeholders to design optimal and scalable data solutions.
• Manage and optimize CI/CD pipelines using Azure DevOps for seamless deployment of data solutions.
• Ensure data quality, integrity, and compliance throughout the data lifecycle.
• Troubleshoot, optimize, and enhance existing data processes and queries for performance improvements.
• Document data models, processes, and workflows clearly for future reference and knowledge sharing.
• Performance Tuning: Implement advanced techniques for performance tuning methodologies in Snowflake to optimize query performance and reduce data processing time.
• DBT Development: Develop and maintain DBT models, macros, and tests for managing data transformations in Snowflake.
• Version Control Management: Manage version control using Git repositories, enabling seamless code management and collaboration.
• CI/CD Pipeline Development & Automation: Design, implement, and maintain automated CI/CD pipelines using Azure DevOps for Snowflake and DBT deployment processes.
• Impacts the effectiveness of own work team through the quality and timeliness of the work produced.
• Largely works within standardized procedures and practices to achieve objectives and meet deadlines and gains some discretion in problem solving.

Qualifications

• Bachelor's/master's degree in computer science, Information Technology, or a related field.

Experience

• Minimum of 5 years of proven experience as a Snowflake Developer or in a similar data engineering role.
• Extensive hands-on experience with SQL and Python, demonstrating proficiency in data manipulation and analysis.
• Significant industry experience working with DBT (Data Build Tool) for data transformation.
• Strong familiarity with CI/CD pipelines, preferably in Azure DevOps.
• Deep understanding of data modelling techniques ( OLTP, OLAP ) and best practices.

CANDIDATE'S PROFILE

Work Experience

• Minimum of 5 years of proven experience as a Snowflake Developer or in a similar data engineering role.
• Extensive hands-on experience with SQL and Python, demonstrating proficiency in data manipulation and analysis.
• Significant industry experience working with DBT ( Data Build Tool ) for data transformation.
• Strong familiarity with CI/CD pipelines, preferably in Azure DevOps.
• Deep understanding of data modelling techniques (OLTP, OLAP, DBT) and best practices.

Preferred Qualifications

• Experience in working with large datasets and performance tuning in Snowflake.
• Familiarity with data governance, data security best practices, and compliance standards.
• Knowledge of additional data technologies ( e.g., AWS, Azure ) is a plus.
• Experience in leading projects or mentoring junior developers is advantageous.