Specialist, Data Engineering

Merck; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Merck in Hyderabad is seeking a Data Engineer to design, build, and maintain data pipelines and infrastructure for large datasets. You will collaborate with data scientists and analysts to ensure reliable access and optimized data for analytics.

The role focuses on ETL/ELT development, data integration across cloud platforms, and adherence to best practices in testing and governance. Strong Python and shell scripting skills are essential, with experience in Informatica and CI/CD tools preferred.

Qualifications

• Bachelor's degree in information technology, Computer Science or any Technology stream.
• 5+ years of experience with enterprise data integration technologies, including Informatica PowerCenter and Informatica IDM Cloud services such as CDI, CAI, Mass Ingest, and Orchestration.
• 5+ years of experience integrating systems through REST and custom APIs.
• 5+ years of experience with relational database technologies and cloud data stores across AWS, GCP, and Azure.
• 2+ years of experience applying the AWS Well-Architected Framework to cloud deployment, integration, and data engineering.
• Preferred experience with CI/CD processes and related tools including Terraform, GitHub Actions, Artifactory.
• Proven expertise in Python and Shell scripting.

Responsibilities

• Develop comprehensive High-Level Technical Design and Data Mapping documents to meet business integration requirements.
• Own data integration and ingestion solutions through the project lifecycle, delivering data flow diagrams and inventories.
• Provide end-to-end delivery ownership for assigned data pipelines with cleansing, processing, and validation.
• Define and implement robust Test Strategies and Test Plans for middleware testing and evidence management.
• Collaborate with Solutions Architecture and Business Analyst teams to analyze system requirements and prototype integration methods.
• Exhibit hands-on leadership, including coding, debugging, and delivering high-quality, scalable products.
• Coordinate across cross-product teams and distributed remote teams to drive complex data initiatives.
• Design ETL/ELT solutions, lead system and integration testing, and establish standards for data integration.

Skills

Data integration

ETL pipelines

REST APIs

Cloud data stores

Python

Shell scripting

CI/CD tooling

Education

Bachelor's degree in information technology, Computer Science or any Technology stream

Tools

Informatica PowerCenter

Informatica IDM Cloud

REST APIs

AWS

GCP

Azure

Terraform

GitHub Actions

Artifactory

Job description

Job Description

The Opportunity: Based in Hyderabad, join a global healthcare biopharma company and be part of a 130- year legacy of success backed by ethical integrity, forward momentum, and an inspiring mission to achieve new milestones in global healthcare.

Be part of an organization driven by digital technology and data-backed approaches that support a diversified portfolio of prescription medicines, vaccines, and animal health products.

Drive innovation and execution excellence. Be a part of a team with passion for using data, analytics, and insights to drive decision-making, and which creates custom software, allowing us to tackle some of the world's greatest health threats.

A focused group of leaders in each Tech Center helps to ensure we can manage and improve each location, from investing in growth, success, and well-being of our people, to making sure colleagues from each IT division feel a sense of belonging to managing critical emergencies. And together, we must leverage the strength of our team to collaborate globally to optimize connections and share best practices across the Tech Centers.

Role Overview: A Data Engineer is responsible for designing, building, and maintaining robust data pipelines and infrastructure that facilitate the collection, storage, and processing of large datasets. They collaborate with data scientists and analysts to ensure data is accessible, reliable, and optimized for analysis. Key tasks include data integration, ETL (Extract, Transform, Load) processes, and managing databases and cloud-based systems. Data engineers play a crucial role in enabling data-driven decision-making and ensuring data quality across organizations.

What will you do in this role:

• Develop comprehensive High-Level Technical Design and Data Mapping documents to meet specific business integration requirements.
• Own the data integration and ingestion solutions throughout the project lifecycle, delivering key artifacts such as data flow diagrams and source system inventories.
• Provide end-to-end delivery ownership for assigned data pipelines, performing cleansing, processing, and validation on the data to ensure its quality.
• Define and implement robust Test Strategies and Test Plans, ensuring end-to-end accountability for middleware testing and evidence management.
• Collaborate with the Solutions Architecture and Business analyst teams to analyze system requirements and prototype innovative integration methods.
• Exhibit a hands-on leadership approach, ready to engage in coding, debugging, and all necessary actions to ensure the delivery of high-quality, scalable products.
• Influence and drive cross-product teams and collaboration while coordinating the execution of complex, technology-driven initiatives within distributed and remote teams.
• Work closely with various platforms and competencies to enrich the purpose of Enterprise Integration and guide their roadmaps to address current and emerging data integration and ingestion capabilities.
• Design ETL/ELT solutions, lead comprehensive system and integration testing, and outline standards and architectural toolkits to underpin our data integration efforts.
• Analyze data requirements and translate them into technical specifications for ETL processes.
• Develop and maintain ETL workflows, ensuring optimal performance and error handling mechanisms are in place.
• Monitor and troubleshoot ETL processes to ensure timely and successful data delivery.
• Collaborate with data analyst and other stakeholders to ensure alignment between data architecture and integration strategies.
• Document integration processes, data mappings, and ETL workflows to maintain clear communication and ensure knowledge transfer.

Primary skills (must-have)

• Bachelor's degree in information technology, Computer Science or any Technology stream
• 5+ years of experience with enterprise data integration technologies, including Informatica PowerCenter and Informatica Intelligent Data Management Cloud services such as CDI, CAI, Mass Ingest, and Orchestration.
• 5+ years of experience integrating systems through REST and custom APIs.
• 5+ years of experience with relational database technologies and cloud data stores across AWS, GCP, and Azure.
• 2+ years of experience applying the AWS Well-Architected Framework to cloud deployment, integration, and data engineering.
• Preferred experience with CI/CD processes and related tools including- Terraform, GitHub Actions, Artifactory etc.
• Proven expertise in Python and Shell scripting, with a strong focus on leverag