Senior Software Engineer - Data Acquisition

Wood Mackenzie Ltd; Gurugram District; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Wood Mackenzie Ltd in Gurugram is hiring a Senior Software Engineer to design, build, and maintain data scraping pipelines and associated infrastructure. You will collaborate across teams to advance the Data Acquisition platform, focusing on scalable, secure, and resilient systems using Python, AWS, and CI/CD pipelines.

The role combines hands-on development with technical leadership and cloud deployment in a hybrid setup.

Qualifications

• Strong experience in Python and AWS, including CI/CD.
• Web-based app development, microservices, and cloud deployment.
• Knowledge of scalable, secure data platforms and cross-team collaboration.

Responsibilities

• Develop and maintain data scraping pipelines and infrastructure.
• Collaborate with teams to solve technical problems across Python, AWS, CI/CD.
• Build web apps, support microservices, and deploy in cloud environments.
• Lead adoption of platform capabilities and contribute to Data Platform evolution.

Skills

Python

AWS

CI/CD

Web-based development

Microservices

Cloud deployment

Linux/Unix

Collaboration

Tools

Docker

Terraform

ECS

Lambda

Glue

TypeScript/Node.js

Job description

## Senior Software Engineer - Data AcquisitionApplyremote type: Hybridlocations: Gurugram, INtime type: Full timeposted on: Posted Todayjob requisition id: JR2988Wood Mackenzie is the global leader in analytics, insights and proprietary data across the entire energy and natural resources landscape.For over 50 years our work has guided the decisions of the world’s most influential energy producers, utilities companies, financial institutions and governments.Now, with the world’s energy system more complex and interconnected than ever before, sector-specific views are no longer enough. That’s why we’ve redefined what’s possible with Intelligence Connected.By fusing our unparalleled proprietary data with the sharpest analytical minds, all supercharged by Synoptic AI, we deliver a clear, interconnected view of the entire value chain. Our trusted team of 2,700 experts across 30 countries breaks siloes and connects industries, markets and regions across the globe.This empowers our customers to identify risk sooner, spot opportunities faster and recalibrate strategy with confidence – whether planning days, weeks, months or decades ahead.Wood Mackenzie Intelligence Connected**WoodMac.com** **Wood Mackenzie Brand Video****Wood Mackenzie Values*** Inclusive – we succeed together* Trusting – we choose to trust each other* Customer committed – we put customers at the heart of our decisions* Future Focused – we accelerate change* Curious – we turn knowledge into actionWe are seeking a **Senior Software Engineer** with extensive years of experience to join our Data Acquisition team. In this role, you will design, develop, and maintain systems and data scraping pipelines. You will collaborate across teams, contributing to the technical evolution of our platform while ensuring scalable, resilient, and secure solutions.**Key Responsibilities:*** Develop, maintain, and enhance systems and infrastructure for Data Scraping pipelines.* Collaborate with multiple teams to solve complex technical problems, particularly around Python, AWS, and CI/CD pipelines.* Build web-based applications, support microservices, and deploy them in cloud environments with a focus on data platform infrastructure.* Contribute to engineering initiatives and guide technical adoption across teams using the Data Platform.* Implement modern software engineering practices including test automation, architectural principles, and best practices for data platform development.* Ensure solutions are scalable, resilient, and secure.* Work closely with technical leadership to drive the technical evolution of the Data Platform.* Enable other teams to adopt new platform capabilities through collaboration and knowledge sharing.**About You:*** Have strong experience in Python and AWS, including CI/CD.* Solid experience in web-based application development, microservices architecture, and cloud deployment.* Excellent communication and collaboration skills, with the ability to work across teams.* Deep understanding of modern software engineering principles and practices applied to data platforms.* Experience with developing scalable, resilient, and secure systems.* Recognizes the importance of people in software development and works effectively with cross-functional teams.**Technical Skillsets:*** We are looking for an experienced engineer with strong expertise in designing and operating scalable AWS-based data and backend platforms. The role requires hands-on proficiency in ECS, Terraform-driven infrastructure automation, Lambda, Glue, Docker/ECR, and Python.* Familiarity with CloudFormation, Jenkins CI/CD pipelines, TypeScript/Node.js, and Datahub or modern metadata/data catalogue platforms will be considered a strong plus.#LI-DB1