Senior Software Engineer - Data Acquisition

Wood Mackenzie; Gurugram District; On-site; INR 2,600,000 - 4,200,000; Full time

Job summary

Wood Mackenzie is seeking a Senior Software Engineer to join the Data Acquisition team. You will design, develop, and maintain data scraping pipelines and related systems, collaborating across teams to evolve the platform with scalable, secure solutions in AWS.

The role emphasizes hands-on Python, AWS, CI/CD, and microservices development, with responsibilities spanning infrastructure, deployments, and cross-team collaboration to advance the Data Platform.

Qualifications

• Strong experience with Python and AWS, including CI/CD.
• Experience in web-based application development and microservices.

Responsibilities

• Develop, maintain, and enhance data scraping pipelines and related infrastructure.
• Collaborate with multiple teams to solve technical problems around Python, AWS, and CI/CD.
• Build and deploy web-based applications and microservices in cloud environments.
• Guide technical adoption across teams using the Data Platform and ensure scalable, secure solutions.

Skills

Python

AWS

CI/CD

Microservices

Cloud deployment

Tools

Terraform

Docker

ECS

Jenkins

DataHub

Job description

Wood Mackenzie is the global leader in analytics, insights and proprietary data across the entire energy and natural resources landscape.

For over 50 years our work has guided the decisions of the world’s most influential energy producers, utilities companies, financial institutions and governments.

Now, with the world’s energy system more complex and interconnected than ever before, sector-specific views are no longer enough. That’s why we’ve redefined what’s possible with Intelligence Connected.

By fusing our unparalleled proprietary data with the sharpest analytical minds, all supercharged by Synoptic AI, we deliver a clear, interconnected view of the entire value chain. Our trusted team of 2,700 experts across 30 countries breaks siloes and connects industries, markets and regions across the globe.

This empowers our customers to identify risk sooner, spot opportunities faster and recalibrate strategy with confidence – whether planning days, weeks, months or decades ahead.

WoodMac.com

• Inclusive – we succeed together
• Trusting – we choose to trust each other
• Customer committed – we put customers at the heart of our decisions
• Future Focused – we accelerate change
• Curious – we turn knowledge into action

We are seeking a Senior Software Engineer with extensive years of experience to join our Data Acquisition team. In this role, you will design, develop, and maintain systems and data scraping pipelines. You will collaborate across teams, contributing to the technical evolution of our platform while ensuring scalable, resilient, and secure solutions.

Key Responsibilities

• Develop, maintain, and enhance systems and infrastructure for Data Scraping pipelines.
• Collaborate with multiple teams to solve complex technical problems, particularly around Python, AWS, and CI/CD pipelines.
• Build web-based applications, support microservices, and deploy them in cloud environments with a focus on data platform infrastructure.
• Contribute to engineering initiatives and guide technical adoption across teams using the Data Platform.
• Implement modern software engineering practices including test automation, architectural principles, and best practices for data platform development.
• Ensure solutions are scalable, resilient, and secure.
• Work closely with technical leadership to drive the technical evolution of the Data Platform.
• Enable other teams to adopt new platform capabilities through collaboration and knowledge sharing.

About You

• Have strong experience in Python and AWS, including CI/CD.
• Solid experience in web-based application development, microservices architecture, and cloud deployment.
• Excellent communication and collaboration skills, with the ability to work across teams.
• Deep understanding of modern software engineering principles and practices applied to data platforms.
• Experience with developing scalable, resilient, and secure systems.
• Recognizes the importance of people in software development and works effectively with cross‑functional teams.

Technical Skillsets

• We are looking for an experienced engineer with strong expertise in designing and operating scalable AWS-based data and backend platforms. The role requires hands‑on proficiency in ECS, Terraform‑driven infrastructure automation, Lambda, Glue, Docker/ECR, and Python.
• Familiarity with CloudFormation, Jenkins CI/CD pipelines, TypeScript/Node.js, and Datahub or modern metadata/data catalogue platforms will be considered a strong plus.