Data Engineer

WSP in India; Bengaluru; Hybrid; INR 800,000 - 1,100,000; Full time

Job summary

WSP India is seeking a Data Engineer to build and own the data engineering layer on the Microsoft Fabric platform for the Australia Mining team. You will ingest data from engineering tools, transform it into clean, AI-ready datasets, and power dashboards and reporting across the business.

This greenfield role demands taking ownership, navigating ambiguity, and making foundational architectural decisions to scale across the organisation. Flexible hybrid work in India may apply.

Qualifications

• Must have minimum 7–10 years of experience with Microsoft Fabric platforms and data engineering
• Microsoft Fabric certification – DP 600, DP700s would be advantageous
• Experience building end-to-end data pipelines, data modelling, and BI readiness

Responsibilities

• Build and maintain Data Factory pipelines for API-based data ingestion (REST, OData)
• Develop Python ETL scripts for extraction and ingestion
• Create and maintain Spark/Python notebooks and SQL-based transformations
• Develop Dataflows Gen2 for handling Excel/CSV data
• Implement incremental loads, CDC patterns, and data quality checks
• Integrate data from Dataverse and other sources into Fabric
• Support Bronze→Silver→Gold transformations and star schema modelling
• Prepare datasets for AI/ML workloads and notebook development
• Design and optimise Power BI semantic models (Direct Lake)
• Monitor pipeline performance and cost, maintain documentation

Skills

Microsoft Fabric

Python

SQL

ETL scripting

Data pipelines

Power BI

Spark

Notebooks

Git

Azure DevOps

Tools

Data Factory

Dataverse

Power Query

Git

Azure DevOps

Job description

WSP India is currently seeking Data Engineer for Australia Mining team. They shall be responsible for supporting our AU business through GCC. This role is responsible for designing, building, and maintaining the data engineering layer of our Microsoft Fabric platform. The Data Engineer will own the end-to-end data pipeline lifecycle — from ingesting raw data out of engineering and construction tools through to delivering clean, modelled, AI-ready datasets that power reporting, dashboards, and decision-making across the business.

This is a greenfield opportunity — the successful candidate will be instrumental in shaping the platform from the ground up, making foundational decisions on standards, and patterns that will scale across the organisation. We are looking for someone who takes genuine ownership, thrives in ambiguity, and is energised by the challenge of building something from scratch rather than maintaining an existing setup.

Responsibilities

• Build and maintain Data Factory pipelines for API-based data ingestion (REST, OData).
• Develop Python ETL scripts for custom extraction, API polling, and file ingestion.
• Develop and maintain Spark/Python notebooks (Python/PySpark) and SQL-based transformation logic.
• Create Dataflows Gen2 (Power Query) for handling Excel/CSV-based messy data.
• Implement incremental loads, watermarking, and CDC patterns.
• Integrate data from Dataverse and other enterprise sources into Fabric.
• Own Bronze → Silver transformations (cleansing, deduplication, standardisation)
• Support Silver → Gold transformations (star schema, fact/dimension modelling)
• Prepare feature datasets for AI/ML workloads and support notebook-based model development
• Implement data quality frameworks (validation rules, anomaly detection)
• Build and optimise Power BI semantic models (Direct Lake)
• Prepare datasets for reporting and basic analytics use cases.
• Monitor pipeline performance, platform health, and Fabric capacity (F64+), including cost optimisation.
• Maintain documentation (data dictionaries, pipeline inventory, architecture decisions)
• Manage Fabric capacity — pause/resume scheduling, scaling, and cost optimisation

Key Competencies / Skills:

• Microsoft Fabric - Hands-on with Lakehouse, Warehouse, Data Factory, Dataflows Gen2, Notebooks, OneLake.
• Python/SQL - Strong experience in ETL scripting, data engineering, transformation logic and notebook development.
• Working knowledge of file formats, partitioning strategies, ACID transactions, schema evolution
• Power BI - Semantic Model Creation, DAX fundamentals, Direct Lake mode configuration.
• Star Schema Design – Fact/dimension modelling, slowly changing dimensions (SCD), aggregation patterns.
• Data Factory / ETL — Pipeline design, REST/OData connectors, incremental loads, error handling.
• Git / CI/CD — Version control practices, Fabric deployment pipelines, Azure DevOps integration.
• Must be able to prioritize, multitask as well as work independently.
• Must be able to maintain quality of work and at the same time meet multiple deadlines.
• Excellent interpersonal skills cum responsiveness to others
• Strong technical skills which demonstrate the ability to implement and maintain an enterprise level reporting solution.

Desirable:

• Experience with Microsoft Dataverse and Power Apps integration
• Familiarity with Microsoft Purview for governance and cataloguing
• Understanding of the EPCM project lifecycle — feasibility through construction and commissioning
• Experience with Agile / iterative delivery in small, cross-functional teams
• Experience working in enterprise environments, particularly in the engineering and construction sector
• Exposure to project controls data — schedules (P6/MSP), cost systems, document management, EVM.

Qualifications

• Must have minimum 7-10 years of experience with
• Microsoft Fabric certification – DP 600, DP700s would be advantageous.

About Us

WSP is one of the world\'s leading professional services consulting firms. We are dedicated to our local communities and propelled by international brainpower. We are technical experts and strategic advisors including engineers, technicians, scientists, architects, planners, surveyors and environmental specialists, as well as other design, program and construction management professionals. We design lasting solutions in the Transportation & Infrastructure, Property & Buildings, Earth & Environment, Power & Energy, Resources and Industry sectors, as well as offering strategic advisory services. Our talented people around the globe engineer projects that will help societies grow for lifetimes to come.

With approximately 4,000 talented people across 3 locations (Noida, Bengaluru & Mumbai offices) in India and more than 73,000 globally, in 550 offices across 40 countries, we engineer projects that will help societies grow for lifetimes to come.

At “WSP” we draw on the diverse skills and capabilities of our employees globally to compete for the most exciting and complex projects across the world and bring the same level of expertise to our local communities. We are proud to be an international collective of innovative thinkers who work on the most complex problems. Unified under one strong brand, we use our local expertise, international reach and global scale to prepare our cities and environments for the future, connect communities and help societies thrive in built and natural ecosystems. True to our guiding principles, our business is built on four cornerstones: Our People, Our Clients, Our Operational Excellence and Our Expertise.

www.wsp.com

We are

• Passionate people doing purposeful and sustainable work that helps shape our communities and the future.
• A collaborative team that thrives on challenges and unconventional thinking.
• A network of experts channeling our curiosity into creating solutions for complex issues.

Inspired by diversity, driven by inclusion, we work with passion and purpose.

Working with Us

At WSP, you can access our global scale, contribute to landmark projects and connect with the brightest minds in your field to do the best work of your life. You can embrace your curiosity in a culture that celebrates new ideas and diverse perspectives. You can experience a world of opportunity and the chance to shape a career as unique as you.

Our Hybrid Working Module

With us, you can operate in a flexible, agile, yet structured work environment and follow a Hybrid Work Model.

• Maximize collaboration.
• Maintain product quality and cultural integrity.
• Balance community, collaboration, opportunity, productivity, and efficiency.

Health, Safety and Wellbeing

Our people are our greatest asset, and we prioritize a safe work environment. Health, safety, and wellbeing are integral to our culture, with each of us accountable for fostering a safe workplace through our “Making Health and Safety Personal” initiative. Our Zero Harm Vision drives us to reduce risks through innovative solutions, earning recognition for our global health and safety practices with RoSPA Health and Safety Awards for six consecutive years.

Inclusivity and Diversity

WSP India is dedicated to fostering a sustainable and inclusive work environment where our greatest strength - Our People -feel valued, respected, and supported. We ensure an unbiased approach in hiring, promotion, and performance evaluation, regardless of age, gender identity, race, religion, sexual orientation, marital status, physical ability, education, social status, or cultural background.

Imagine a better future for you and a better future for us all.

Join our close-knit community of over 73,300 talented global professionals dedicated to making a positive impact. Together, we can make a difference in communities both near and far.

With us, you can.

Apply today.