Azure Data Engineer

Wipro Technologies; Toronto; On-site; CAD 77,000 - 120,000; Full time

Job summary

Wipro Limited in Toronto, Canada, invites an IT Professional with 8+ years of SDLC experience specializing in Azure stack to architect and implement scalable data solutions using Azure data services and Power BI.

You will design data pipelines with Azure Data Factory, Databricks, Synapse, Snowflake, and manage data models in Azure SQL Database and Data Lake, while building near real-time data processing and governance frameworks.

Qualifications

• 8+ years of experience in SDLC with a focus on Azure stack.
• Experience designing scalable data pipelines and data models in Azure.
• Proficiency in writing complex SQL and managing data warehousing solutions.

Responsibilities

• Design and implement scalable data pipelines using Azure Data Factory, Databricks, Synapse, and Snowflake.
• Develop data models and optimized storage in Azure SQL Database and Data Lake (Blob Storage).
• Build near real-time data pipelines, EDWs and Data Marts with governance and reporting in Power BI.

Skills

Pyspark

SparkSQL

Spark

Tools

Azure Databricks

Azure Data Factory

Azure Synapse Analytics

Snowflake

Azure Data Lake

Azure SQL Server

Azure Data Studio

Power BI

Job description

Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world. For additional information, visit us at www.wipro.com.

Job Description

• IT Professional 8+ years of comprehensive experience in the Software Development Life Cycle (SDLC), specializing in Azure stackwith a proven track record of leveraging Microsoft Azure/Cloud Servicesto architect and implement scalable data solutions. Skilled in utilizing SQL Data Warehouse, Azure SQL Server, Snowflake, Azure Data Lake, Azure Blob Storage, Azure Databricks, and Azure Data Factoryfor efficient data processing, storage, and analytics (power BI)
• Design and implement scalable data pipelines using Azure Data Factory, Azure Databricks, Synapse and Snowflake Analytics.
• Develop data models and optimized data storage solutions using Azure SQL Database, and Azure Data Lake (Blob Storage).
• Experience in Azure fabric frame work (creating lake house, ware houses)
• Experience in working with One lake and delta lake for fabric workspaces.
• Experience in migration of on-premises data warehouse to Snowflake, Azure Synapse Analytics, enhancing data accessibility and reporting capabilities.
• Experience in designing and developing scalable data processing frameworks using Apache Spark, enabling efficient processing and analysis of large datasets in both batch and streaming modes.
• Proficiency in Pyspark, SparkSQLfor developing notebooks in Databricks
• Experience in Spark SQL for developing notebooks in synapse.
• Have Worked on Event Hubs for processing streaming data in to Databricks.
• Experience in loading/writing data in to Azure data lake using ADF, Databricks, Synapse Analytics
• Proficiency in writing complex SQL queriesand stored procedures. Proficient in optimizing data-base performance, ensuring efficient data retrieval, and implementing robust data manipulation logic.
• Proficiency in creating near real-time data pipelines, Enterprise Data Warehouses (EDW), DataMart’s, and audit and control frameworks. Skilled in designing and implementing solutions that ensure data integrity, compliance, and efficient reporting.
• Implemented CI/CD pipelines using Azure DevOps,including automated build, test, and deploy-ment processes.
• Designed and implemented a comprehensive framework of controls for the data governance team, ensuring data adheres to standards of accuracy, completeness, consistency, and compliance.
• Led the design and development of robust data loading frameworks and products, enabling efficient and reliable data ingestion, transformation, and integration across multiple platform

Design and develop dashboards, reports in Power BI too l

Mandatory Skills

DataBricks - Data Engineering.Experience: 5-8 Years.The expected compensation for this role ranges from CAD 77000 to CAD 120000 .

Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.

Wipro is committed to creating an accessible, supportive, and inclusive workplace. Reasonable accommodation will be provided to all applicants including persons with disabilities, throughout the recruitment and selection process. Accommodations must be communicated in advance of the application, where possible, and will be reviewed on an individual basis. Wipro provides equal opportunities to all and values diversity.