Senior Data Engineer

Microsoft; Vancouver; On-site; CAD 114,000 - 204,000; Full time

Job summary

Microsoft is seeking a Data Engineer to architect, analyze, and build data solutions as part of the CE&S BI Team. The ideal candidate will have extensive experience in data modeling, governance practices, and scaling data solutions across enterprise environments. This opportunity involves collaboration with engineering teams to enhance data architecture and address complex data needs, ensuring the integrity and quality of the data throughout its lifecycle. Candidates should possess relevant degrees and combined years of experience in software development and analytics.

Qualifications

• Bachelor’s degree in Computer Science or equivalent with 4+ years of relevant experience.
• 3+ years of delivering large complex solutions, with strong data platform project experience.
• Advanced working knowledge of Spark SQL and Azure-related technologies.

Responsibilities

• Architect and engineer data solutions, focusing on data functions and transformations.
• Collaborate with cross-functional teams to address data-related issues.
• Manage the security and integrity of data throughout its lifecycle.

Skills

Data Science

Data Engineering

Data Modeling

Software Development

Spark SQL

Azure Databricks

SQL

Data Governance

API Knowledge

Power BI

Education

Bachelor’s degree in Computer Science

Master’s Degree in Computer Science

Tools

Azure Data Lake Storage

Azure Data Factory

Azure Synapse

Job description

Responsibilities (Text Only)

- Architect, analyze, build, and engineer data solutions under the scope of the CE&S BI Team. - Build data models and flows for data functions and transformations. - Innovate/Optimize conceptual, logical, and physical data model and design. - Be a Voice of Customer to share insights and best practices, and connect with Engineering team to remove key blockers - Collaborate with architecture, compliance, and peer engineers to contribute and support the design and sustainment of the CE&S BI data architecture and engineering standards. - Manage the availability, usability, integrity, quality and security of the data. - Monitor and implement self-healing processes to maintain data quality and optimal performance throughout the data lifecycle. - Land governance procedures for data integrity. - Work together with cross-functional teams to identify and address data-related issues and support data infrastructure needs. - Embody our culture and values.

Qualifications (Text Only)

Required Qualifications: - Bachelor’s degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years’ experience in business analytics, data science, software development, data modeling or data engineering work - OR Master’s Degree in computer science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years’ experience in business analytics, data science, software development, or data engineering work - OR equivalent experience. - 3+ years of data architecting and delivering large complex solutions to enterprise customers. - 3+ years of experience in large-scale Data Platform and deployment projects. - Advanced working knowledge and hands-on experience in any of the following technologies: Spark SQL, PySpark in Azure Databricks, SQL on Azure SQL DBs and OnPrem SQL server, Azure Data Lake Storage, and Azure Data Factory, Fabric, Azure Synapse. Other Requirements: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: - Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. Preferred Qualifications: - Bachelor's degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 8+ years' experience in business analytics, data science, software development, data modeling or data engineering work - OR Master's Degree in computer science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years’ experience in business analytics, data science, software development, data modeling or data engineering work. - Working knowledge with Application Programming Interface (API). - Advanced Analytics (prefer Azure Data Bricks, data visualization tools such as Power BI). - Knowledge of PowerApps development and power automate flows. - Previous experience in a data governance, MDM and taxonomy design environment and has implemented technological solutions tied to such programs. Data Engineering IC4 - The typical base pay range for this role across Canada is CAD $114,400 - CAD $203,900 per year. Find additional pay information here: Canada pay information | Microsoft Careers Microsoft will accept applications for the role until June 9, 2025. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a requestvia the Accommodation request form. Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.