Test Lead (Azure- Databricks)

nugget.ai; Mississauga; On-site; CAD 100,000 - 130,000; Full time

Job summary

A leading technology firm is seeking a Quality Engineer with a robust background in Quality Engineering and Canadian banking to develop testing strategies for Data platforms. This pivotal role involves leading complex modernization initiatives and mentoring the testing team, driving high standards of quality in data engineering projects. Candidates should have extensive experience working with various tools and frameworks within the Azure ecosystem.

Qualifications

• 10+ years of experience in Quality Engineering in Data platforms.
• Canadian Banking domain experience.
• Experience leading complex Data Modernization initiatives.

Responsibilities

• Develop a comprehensive Test strategy for Azure Databricks.
• Coordinate UAT and E2E testing activities.
• Design and maintain automated Data test frameworks.

Skills

Testing Azure Databricks

Automation testing

Quality Engineering

Data governance

Problem-solving

Communication

Job description

• Must Have
  • At least 10+ years of work experience in Quality Engineering (Testing) in Data platforms
  • Canadian Banking domain experience
  • Experience in leading and testing large scale, complex Data Modernization initiatives
  • Led Data Platform migration projects such as from Cognos to PowerBI, etc.
  • Automation first mindset
  • Coordinating with Data Engineering, Infrastructure, other Technical teams, etc.
  • Experience working in a matrix organization
  • Stakeholder management across multiple areas such as Business, Infrastructure, Network, IT Custodians, Development, etc.

• Required Skills
  • In-depth knowledge in testing Azure Databricks, Azure ADLS Gen2, Azure Data Factory, Azure PowerBI, SQL Server
  • Excellent coding skills in Python, PySpark, Scala, SQL, Java
  • Excellent analytical and problem-solving skills,communication skills
  • Knowledge in Data testing, ETL testing, implementation of Automation test frameworks in Data platforms
  • Knowledge in Data governance, Data pipeline framework, Data ingestion, Data ops, Data profiling, Unity catalog, etc.
  • Proactive in identifying gaps and raising issues; Self-motivated, possessing initiative to get things done with high quality

• Job description
  • Identify, prepare and develop a comprehensive Test strategy/approach to test Azure Databricks ecosystem
  • Create and maintain QE documentation
  • Coordinate, perform or lead UAT, Business and E2E testing activities
  • Design, develop, and maintain automated Data test framework, engineering pipelines and scripts
  • Identify performance bottlenecks and provide support to Performance and Security testing
  • Communicate and plan with development teams and stakeholders
  • Track & plan QE testing progress and provide analysis & metrics on the QE effort
  • Log and track detailed product defects and support the RCA identification
  • Coach and provide mentorship to the testing team, and not afraid to get hands dirty
  • Be the single point of contact for all Data testing related activities