Data Engineer

Galent; Toronto; Hybrid; CAD 90,000 - 130,000; Full time

Job summary

A leading company is seeking an experienced Data Engineer to join their team in a hybrid role based in Toronto. This position requires expertise in Databricks SQL and PySpark, along with a strong background in data architecture. The successful candidate will drive innovation in data solutions and work collaboratively across teams to enhance operational efficiency, contributing to the company's mission.

Qualifications

• 9-13 years of experience in data engineering.
• Strong technical skills in Databricks SQL and PySpark.
• Experience in the Life and Annuities Insurance domain is a plus.

Responsibilities

• Design and implement scalable data architectures using Databricks SQL and PySpark.
• Collaborate with teams to develop and optimize Databricks Workflows.
• Conduct regular performance assessments and implement enhancements.

Skills

Databricks SQL

PySpark

Data Governance

Problem-Solving

Job description

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Galent

Talent Acquisition Specialist - United States | Canada - IT & NON IT Recruitment

Hybrid Mode- Toronto, ON or London, ON

Must have 9-13 years of experience

We are seeking an experienced Data Engineer with 9 to 13 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL, Databricks Workflows, and PySpark. Experience in the Life and Annuities Insurance domain is a plus. This hybrid role requires a proactive individual who can drive innovation and efficiency in our data solutions, contributing to the company's growth and societal impact.

Responsibilities

• Design and implement scalable data architectures using Databricks SQL and PySpark to enhance data processing capabilities.
• Collaborate with cross-functional teams to develop and optimize Databricks Workflows for seamless data integration.
• Analyze complex data sets to identify trends and insights that drive business decisions and improve operational efficiency.
• Ensure data quality and integrity by implementing robust data governance practices and monitoring systems.
• Provide technical guidance and mentorship to junior team members, fostering a culture of continuous learning and improvement.
• Develop and maintain comprehensive documentation for data architecture and workflows to support ongoing development and maintenance.
• Work closely with stakeholders to understand business requirements and translate them into technical solutions that align with company objectives.
• Lead efforts to innovate and improve data processing techniques, ensuring the company remains at the forefront of industry advancements.
• Conduct regular performance assessments of data systems to identify areas for optimization and implement necessary enhancements.
• Collaborate with IT and business teams to ensure data solutions are aligned with organizational goals and regulatory requirements.
• Drive the adoption of best practices in data engineering and architecture to ensure high-quality deliverables.
• Engage in continuous professional development to stay updated with the latest trends and technologies in data architecture.
• Contribute to the companys mission by leveraging data to create impactful solutions that benefit society.

Qualifications

• Possess strong technical skills in Databricks SQL and PySpark, with a proven track record of successful implementations.
• Demonstrate expertise in designing and optimizing Databricks Workflows for efficient data processing.
• Exhibit a deep understanding of data architecture principles and best practices.
• Have experience in the Life and Annuities Insurance domain, which is considered an advantage.
• Show proficiency in data governance and quality assurance practices.
• Display excellent problem-solving skills and the ability to work collaboratively with diverse teams.
• Maintain a commitment to continuous learning and professional growth in the field of data architecture.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Job function

  Information Technology

• Industries

  Technology, Information and Internet

Referrals increase your chances of interviewing at Galent by 2x

Get notified about new Data Architect jobs in Toronto, Ontario, Canada.

Startup Solutions Architect, Startups Canada

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.