Senior Data Engineer

Company 1; Halifax; Hybrid; CAD 94,000 - 175,000; Full time

Job summary

A leading financial services provider in Halifax is looking for a Senior Data Engineer to oversee the development of data pipelines using Azure technologies. You will lead agile projects, design data architectures, and mentor junior staff. Candidates should have extensive experience with Azure tools, data warehousing, and the Hadoop ecosystem. This position offers a hybrid working arrangement with a competitive salary and comprehensive benefits.

Benefits

Health, dental and vision insurance

Short- and long-term disability insurance

Generous paid time off

Retirement savings plans

Qualifications

• 10 years of experience in data warehouses and ETL tools.
• Strong Azure Data Engineer background with Azure Databricks.
• Experience with Hadoop ecosystem and BI tools.

Responsibilities

• Develop and maintain data pipelines and ETL processes.
• Lead agile software development and cross-team coordination.
• Mentor staff and facilitate knowledge transfer.

Skills

10 years of professional experience with designing and development of data warehouses and ETL tools and technologies

Strong experience as an Azure Data Engineer

Expert level understanding of Azure Data Lake, Azure SQL

Hands-on experience designing scripts for ETL

Experience preparing data for Advanced Analytics using Azure ML

Experienced with the Hadoop ecosystem

Experience with CI / CD tools

Knowledge of BI tools such as PowerBI

Strong interpersonal communication skills

Ability to effectively prioritize tasks

Customer service orientation

Tools

Azure Data Factory

Azure Databricks

PySpark

Hadoop

GitHub

Jenkins

Azure DevOps

PowerBI

Job description

Responsibilities

• Hands-on data engineering and technical oversight in the development of batch and real-time data pipelines DevOps pipelines and end-to-end processes supporting data ingestion, curation, virtualization and delivery at scale leveraging Microsoft Azure Data & Analytics PaaS Services.
• Lead the agile software development process including roadmap planning, cross-team coordination, task assignments, code reviews, sprint demos and design review and sign-off.
• Translate business requirements to technical solutions working with development teams, architects and business analysts conformant to enterprise standards, architecture and technologies.
• Delivery of modernization of enterprise data solutions using Azure cloud data technologies.
• Design and Build Modern Data Pipelines and Data Streams.
• Design and Build Data Service APIs.
• Develop and maintain data warehouse schematics, layouts, architectures and relational / non-relational databases for data access and Advanced Analytics.
• Expose data to end-users using PowerBI, Azure API Apps or any other modern visualization platform or experience.
• Playing a key role in mentoring other staff members and a proven track record in knowledge transfer to other team members and departments.
• Identifies opportunities for new architectural initiatives, makes recommendations on the increasing scalability and robustness of platforms and solutions.

Knowledge and skills

• 10 years of professional experience with designing and development of data warehouses and ETL tools and technologies.
• Strong experience as an Azure Data Engineer and must have Azure Databricks experience.
• Expert level understanding of Azure Data Lake, Azure SQL databases, Azure Data Factory and Azure Databricks is required.
• Hands-on experience on designing and developing scripts for ETL processes and automation in Azure Data Factory, Azure Databricks and PySpark.
• Experience preparing data for use in Data science / Advanced Analytics using Azure ML.
• Experienced with the Hadoop ecosystem and toolset (HDFS, MapReduce, Spark, Python, Scala, Hive and Oozie).
• Experience with CI / CD tools such as GitHub, Jenkins and Azure DevOps to configure and build CI / CD pipelines.
• Knowledge of BI tools such as PowerBI.
• Strong interpersonal, written and oral communication skills.
• Proven ability to effectively prioritize and execute tasks in a team-oriented, collaborative workplace.
• Self-reliant and comfortable with a rapidly changing environment.
• Customer service orientation.
• Ability to assimilate new skills to support.
• Ability to adapt to new service needs as they arise.

About Manulife and John Hancock

Manulife Financial Corporation is a leading international financial services provider helping people make their decisions easier and lives better. To learn more about us visit is an Equal Opportunity Employer.

At Manulife / John Hancock we embrace our diversity. We strive to attract, develop and retain a workforce that is as diverse as the customers we serve and to foster an inclusive work environment that embraces the strength of cultures and individuals. We are committed to fair recruitment, retention, advancement and compensation and we administer all of our practices and programs without discrimination on the basis of race, ancestry, place of origin, colour, ethnic origin, citizenship, religion or religious beliefs, creed, sex (including pregnancy and pregnancy-related conditions), sexual orientation, genetic characteristics, veteran status, gender identity, gender expression, age, marital status, family status, disability or any other ground protected by applicable law.

It is our priority to remove barriers to provide equal access to employment. A Human Resources representative will work with applicants who request a reasonable accommodation during the application process. All information shared during the accommodation request process will be stored and used in a manner that is consistent with applicable laws and Manulife / John Hancock policies. To request a reasonable accommodation in the application process contact.

Miscellaneous

Referenced Salary Location

Halifax, Nova Scotia

Working Arrangement

Hybrid

Salary range is expected to be between

$94,220.00 CAD - $174,980.00 CAD

If you are applying for this role outside of the primary location please contact for the salary range for your location. The actual salary will vary depending on local market conditions, geography and relevant job-related factors such as knowledge, skills, qualifications, experience and education / training. Employees also have the opportunity to participate in incentive programs and earn incentive compensation tied to business and individual performance.

Manulife offers eligible employees a wide array of customizable benefits including health, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage, adoption / surrogacy and wellness benefits and employee / family assistance plans. We also offer eligible employees various retirement savings plans (including pension and a global share ownership plan with employer matching contributions) and financial education and counseling resources. Our generous paid time off program in Canada includes holidays, vacation, personal and sick days and we offer the full range of statutory leaves of absence. If you are applying for this role in the U.S. please contact for more information about U.S.-specific paid time off provisions.

Required Experience :

Senior IC

Key Skills

Apache Hive, S3, Hadoop, Redshift, Spark, AWS, Apache Pig, NoSQL, Big Data, Data Warehouse, Kafka, Scala

Employment Type :

Full-Time

Experience :

years

Vacancy :

1