Senior Data Engineer - Halifax

ODAIA; Bedford; On-site; CAD 90,000 - 120,000; Full time

Benefits offered by this job

Comprehensive Total Rewards Program

Flexible work/life balance options

World-class training program in financial services

Opportunities for challenging work

Job summary

ODAIA is seeking a Senior Data Engineer to work within the Risk IT Data Services team in Bedford, Nova Scotia. This role involves designing and implementing data architecture best practices and supporting the leadership team in executing data strategies. Candidates must have 5+ years application development experience in Hadoop, Spark, and Java/Scala, and a Bachelor's degree in IT or Computer Science. The position offers a comprehensive Total Rewards Program, flexible work-life balance, and opportunities for professional development.

Qualifications

• 5+ years of application development experience in Hadoop, Spark, and Java/Scala.
• 2+ years of application development experience in Java and Spring Framework.
• 7+ years of full development life cycle experience, from architecture through test and deployment.
• Experience leading a team of developers.

Responsibilities

• Provide consulting services on new initiatives of varying complexity.
• Develop, code, and execute tests using different languages and tools.
• Architect, design, and implement solutions to meet stakeholder needs.
• Prepare technical specifications in accordance with documentation objectives.
• Optimize spark jobs and java applications.

Skills

Big Data Management

Cloud Computing

Database Development

Data Mining

Data Warehousing (DW)

ETL Processing

Quality Management

Requirements Analysis

Education

Bachelor’s degree in Information Technology or Computer Science

Tools

Hadoop

Spark

Java

Scala

Spring Framework

Jenkins CI

Git

JIRA

Job description

Job Description

What is the opportunity?

As Senior Data Engineer, in our Halifax team, in the Risk IT Data Services team, you will design, implement and support Data architecture best practices and processes within Risk IT Data Services across the global organization in line with corporate vision. We are looking for a strategic thinker, and passionate data management enthusiast to drive and support the leadership team in executing data strategy.

As a member of a dynamic, fast-paced team, this role brings strong data architecture and data engineering skills and leadership, effective written and verbal communication skills, a strong work ethic, and a demonstrated capability to multi-task effectively. This role requires strong interpersonal, organizational, and problem-solving skills as well as a demonstrated sense of urgency to respond to changing priorities at times. This is complemented by a positive attitude and a willingness to take accountability for the results achieved.

What will you do?

• Provide consulting services on new initiatives (small to large of varying complexity).
• Explore new emerging technologies and how they best suit our applications.
• Develop, code, document, and execute unit tests, system, integration, and acceptance tests using different languages and testing tools for functions of high complexity.
• Ensure adequate technical documentation and training.
• Optimize spark jobs and java applications.
• Architect, design, and implement solutions that meet the stakeholder’s needs.
• Participate actively in requirements gathering, data modeling, and design sessions.
• Prepare high-level and detailed technical specifications for the projects in accordance with PLC, security, and architecture documentation objectives.
• Develop detailed plans and accurate estimates for the completion of build, system testing, and implementation phases of a project.
• Write, test, and maintain detailed programs according to specifications given by computer software engineers and systems analysts.

Knowledge and Experience

• 5+ years of application development experience in Hadoop, Spark, and Java/Scala.
• 2+ years of application development experience in Java and Spring Framework.
• 7+ years of full development life cycle experience, from architecture through test and deployment and cross-platform skills.
• Experience leading a team of developers.
• Bachelor’s degree in Information Technology, Computer Science.

What do you need to succeed?

Must Have

• Experience in developing and optimizing Big Data applications using Java/Scala and Spark on Cloudera/HDP.
• Experience in building data pipelines.
• Experience in developing/designing micro-service architecture.
• Experience in developing applications in Spring & Spring Boot.
• Working knowledge of Jenkins CI, Git, JIRA.
• Ability to seek improvements to all aspects of the development process.

Nice to have

• Knowledge of Credit Risk Markets.

What’s in it for you?

• A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable.
• Leaders who support your development through coaching and managing opportunities.
• Ability to make a difference and lasting impact.
• Work in a dynamic, collaborative, progressive, and high-performing team.
• A world-class training program in financial services.
• Flexible work/life balance options.
• Opportunities to do challenging work.

Job Skills

• Big Data Management, Cloud Computing, Database Development, Data Mining, Data Warehousing (DW), ETL Processing, Group Problem Solving, Quality Management, Requirements Analysis.