Big Data Engineer

Motion Recruitment Partners; Mississauga; Hybrid; CAD 60,000 - 80,000; Full time

Job summary

A global banking institution in Mississauga is seeking a Big Data Engineer for a contract role with competitive pay and hybrid work. The successful candidate will have over 10 years of Big Data experience and proficiency with tools like Hadoop, Spark, and SQL. This position offers a robust opportunity for career growth and collaboration within a dynamic team of experts.

Qualifications

• 10+ years of Big Data development experience.
• Solid understanding of Big Data architecture.
• Hands-on experience with data curation/conformance tools.

Responsibilities

• Work closely with data engineers on a Big Data Platform.
• Manage Applications Development teams to achieve goals.
• Contribute to strategies for applications development.

Skills

Big Data development experience

Troubleshooting performance issues on Hadoop

Experience with Hive

Proficiency in Spark

Scala development

Continuous Integration and Continuous Delivery

Data analysis skills

Leadership & Mentorship

Strong communication skills

Tools

Hadoop (Cloudera)

Kafka

HBase

Spark

Jenkins

Kubernetes

SQL (Oracle, SQL Server)

NoSQL (MongoDB)

Cache (Couchbase)

Job description

Big Data Engineer

Mississauga, Ontario

Hybrid

Contract

$70/hr - $72.5/hr

Grow your career as a Big Data Engineer with an innovative global bank in Mississauga, Ontario. Contract role with strong possibility of extension or conversion. Will require working a hybrid schedule 3 days onsite per week.

Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. You will work alongside some of the smartest minds in the industry who are excited to share their knowledge and to learn from you.

Contract Duration: 11+ Months

Required Skills & Experience

• 10+ years of Big Data development experience.

• Strong solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)

• Hands-on experience working with Hive, Impala, Kafka, HBase, Spark for data curation/conformance related work.

• Strong proficiency in Spark for development work related to curation/conformance.

• Strong Scala development (with previous Java background) preferred.

• Experience with Spark/Kafka or equivalent streaming/batch processing and event-based messaging.

• Experience working in a Continuous Integration and Continuous Delivery environment and familiarity with tools like Jenkins, TeamCity, SonarQube, OpenShift, ECS, or Kubernetes.

• Proficient in industry-standard best practices such as Design Patterns, Coding Standards, Coding modularity, and Prototyping.

• Experience with data visualization tools and techniques for presenting data insights effectively.

• Agile development experience working in agile and scaled agile teams.

• Strong data analysis skills and the ability to slice and dice the data as needed for business reporting.

• Relational SQL (Oracle, SQL Server), NoSQL (MongoDB) and Cache (Couchbase) database integration and data distribution principles experience

• Leadership & Mentorship: Ability to guide and mentor junior developers, fostering a collaborative team environment and promoting professional growth.

• Strong communication skills, both written and verbal, with the ability to explain complex technical concepts to both technical and non-technical audiences.

What You Will Be Doing

• Utilize in-depth knowledge and hands-on skills across multiple Applications Development areas to provide technical oversight across systems and applications

• Will work very closely with and manage the work of a team of data engineers working on a Big Data Platform.

• Manage one or more Applications Development teams in an effort to accomplish established goals

• Review/analyze/develop proposed technical solutions for projects

• Contribute to formulation of strategies for applications development and other functional areas

• Develop comprehensive knowledge of how areas of business integrate to accomplish business goals

• Provide evaluative judgment based on analysis of factual data in complicated and unique situations

• Impact the Applications Development area through monitoring delivery of end results, participate in budget management, and handling day-to-day staff management issues, including resource management and allocation of work within the team/project

• Ensure essential procedures are followed and contribute to defining standards negotiating with external parties when necessary

Motion Recruitment Partners (MRP) is an Equal Opportunity Employer. All applicants must be currently authorized to work on a full-time basis in the country for which they are applying, and no sponsorship is currently available. Employment is subject to the successful completion of a pre-employment screening. Accommodation will be provided in all parts of the hiring process as required under MRP’s Employment Accommodation policy. Applicants need to make their needs known in advance.

Posted by: Melissa Klein

Specialization:

• Data Engineering