Technical Specialist Advisory - Cloudera Data Platform (CDP) using Diyotta

Scotiabank; Toronto; Hybrid; CAD 80,000 - 120,000; Full time

Job summary

An established industry player seeks a dedicated professional to enhance user experience on Hadoop/Cloudera platforms. This role involves supporting deployment, monitoring, and troubleshooting while collaborating with diverse teams. You'll manage multiple projects across numerous servers, ensuring quality delivery and performance tuning. Join a forward-thinking team that values innovation and inclusivity, offering competitive rewards and flexible work arrangements. If you're passionate about technology and eager to contribute to transformative projects, this opportunity is perfect for you.

Benefits

Competitive rewards

Bonuses

Pension

Shares

Flexible work arrangements

Inclusive environment

Learning opportunities

Qualifications

• 5+ years of experience with Cloudera Data Platform and Diyotta.
• Strong troubleshooting skills in Linux/UNIX systems.

Responsibilities

• Support and enhance user experience for Hadoop/Cloudera platforms.
• Manage initiatives within Hortonworks Data Platform covering multiple projects.

Skills

Diyotta

Cloudera Data Platform

Linux

Java

Python

Shell Scripting

Networking Troubleshooting

Communication Skills

Problem Solving

Education

Post-secondary education in Computer Science

Engineering or related field

Tools

Hadoop

ETL Processes

Monitoring Tools

Job description

Requisition ID: 224551

Join a purpose-driven, high-performing team committed to results in an inclusive culture.

The team:

Scotiabank’s Global Technology Enterprise Platforms (GTEP) - Enterprise Data Lake (EDL) & Data Management Services manages and supports Scotiabank’s Hadoop/Cloudera platforms across Canada, Caribbean, Latin America (LATAM), and other countries. Responsibilities include implementing new technology, security patches, software deployment, and continuous improvement in collaboration with subsidiaries, under the direction of globalization and application consolidation.

The role:

Supporting and enhancing user experience for Hadoop/Cloudera platforms for Canadian and global lines of business. Responsibilities include deployment, monitoring, support, troubleshooting, and collaborating with developers, business users, and support teams. Managing initiatives within the Hortonworks Data Platform (HDP)/Cloudera Data Platform (CDP), covering multiple projects and over 100 servers with 30+ applications. Creating test plans, performing manual and automation testing, troubleshooting production issues, and ensuring quality delivery. The role includes rotational on-call support.

Is this role right for you?

• Customer-focused with ability to deepen client relationships and leverage broader bank systems and knowledge.
• Strong development background with Diyotta environment, building complex ETL processes involving files, databases, and external calls.
• Act as liaison between architects, business leads, and development teams, owning technical delivery.
• Proficient in troubleshooting system capacity issues, memory, CPU, kernel, storage, and performance tuning of Java applications.
• Ability to architect ETL solutions using Hadoop and various databases.
• Rigorous, resourceful, adaptable, with strong attention to detail and project ownership.
• Champion a high-performance, inclusive work environment.

Skills required:

• Strong communication skills (verbal/written) and interpersonal skills to build relationships with partners and vendors.
• Minimum 5+ years of hands-on experience supporting, deploying, and integrating data sources with Cloudera Data Platform using Diyotta and other technologies (Linux, monitoring).
• At least 5+ years of OS support experience on Linux and/or UNIX systems.
• Familiarity with DevOps/SRE concepts and tools to improve service quality.
• Networking troubleshooting skills, including IP configuration, firewalls, and load balancing.
• Core experience in software deployment technologies, shell scripting, Python, and Java.
• Strong problem-solving and decision-making skills, able to work under pressure.
• Post-secondary education in Computer Science, Engineering, or related field.

What’s in it for you?

• Opportunity to work with industry leaders and contribute to transformative technology projects.
• Inclusive, innovative environment that encourages learning and success.
• Competitive rewards, including bonuses, pension, shares, benefits, and flexible work arrangements.
• Location: Toronto, with remote/hybrid options. Onsite amenities include The Commons dining space and access to The PATH for shopping and services.

Location: Canada, Ontario, Toronto

Scotiabank is committed to diversity and inclusion. Accommodations are available during the recruitment process. Candidates must apply online. Only shortlisted candidates will be contacted.