Technical Specialist Advisory - Cloudera Data Platform (CDP) using Diyotta

Scotiabank; Toronto; Hybrid; CAD 80,000 - 110,000; Full time

Job summary

Join a dynamic and purpose-driven team at a leading bank in the Americas, where you will enhance user experiences on Hadoop and Cloudera platforms. This role offers the opportunity to work with industry leaders while managing multiple projects and environments. You will be responsible for deploying, monitoring, and supporting complex systems, ensuring high-quality delivery and fostering an inclusive workplace. With flexible remote work options and a collaborative culture, this position is ideal for a resourceful individual eager to make a significant impact in the tech space.

Benefits

Competitive rewards

Bonuses

Pension plan

Employee share plans

Generous vacation

Health benefits

Remote work flexibility

Access to dining space

Proximity to transit and services

Qualifications

• 5+ years of experience supporting Linux/UNIX systems.
• Strong development experience with Diyotta and ETL solutions.

Responsibilities

• Deploy, monitor, and support Hadoop/Cloudera environments.
• Create test plans, perform testing, and troubleshoot production issues.

Skills

Diyotta

Linux

UNIX

Python

Java

Networking Troubleshooting

Shell Scripting

Problem Solving

Education

Post-secondary education in Computer Science

Engineering or related fields

Tools

Hadoop

Cloudera

ETL Tools

Job description

Press Tab to Move to Skip to Content Link

Select how often (in days) to receive an alert:

Select how often (in days) to receive an alert:

Please be advised that our Careers site will be unavailable from November 28 at 12am ET to November 29 12am ET for scheduled system maintenance.

Title: Technical Specialist Advisory - Cloudera Data Platform (CDP) using Diyotta

Requisition ID: 224551

Join a purpose-driven, results-oriented team committed to an inclusive and high-performing culture.

The team:

Scotiabank’s Global Technology Enterprise Platforms (GTEP) - Enterprise Data Lake (EDL) & Data Management Services manages and supports Scotiabank’s Hadoop/Cloudera platforms across Canada, Caribbean, Latin America (LATAM), and other countries. Responsibilities include implementing new technology, security patches, software deployment, and continuous improvement initiatives across subsidiaries, guided by globalization and application consolidation efforts.

The role:

To support and enhance user experience on Hadoop/Cloudera platforms, you will deploy, monitor, and support these environments, collaborating with developers, business users, and support teams. You will handle all Hortonworks Data Platform (HDP)/Cloudera Data Platform (CDP) initiatives within GTEP, overseeing multiple projects and environments with over 100 servers and 30+ applications. Your tasks include creating test plans and strategies, performing manual and automated testing, troubleshooting production issues, and delivering quality products.

This role involves rotational on-call “pager” support.

Is this role right for you?

• You aim to foster a customer-focused culture and leverage broader bank relationships.
• You have strong development experience with Diyotta, building complex, multi-step processes interacting with files and databases, and calling external processes.
• You act as a liaison between architects, business leads, and development teams, owning technical delivery.
• You can troubleshoot system capacity issues, including memory, CPU, kernel, storage, and perform configuration and performance tuning of Java applications.
• You can architect ETL solutions using ETL tools on Hadoop and various database environments.
• You are rigorous, resourceful, adaptable, detail-oriented, and take ownership of projects.
• You promote a high-performance environment and contribute to an inclusive workplace.

Do you have the skills to succeed?

• Strong verbal and written communication skills, with good interpersonal abilities to build relationships with partners and vendors.
• At least 5+ years of hands-on experience supporting Linux and/or UNIX operating systems.
• Familiarity with networking troubleshooting, IP configuration, firewalls, and load balancing.
• Solid foundation in software deployment technologies, shell scripting, Python, and/or Java.
• Excellent problem-solving and decision-making skills, with the ability to work under pressure.
• Post-secondary education in Computer Science, Engineering, or related fields.

What's in it for you?

• Opportunity to work with and learn from industry leaders.
• Inclusive, collaborative environment fostering innovation and continuous learning.
• Competitive rewards, including bonuses, pension, employee share plans, generous vacation, and health benefits.
• Remote work flexibility, with potential for hybrid arrangements at the downtown Toronto location: 720 King Street W.
• Access to amenities like The Commons dining space, The Bean beverages, and proximity to transit and services.

Location(s): Canada : Ontario : Toronto

Scotiabank is a leading bank in the Americas, committed to inclusivity and accessibility. We welcome accommodations for candidates during the recruitment process. Only shortlisted candidates will be contacted.

Job Segment: Database, Test Engineer, Testing, Software Engineer, Data Management, Technology, Engineering, Data