Hadoop / Cassandra- Big Data Engineer $150k

IT Accel, Inc; Toronto; On-site; CAD 90,000 - 120,000; Full time

Job summary

A technology solutions provider in Toronto seeks a Big Data Platform Engineer to develop and maintain solutions focusing on efficiency, reliability, and security. The ideal candidate will have 5-10 years' experience and strong knowledge in cloud technologies like Azure. Responsibilities include systems administration, managing automated processes, and ensuring effective change management. Join a fast-paced environment to make impactful contributions.

Qualifications

• 5-10 years relevant experience.
• Ability to contribute in a complex, critical environment.
• Expert knowledge of engineering frameworks and tools.
• Experience in cloud environments (Azure, AWS, GCP).
• Strong troubleshooting skills.

Responsibilities

• Develop and maintain technical solutions adhering to design principles.
• Perform systems administration tasks.
• Design, implement, and maintain automated processes.
• Ensure effective change management.
• Provide specialized support meeting service levels.

Skills

Linux OS administration

Hadoop/Cassandra administration

Cloud services (Azure, AWS, GCP)

Configuration management tools (SALT, Terraform, Ansible, CHEF)

Development/Engineering (Bash, Shell, Python)

Problem-solving mindset

Tools like Jenkins, Github, Bitbucket, Nexus

Education

Undergraduate Degree or Technical Certificate

Job description

Job Description

Big Data Platform Engineer

Position Overview

We are looking for someone armed with a strong tool-kit to develop and maintain technical solutions that adhere to engineering and architectural design principles while meeting business requirements. You'll be a technology owner providing technical expertise with a focus on efficiency, reliability, scalability, and security, including planning, evaluating, designing, operationalizing, and supporting solutions in compliance with enterprise and industry standards. The ideal candidate is willing and able to research, maintain, configure, administer, and provision infrastructure, applications, and services across our platforms.

• Understand architecture diagrams and provide input into application design
• Perform systems administration: monitor, configure, back-up, authenticate, tune, maintain, install, script, monitor applications, services, and systems
• Script installs and stand up infrastructure in both private/public Cloud
• Identify issues, develop, and maintain processes that address and resolve them, and communicate/alert stakeholders as needed
• Design, implement, and maintain an automated build and deploy process; develop and maintain build scripts of projects and/or products
• Perform Release Engineering functions for cloud or non-cloud services, products, and platforms
• Ensure effective change management (using ServiceNow)
• Provide specialized support (research, installation, configuration, L3 support) meeting or exceeding standards/service levels while minimizing operational risk
• Design, review, and integrate infrastructure and application requirements (non-functional, security, performance, etc.)
• Build/deploy base infrastructure components (e.g., Azure Virtual Machines, AKS, Blob storage) and application services across environments; help evolve infrastructure and deploy new cloud technologies
• Maintain infrastructure, work with vendors (Azure), report problems, and receive fixes
• Create and document disaster recovery plans and procedures

Requirements

Seeking an individual with a strong engineering mindset, sense of ownership, organizational skills, follow-up, and ability to handle complex, multi-faceted assignments independently:

• Undergraduate Degree or Technical Certificate
• 5-10 years relevant experience
• Ability to contribute within a complex, critical environment
• Expert knowledge of engineering frameworks, tools, standards, and procedures, with experience as a subject matter expert
• Experience deploying, managing, and operating complex applications in cloud environments (Azure, AWS, GCP)
• Understanding of shell scripting, PowerShell, Python, and automation coding
• Knowledge of DevOps concepts (CI, CD, IaC) and Agile principles
• Motivated to resolve complex development issues independently
• Excellent troubleshooting skills
• Experience with infrastructure, services, application monitoring, and logging
• Experience with big data technologies/databases and data storage/indexing approaches is a plus

Must-have Skills

• Linux OS administration
• Hadoop/Cassandra administration
• Cloud services (Azure, AWS, GCP)
• Configuration management tools (SALT, Terraform, Ansible, CHEF)
• Development/Engineering (Bash, Shell, Python)
• Problem-solving and engineering mindset
• Tools like Jenkins, Github, Bitbucket, Nexus

Nice to Have

• Windows experience
• High-Performance Computing clusters
• Monitoring tools (Splunk, DataDog, ELK, etc.)
• ITSM tools (AutoSys, ServiceNow, JIRA, Confluence)
• Additional cloud and data technologies (Databricks, Blob, Event Hub)