Hadoop SRE Engineer

CITI; Mississauga; On-site; CAD 80,000 - 120,000; Full time

Job summary

An established industry player is seeking a skilled Hadoop SRE Engineer to lead engineering activities and ensure quality standards within the technology framework. This senior role involves collaborating with various stakeholders, driving compliance, and mentoring junior team members. The ideal candidate will possess a strong background in scripting, cloud technologies, and automation, along with experience in designing highly available platforms. Join a dynamic team where your expertise will significantly impact the engineering function and contribute to innovative solutions in a fast-paced environment.

Qualifications

• 6-10 years of experience in an Engineering role, preferably in Financial Services.
• Strong scripting skills and experience with cloud technologies and automation.

Responsibilities

• Lead engineering activities for hardware, software, and network infrastructure.
• Serve as a technology expert and mentor junior team members.

Skills

Scripting Skills (Shell, Python, Ruby, Perl)

Project Management

Analytic/Diagnostic Skills

Cloud Technologies (VMware, Docker, Kubernetes)

CI/CD Tools

Linux Environment Troubleshooting

Automation Technologies

Cloudera Hadoop Distribution

Security Concepts and Best Practices

Education

Bachelor’s degree or equivalent experience

Tools

Cloudera

MapReduce

Spark

Impala

HBase

Ozone

Ansible

Chef

Job description

The Hadoop SRE Engineer is a senior level position responsible for leading a variety of engineering activities including the design, acquisition and deployment of hardware, software and network infrastructure in coordination with the Technology team. The overall objective of this role is to lead efforts to ensure quality standards are being met within existing and planned framework.

Responsibilities:

• Serve as a technology subject matter expert for internal and external stakeholders and provide direction for all firm mandated controls and compliance initiatives, all projects within the group and in creating a technology domain roadmap for Cloudera Hadoop Platform and Hadoop on Google Cloud Platform.

• Ensure that all integration of functions meet business goals.

• Define necessary system enhancements to deploy new products and process enhancements.

• Recommend product customization for system integration.

• Identify problem causality, business impact and root causes.

• Exhibit knowledge of how own specialty area contributes to the business and apply knowledge of competitors, products and services.

• Advise or mentor junior team members.

• Impact the engineering function by influencing decisions through advice, counsel or facilitating services.

• Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

Qualifications:

• 6-10 years of relevant experience in an Engineering role.

• Experience working in Financial Services or a large complex and/or global environment.

• Project Management experience.

• Consistently demonstrates clear and concise written and verbal communication.

• Comprehensive knowledge of design metrics, analytics tools, benchmarking activities and related reporting to identify best practices.

• Demonstrated analytic/diagnostic skills.

• Ability to work in a matrix environment and partner with virtual teams.

• Ability to work independently, multi-task, and take ownership of various parts of a project or initiative.

• Ability to work under pressure and manage to tight deadlines or unexpected changes in expectations or requirements.

• Proven track record of operational process change and improvement.

• Proven track record of designing highly available platforms and services supporting various types of workloads.

• Experience in designing fail-over processes and solutions.

• Strong scripting skills – shell scripts, Python, Ruby, Perl, etc.

• Experience with virtualization, containerization, and cloud technologies – VMware, Docker, Kubernetes, Cloud Platforms, etc.

• Analytical thinker able to assess various aspects to methodically arrive at a solution.

• Individual with hands-on experience in gathering performance metrics, troubleshooting, tuning, monitoring, etc.

• Hands-on work on installing, configuring and troubleshooting Linux based environments.

• Expertise with automations including latest technologies in the space.

• Experience in CI/CD tools.

• Knowledge of Ansible and/or Chef.

• Good knowledge of Cloudera Hadoop distribution and advanced analytics tools.

• Deployed and administered large scale Hadoop clusters with MapReduce, Spark, Impala and HBase, Ozone, Cloudera Data services, etc.

• Good understanding of security concepts and best practices.

Education:

• Bachelor’s degree/University degree or equivalent experience.

Job Family Group: Technology

Job Family: Systems & Engineering

Time Type: Full time