Data Engineer

Tekshapers; Mississauga; On-site; CAD 90,000 - 130,000; Full time

Job summary

Tekshapers is seeking a data engineer to work with a cutting-edge big data stack, including Kafka, Spark, Scala and SQL, to process large volumes of data. You will analyze data, wrangle datasets, and optimize performance while troubleshooting complex issues in a Linux-based infrastructure.

You will face off to business users, communicate clearly, and collaborate with a distributed global team in a fast-paced environment, staying motivated and eager to learn new technologies and approaches.

Qualifications

• Data analysis and data wrangling for very large datasets.
• Strong ability to analyze performance and troubleshoot issues in big data environments.
• Familiarity with Linux-based infrastructures and distributed systems.

Skills

Data analysis

Data wrangling

Performance analysis

Troubleshooting

Linux

Communication

Self-motivation

Learning mindset

Analytical thinking

Teamwork

Fast-paced environment

Tools

Kafka

Spark

Scala

SQL

Hive

Impala

Hadoop

Splunk

Autosys

Job description

• 2. Strong experience in Kafka, Spark, Scala,SQL ,Hive, Impala, Hadoop, Splunk, Autosys .
• 3. Data Analysis and Data Wrangling skills when dealing with Huge Volume.
• 4. Performance analysis, troubleshooting and resolution including Cloudera Big Data eco system.
• 5. Experience with Linux-based infrastructures. Competencies:
• Strong verbal and written communication skills; ability to face off to business users
• Self-motivated individual and with determination to achieve goals
• Willingness to learn, both technically and professionally
• Strong analytical and problem solving skills
• Good team working skills and ability to work in a distributed global team environment
• Ability to work on a fast-pace environment; Flexible and able to deliver quality results in the required timeframe