Senior Big Data Engineer & Platform Specialist

Tata Consultancy Services; Toronto; On-site; CAD 140,000 - 190,000; Full time

Job summary

Tata Consultancy Services Canada Inc. is seeking a Senior Big Data Engineer / Data Platform Specialist to design, develop, and operate large-scale data processing solutions.

The ideal candidate has 10+ years of experience and hands-on expertise with Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk, Autosys, and Linux environments, plus Cloudera Hadoop ecosystem proficiency. You will build and optimize high-volume data pipelines, perform data analysis and wrangling on huge datasets, and

Qualifications

• 10+ years of experience in Big Data Engineering, Data Platforms, or Data Analytics.
• Strong hands-on experience with: Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk, Autosys and Linux environments.
• Experience supporting and optimizing the Cloudera Big Data ecosystem and performing performance tuning.

Responsibilities

• Build and optimize high-volume data pipelines across Big Data platforms.
• Analyze data and wrangle large datasets to enable scalable analytics.
• Ensure performance, reliability, and scalability of Big Data ecosystems.

Skills

Kafka

Spark

Scala

SQL

Hive

Impala

Hadoop

Splunk

Autosys

Linux

Tools

Cloudera Hadoop ecosystem

Job description

Tata Consultancy Services Canada Inc. is seeking a Senior Big Data Engineer / Data Platform Specialist to design, develop, and operate large-scale data processing solutions.

The ideal candidate has 10+ years of experience and hands-on expertise with Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk, Autosys, and Linux environments, plus Cloudera Hadoop ecosystem proficiency. You will build and optimize high-volume data pipelines, perform data analysis and wrangling on huge datasets, and