Big Data Engineer

Tata Consultancy Services; Toronto; On-site; CAD 140,000 - 190,000; Full time

Job summary

Tata Consultancy Services Canada Inc. is seeking a Senior Big Data Engineer / Data Platform Specialist to design, develop, and operate large-scale data processing solutions.

The ideal candidate has 10+ years of experience and hands-on expertise with Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk, Autosys, and Linux environments, plus Cloudera Hadoop ecosystem proficiency. You will build and optimize high-volume data pipelines, perform data analysis and wrangling on huge datasets, and

Qualifications

• 10+ years of experience in Big Data Engineering, Data Platforms, or Data Analytics.
• Strong hands-on experience with: Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk, Autosys and Linux environments.
• Experience supporting and optimizing the Cloudera Big Data ecosystem and performing performance tuning.

Responsibilities

• Build and optimize high-volume data pipelines across Big Data platforms.
• Analyze data and wrangle large datasets to enable scalable analytics.
• Ensure performance, reliability, and scalability of Big Data ecosystems.

Skills

Kafka

Spark

Scala

SQL

Hive

Impala

Hadoop

Splunk

Autosys

Linux

Tools

Cloudera Hadoop ecosystem

Job description

Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our people stories across our workforce and implemented through equitable workplace policies and processes.

TCS is an IT services, consulting, and business solutions organization that has been partnering with many of the world’s largest businesses in their transformation journeys for over 55 years. Its consulting-led, cognitive-powered portfolio of business, technology, and engineering services and solutions is delivered through its unique Location Independent Agile delivery model, recognized as a benchmark of excellence in software development. A part of the Tata group, India's largest multinational business group, TCS operates in 55 countries and employs over 607,000 highly skilled individuals, including more than 10,000 in Canada. The company generated consolidated revenues of US $30 billion in the fiscal year ended March 31, 2025,[BS1] and is listed on the BSE and the NSE in India. TCS' proactive stance on climate change and award-winning work with communities across the world have earned it a place in leading sustainability indices such as the MSCI Global Sustainability Index and the FTSE4

We are seeking a Senior Big Data Engineer / Data Platform Specialist with 10+ years of experience in designing, developing, and supporting large-scale data processing solutions. The ideal candidate will have strong expertise in Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk, Autosys, and Linux environments, along with hands-on experience managing and troubleshooting enterprise Big Data platforms.

The successful candidate will be responsible for building and optimizing high-volume data pipelines, performing data analysis and data wrangling on large datasets, and ensuring the performance, reliability, and scalability of Big Data ecosystems. Experience working within the Cloudera Hadoop ecosystem and resolving complex production issues is essential.

Key Requirements

• 10+ years of experience in Big Data Engineering, Data Platforms, or Data Analytics.
• Strong hands-on experience with:
• Kafka
• Scala
• SQL
• Hive
• Impala
• Hadoop
• Splunk
• Autosys
• Experience handling and analyzing large-scale, high-volume datasets.
• Strong data analysis and data wrangling capabilities.
• Expertise in performance tuning, troubleshooting, and issue resolution across Big Data environments.
• Experience supporting and optimizing the Cloudera Big Data ecosystem.
• Strong knowledge of Linux-based operating systems and infrastructure.
• Experience developing scalable and high-performance data processing solutions.

Core Competencies

• Excellent verbal and written communication skills with the ability to interact directly with business stakeholders.
• Strong analytical and problem-solving abilities.
• Self-motivated and results-oriented with a proactive mindset.
• Ability to work effectively in a fast-paced, dynamic environment.
• Strong collaboration skills with experience working in globally distributed teams.
• Flexible and adaptable with a focus on delivering high-quality results within tight timelines.
• Continuous learning mindset with a desire to grow both technically and professionally.

Tata Consultancy Services Canada Inc. is committed to meeting the accessibility needs of all individuals in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC). Should you require accommodations during the recruitment and selection process, please inform Human Resources.