Big Data Developer

Tata Consultancy Services; Toronto; On-site; CAD 90,000 - 110,000; Full time

Job summary

Tata Consultancy Services Canada Inc. is seeking a Big Data Engineer to design and maintain robust data pipelines using Apache Spark, Scala, and Java for enterprise analytics.

You will ingest, transform, and optimize large datasets, focusing on performance and cost efficiency while collaborating with data scientists and infrastructure teams. You will also implement testing strategies, maintain documentation, and contribute to code quality through CI/CD practices.

Qualifications

• Demonstrated professional experience developing production-grade big data applications.
• Strong expertise in Apache Spark (Core, SQL, Streaming).
• Advanced programming skills in Scala and/or Java.
• Strong understanding of distributed computing principles and architecture.
• Experience with data warehousing and SQL.
• Knowledge of Git and CI/CD pipelines.
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork skills.

Responsibilities

• Design and implement end-to-end data pipelines using Apache Spark for ETL and analytics workloads.
• Develop clean, efficient, and maintainable code using Scala and Java.
• Build solutions to ingest, transform, and aggregate large-scale financial and operational data.
• Analyze and optimize Spark applications for performance, memory efficiency, and cost-effectiveness.
• Collaborate with data scientists, analysts, and infrastructure teams to translate requirements into technical solutions.
• Troubleshoot and resolve production issues within big data systems.
• Implement testing strategies and maintain code quality standards.
• Create and maintain technical documentation and knowledge base articles.

Skills

Scala

Java

SQL

ETL/ELT

Distributed Systems

Performance Tuning & Optimization

Testing Frameworks & Methodologies

Tools

Kafka

Flink

Hadoop

Hive

HBase

Docker

Kubernetes

Job description

Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our people stories across our workforce and implemented through equitable workplace policies and processes.

TCS has been serving the Canadian marketplace for more than 35 years and today is the technology partner of choice for many of the country's leading organizations. As one of the largest IT services providers in Canada and globally, TCS is aiming to become the world's largest AI-led technology services company and is enabling its clients to transform themselves across the full AI stack, from infrastructure to intelligence.

Rooted in the heritage and values of the Tata Group, TCS is focused on creating long-term value for its clients, investors, employees, and the communities it serves. With a highly skilled workforce supporting customers from coast to coast, TCS has consistently been recognized as a Top Employer by the Top Employers Institute, including a recent top ranking at the country level.

TCS also sponsors 14 of the world's most prestigious marathons and endurance events, including the TCS Toronto Waterfront Marathon, reflecting its commitment to health, sustainability, and community empowerment.

Position Overview

Build and maintain robust big data processing solutions using Apache Spark, Scala, and Java. Develop scalable applications to process large datasets and support enterprise data and analytics requirements.

Key Responsibilities

• Design and implement end-to-end data pipelines using Apache Spark for ETL and analytics workloads.
• Develop clean, efficient, and maintainable code using Scala and Java.
• Build solutions to ingest, transform, and aggregate large-scale financial and operational data.
• Analyze and optimize Spark applications for performance, memory efficiency, and cost-effectiveness.
• Collaborate with data scientists, analysts, and infrastructure teams to translate requirements into technical solutions.
• Troubleshoot and resolve production issues within big data systems.
• Implement testing strategies and maintain code quality standards.
• Create and maintain technical documentation and knowledge base articles.

Required Qualifications

• Demonstrated professional experience developing production-grade big data applications.
• Strong expertise in Apache Spark (Core, SQL, Streaming).
• Advanced programming skills in Scala and/or Java.
• Strong understanding of distributed computing principles and architecture.
• Experience with data warehousing and SQL.
• Knowledge of Git and CI/CD pipelines.
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork skills.

Preferred Qualifications

• Experience with Kafka, Flink, or other real-time streaming platforms.
• Familiarity with Hadoop, Hive, HBase, or similar technologies.
• Cloud platform experience with AWS, Azure, or GCP.
• Background in financial services or banking.
• Knowledge of data modeling and schema design.
• Experience with Docker and Kubernetes.

Technical Skills

• Scala
• Java
• SQL
• ETL/ELT
• Distributed Systems
• Performance Tuning & Optimization
• Testing Frameworks & Methodologies

Salary Range - CA$ 90,000 - CA$ 110,000 Per Year

Tata Consultancy Services Canada Inc. is committed to meeting the accessibility needs of all individuals in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC). Should you require accommodation during the recruitment and selection process, please inform Human Resources.

Thank you for your interest in TCS. Candidates that meet the qualifications for this position will be contacted within a 2-week period. We invite you to continue to apply for other opportunities that match your profile.