Big Data Developer

Tata Consultancy Services; Mississauga; On-site; CAD 80,000 - 110,000; Full time

Job summary

An established industry player is seeking a skilled developer to design and implement high-performance data transformation applications using cutting-edge technologies like Apache Spark. In this role, you will collaborate with global teams, ensuring high-quality deliverables that meet business standards. Your expertise in Java and Scala, along with your knowledge of big data tools, will be crucial in addressing complex data challenges. This position offers a dynamic work environment where innovation is encouraged, making it an exciting opportunity for those passionate about technology and data solutions.

Qualifications

• Hands-on experience in Java and Scala for data transformation applications.
• Proficiency with Apache Spark frameworks and Unix commands.

Responsibilities

• Design high-quality deliverables aligned with business requirements.
• Develop and maintain scalable data transformation applications using Spark.

Skills

Java

Scala

Apache Spark

Unix Shell scripting

Oracle SQL

Hive SQL

Spark SQL

Impala

HBase

JUnit

Tools

Maven

Eclipse IDE

Tectia Client

Oracle SQL Developer

Job description

Inclusion without Exception

Tata Consultancy Services (TCS) is an equal opportunity employer, embracing diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation. We are committed to creating a workforce that reflects the societies we operate in through equitable workplace policies and processes.

About TCS

TCS is an IT services, consulting, and business solutions organization with over 55 years of experience partnering with major global businesses. Our consulting-led, cognitive-powered portfolio of services is delivered through our unique Location Independent Agile delivery model, recognized for excellence in software development. As part of the Tata group, India’s largest multinational business group, TCS employs over 612,000 consultants across 55 countries. In FY2024, TCS generated revenues of US $29 billion and is listed on the BSE and NSE in India. Our commitment to sustainability is reflected in our inclusion in indices such as the MSCI Global Sustainability Index and FTSE4Good Emerging Index.

Job Description

Role Responsibilities:

1. Design high-quality deliverables aligned with business requirements, standards, and design principles.
2. Develop and maintain scalable, high-performance data transformation applications using Apache Spark.
3. Implement and integrate code following CI/CD practices, utilizing Spark Framework in Scala/Java, and provide solutions for big data challenges using Spark, Hive, and MPP processes like IMPALA.
4. Create JUnit tests to ensure code coverage meets standards.
5. Collaborate with geographically distributed teams.
6. Review code modules developed by junior team members.

Required Skill Sets:

1. Hands-on experience in programming languages such as Java and Scala, using Maven, Apache Spark frameworks, and Unix Shell scripting.
2. Proficiency with Unix File System and HDFS commands.
3. Experience with query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, and HBase.
4. Good communication and customer management skills, with flexibility to adapt.

Desired Skill Sets:

1. Knowledge of Big Data ingestion tools like SQOOP and KAFKA.
2. Understanding of components within the Big Data ecosystem.
3. Experience with development tools such as Eclipse IDE, Tectia Client, and Oracle SQL Developer.

Tata Consultancy Services Canada Inc. is committed to accessibility in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC). Please inform Human Resources if you require accommodations during the recruitment process.

Thank you for your interest in TCS. Qualified candidates will be contacted.