Senior Spark Developer - Real-Time Pipelines (Scala/Python)

HCLTech

Mississauga

On-site

CAD 100,000 - 150,000

Full time

11 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

HCL Technologies Limited in Mississauga is seeking a Senior Apache Spark Developer to design and implement scalable data pipelines using Apache Spark with Scala and Python. The role focuses on coding, testing, and maintaining high-performance applications.

You will collaborate with teammates to translate requirements into robust software solutions, optimize performance, and stay current with evolving big data trends in a fast-paced environment.

Qualifications

  • Proficiency in Apache Spark for real-time data processing.
  • Strong programming skills in Scala and Python.
  • Experience designing scalable, high-performance applications.
  • Knowledge of big data technologies and frameworks.
  • Excellent teamwork and communication.

Responsibilities

  • Design and develop scalable data processing pipelines using Apache Spark
  • Implement algorithms and perform data analysis using Scala and Python
  • Collaborate within team to understand requirements and deliver high-quality software solutions
  • Troubleshoot and debug applications to optimize performance and enhance user experience
  • Stay updated on industry trends and best practices in big data technologies

Skills

Spark
Scala
Python
Big data
Teamwork
Problem solving

Education

Cloudera Certified Spark and Hadoop Developer

Job description

HCL Technologies Limited in Mississauga is seeking a Senior Apache Spark Developer to design and implement scalable data pipelines using Apache Spark with Scala and Python. The role focuses on coding, testing, and maintaining high-performance applications.

You will collaborate with teammates to translate requirements into robust software solutions, optimize performance, and stay current with evolving big data trends in a fast-paced environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Spark & Scala Engineer – Data Pipelines
Senior Spark & Scala Engineer – Data Pipelines

LTM • Mississauga

On-site
CAD 90,000 - 130,000
Senior Apache Spark Developer - Scala, Python
Senior Apache Spark Developer - Scala, Python

HCLTech • Mississauga

On-site
CAD 100,000 - 150,000
Senior Data Engineer - Big Data & Spark Expert
Senior Data Engineer - Big Data & Spark Expert

Wipro Ltd. • Mississauga

On-site
CAD 100,000 - 150,000
Specialist - Data Engineering
Specialist - Data Engineering

LTM • Mississauga

On-site
CAD 90,000 - 130,000
Senior Java Spark Engineer — Big Data & AI Tools
Senior Java Spark Engineer — Big Data & AI Tools

Capgemini • Montreal

On-site
CAD 38,000 - 59,000
Medical benefits
Dental benefits
Vision benefits
+1
Spark Developer (With Java)
Spark Developer (With Java)

Capgemini • Mississauga

On-site
CAD 90,000 - 130,000
Spark Scala Developer | Data Processing with Spark & Java
Spark Scala Developer | Data Processing with Spark & Java

Astra-North Infoteck Inc. • Toronto

On-site
CAD 90,000 - 120,000
Scala/SparkDeveloper
Scala/SparkDeveloper

Nexgen HR and Tech Solutions Inc. • Toronto

Hybrid
CAD 110,000 - 150,000
Spark Big Data Engineer | Scala/Java & ETL Analytics
Spark Big Data Engineer | Scala/Java & ETL Analytics

Tata Consultancy Services Limited • Toronto

On-site
CAD 90,000 - 110,000
Data Engineering Software Engineer — Pipelines & Spark
Data Engineering Software Engineer — Pipelines & Spark

Unchain Data • Toronto

On-site
CAD 136,000 - 160,000
Bonus opportunities
Equity
Benefits