Senior Software Engineer: Big Data Spark & Java (Canada)

Capgemini Engineering; Canada; On-site; CAD 65,200 - 158,550; Full time

Benefits offered by this job

Paid time off

Medical, dental, and vision coverage

Retirement savings plans

Life and disability insurance

Employee assistance programs

Job summary

A leading engineering consultancy in Canada is looking for a Senior Software Engineer specialized in Java and Spark. In this role, you will work on a large social media platform processing petabytes of data. The position involves optimizing data systems, designing solutions, and collaborating with cross-functional teams. Ideal candidates should have over 5 years of experience and a passion for innovative problem-solving. You will also participate in open-source initiatives and develop scalable data processing frameworks.

Qualifications

• 5+ years of experience as Software Engineer with Solid Java, Python coding skill with Spark.
• 3+ years of experience of building and support large scalable big data infrastructure/platform.
• Knowledge of big data technologies (e.g. Spark, Hadoop, Parquet/ORC, Flink).

Responsibilities

• Develop best practices for data coding to ensure consistency within the system.
• Design, implement, and maintain pipelines for business critical data using cloud technology.
• Collaborate with other teams to address area-level risks.

Skills

Solid Java

Python coding

Spark

Big data technologies

Effective communication

Tools

AWS

Kubernetes

Job description

A leading engineering consultancy in Canada is looking for a Senior Software Engineer specialized in Java and Spark. In this role, you will work on a large social media platform processing petabytes of data. The position involves optimizing data systems, designing solutions, and collaborating with cross-functional teams. Ideal candidates should have over 5 years of experience and a passion for innovative problem-solving. You will also participate in open-source initiatives and develop scalable data processing frameworks.