Java Developer with Big Data (Scala, Spark)

CG Consulting Group; Toronto; Hybrid; CAD 90,000 - 150,000; Full time

Job summary

An established industry player seeks a talented Java Developer with extensive experience in Big Data technologies. In this exciting role, you will focus on regulatory projects, providing software engineering expertise for data pipeline applications. You'll leverage your strong background in Java, Spring, and Big Data frameworks like Scala and Spark, while also collaborating with diverse stakeholders. This hybrid position offers the flexibility of working in the office three days a week, allowing you to thrive in a dynamic environment. If you're ready to take on a leadership role in software development and make a significant impact, this opportunity is for you.

Qualifications

• 10+ Jahre Erfahrung in der Backend-Entwicklung mit Java und Spring.
• 5+ Jahre Erfahrung in der Entwicklung von Big Data Anwendungen mit Scala/Spark.

Responsibilities

• Entwicklung und Unterstützung von Datenpipeline-Anwendungen.
• Technische Führung und Koordination im Softwaredesign.

Skills

Problem Solving

Java

Spring/Spring Boot

Scala

Spark

Big Data Applications

Micro-service Architecture

Containerization

CI/CD Pipelines

Python

Tools

Docker

Kubernetes

Openshift

Jenkins CI

Git

Job description

Java Developer with Big Data (Scala, Spark)

This is with a large IT services firm for a major bank
Candidate must have legal work status for Canada.
Client Location is downtown Toronto, close to TTC and GO.
Hybrid - In-Office 3 days per week.
Perm/FT role, salary and benefits or on contract - 6 months to start
Market rate
Several positions available

Description:
This is a newly created position working on our regulatory projects. The primary focus of this role is to provide software engineering expertise, covering design, implementation and support of data pipeline applications. Additional focus will be to work with other internal application development teams.
A technical expert in developing, coding, testing and debugging new software or making significant improvements to existing software. Experience and expertise must be significant to support the software design phases. Could be responsible for overall design, development and team coordination on the business system/application. Significant independent judgment is to be used and will be expected to act as a technical leader on projects.

Knowledge & Experience
Must Have:
• Strong background in problem solving, OOP, data structures and algorithms.
• 10+ years backend application development experience in Java and Spring/Spring Boot
• 5+ years in developing and optimizing Big Data applications using Java with Scala and/or Spark
• Experience Cloudera/HDP or similar big data/ Hadoop DB systems.
• Experience in developing/designing micro-service architecture.
• Proven hands-on experience in containerization – Docker, Kubernetes, Openshift etc.
• Working knowledge of Jenkins CI, Git, CI/CD pipelines
• Ability to work with multiple stakeholders – business and technical
• Experience with capital markets, trading, market data, investment mgnt, risk mgnt or similar type applications

Nice to Have
• Experience in building end to end data pipelines on AWS/Azure and/or Databricks
• Experience in large scale on-premise to Cloud migration projects
• Programming experience in Python (2+ years)