Big Data Systems Engineer

Pyramid Consulting, Inc; Toronto; Hybrid; CAD 77,000 - 79,000; Full time

Job summary

Pyramid Consulting, Inc. is seeking a Big Data Systems Engineer for a 6+ months contract in Toronto, hybrid. The role focuses on migrating Spark modules to Scala and building scalable data pipelines using Spark, Java, Spring Boot, and MSSQL.

You will work on senior-level Big Data tasks, optimize performance, and collaborate with IT teams to deliver robust data solutions. This position offers long-term potential with the client.

Qualifications

• 8+ years Big Data with Spark and Hadoop ecosystem components.
• Expert in Scala and Java programming.
• Backend experience with Spring Boot and RESTful APIs.
• Database experience with MSSQL.
• Nice to have cloud migration experience (Azure/AWS) and ML concepts.
• Migrate and refactor Java Spark modules to Scala with quality and performance.
• Design, develop, test, and productionize new Scala Spark module with limited supervision.

Responsibilities

• Migrate and refactor existing Java Spark modules to Scala with quality and performance.
• Individually design, develop, test, and productionize the new Scala Spark module with minimal supervision.

Skills

Spark

Scala

Java

Spring Boot

REST APIs

MSSQL

Azure

AWS

Data Engineer

Hadoop

Hive

Job description

Immediate need for a talented Big Data Systems Engineer. This is a 06+months contract opportunity with long-term potential and is located in Toronto, ON(Hybrid).

Job ID:26-19758

Pay Range: CAD 56 - CAD 57.14/hour.

Key Requirements and Technology Experience:

• Key Skills: SENIOR SPARK DEVELOPER, SCALA BIG DATA DEVELOPER, DATA ENGINEER, APACHE SPARK,JAVA, SPRING BOOT.
• 8+ years Big Data: Apache Spark, Hadoop ecosystem(HDFS, Hive, Yarn).
• Programming : Expert in Scala and Java .
• Backend :Spring Boot, RESTful APIs .
• Database : Microsoft SQL Server(MSSQL) .
• Nice to have : Experience in migrating on-premise applications to cloud (Azure/AWS), familiarity with machine-learning concepts and workflows Primary Responsibility .
• Migrate and refactor existing Java based Spark modules to Scala, ensuring code quality, performance, and scalability.
• Individually design, develop, test, and productionize the new Scala spark module with minimal supervision

Our client is a leading IT Industry, and we are currently interviewing to fill this and other similar contract positions.

Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, colour, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.