Big Data Cloud Developer (Senior)

CGI; Montreal; On-site; CAD 80,000 - 120,000; Full time

Job summary

Join a forward-thinking company as a Big Data Cloud Expert, where you will play a pivotal role in enhancing the Data Lake platform on Microsoft Azure. Collaborate with teams across the AMER region, leveraging cutting-edge technologies like Spark and Kafka to drive project transformation and implementation. Your expertise will ensure a self-service platform that thrives on automation and security. This role offers a unique opportunity to work with innovative solutions while fostering collaboration and knowledge sharing within a global team. If you're passionate about Big Data and cloud technologies, this is the perfect chance to make a significant impact.

Qualifications

• 5+ years of experience in Java for multi-threaded applications.
• Extensive knowledge of Big Data technologies and Azure services.

Responsibilities

• Design and evolve the Data Lake platform on Azure.
• Provide expertise for onboarding projects and ensuring platform stability.

Skills

Java

Big Data Technologies

Microsoft Azure

Apache Spark

RDBMS (Oracle SQL, PostgreSQL)

Education

Bachelor’s degree in Computer Science

Tools

Terraform

PowerShell

Bash

Git

GitHub

Jira

Docker

Jenkins

Job description

Position Description:

As Big Data Cloud Expert, you are part of a global central team distributed between Montréal and Paris, with responsibilities related to our Data Lake platform on Microsoft Azure cloud. You serve as the main point of contact for AMER region projects, supporting teams using the platform across various business lines.

Your future duties include:

1. Designing the evolution of the Data Lake platform and supporting project transformation, implementation, and production support.
2. Providing expertise to onboard projects onto the platform.
3. Leveraging Open-Source technologies like Spark and Kafka, as well as Azure-specific technologies such as Azure Storage, HDInsight, Synapse, Fabric, AKS, etc.
4. Ensuring the platform is self-service with automation, security, and stability for critical processes.
5. Participating in testing, evaluating new Azure technologies, and collaborating with security and Microsoft teams.
6. Building automation, monitoring solutions, and providing training on data technologies.
7. Assisting data project teams with onboarding and transformation on Azure.
8. Training team members and advising on Big Data project implementations.
9. Participating in production support, including overtime when necessary, and communicating incidents to AMER users.

Required qualifications:

• 5+ years of experience with Java, developing multi-threaded applications and APIs.
• Extensive experience with Big Data technologies such as Hadoop, Kafka, Azure Kubernetes Service, Delta or Iceberg formats.
• Proficiency with Microsoft Azure cloud services like Azure Storage, Synapse, and Azure AI Search.
• Experience with Apache Spark.
• Background in RDBMS such as Oracle SQL or PostgreSQL.

Nice to have skills:

• Knowledge of Terraform, PowerShell, Bash.
• Experience with DevOps tools like git, GitHub, Jira, Docker, Jenkins.
• Bachelor’s degree in computer science or equivalent certifications.
• Languages: French and English, with strong communication skills in English required.

Location: Montreal