Senior Data Engineer: Spark, Python/Scala & Snowflake

Capgemini; Brampton; On-site; CAD 85,000 - 110,000; Full time

Job summary

A global technology consulting firm is seeking a Senior Software Engineer specialized in data engineering, particularly with expertise in Python/Scala and big data technologies like Spark and Snowflake. The ideal candidate will have 7-10 years of experience, strong analytical skills, and a Bachelor's degree. This role involves implementing AWS Big Data solutions while leveraging CI/CD practices. This firm values diversity and offers opportunities for growth in a supportive environment.

Qualifications

• 7-10 years of experience, with at least 3 years in a relevant role.
• Certification: Should have SE Level 1 and seeking Level 2.
• Excellent analytical and problem-solving skills.

Responsibilities

• Implement AWS Big Data Lake using EMR and Spark.
• Develop data pipelines using Python, Scala, SQL.
• Deploy real-time data streams in a cloud-native infrastructure.

Skills

Business Analysis

Software Engineering

Data Management

Technical Solution Design

Education

Bachelor’s degree

Tools

Spark

Snowflake

AWS

GitLab

Job description

A global technology consulting firm is seeking a Senior Software Engineer specialized in data engineering, particularly with expertise in Python/Scala and big data technologies like Spark and Snowflake. The ideal candidate will have 7-10 years of experience, strong analytical skills, and a Bachelor's degree. This role involves implementing AWS Big Data solutions while leveraging CI/CD practices. This firm values diversity and offers opportunities for growth in a supportive environment.