Sr Data Engineer

Capgemini; Mississauga; On-site; CAD 120,000 - 180,000; Full time

Job summary

Capgemini is seeking a Senior Data Engineer in Mississauga to join our scrum teams and drive functional development for Hadoop-based data lake initiatives. You will integrate data across sources to enable analytics and support critical systems.

The role requires deep experience with AWS, big data tooling, and a track record of delivering high-visibility, fast-paced projects while mentoring others and collaborating across teams.

Qualifications

• Bachelors degree in a quantitative field (Engineering, Computer Science, Statistics, Econometrics) and 9+ years of experience.
• Minimum 5 years of experience in building big data solutions.
• Hands-on experience with AWS, shell scripting, SQL, Hadoop commands, Kafka, Spark, and Git.
• Experience with real-time data streaming systems.
• Ability to write abstracted, reusable code components.
• Proficiency in at least two of Scala, Java, or Python.

Responsibilities

• Participate in the agile development process.
• Develop functional and technical specifications from business requirements for the platform.
• Ensure application quality and meet performance requirements.
• Assist with project estimates and plans; represent engineering in meetings and discussions.
• Participate in code reviews and team knowledge sharing.
• Collaborate with data engineers to build analytic applications using AWS Big Data technologies (Kafka, PySpark, Spark, Hadoop).
• Mentor and influence team members and stakeholders.
• Perform additional duties as assigned.

Skills

Agile development

Mentoring

Team collaboration

Analytical thinking

Communication skills

Education

Bachelors degree in a quantitative field

Tools

AWS

Kafka

Spark

Hadoop

PySpark

Shell scripting

SQL

Git

Job description

Year of experience: 8+ Years of experience

Senior Data Engineer role to be part of our scrum teams and perform functional system development for Hadoop applications for our Enterprise Data Lake initiative

This is high visibility fast paced key initiative will integrate data across internal and external sources provide analytical insights and integrate with our critical systems

• Participate in the agile development process


• Develop functional and technical specifications from business requirements for the commercial platform


• Ensure application quality and adherence to performance requirements


• Help create project estimates and plans Represent engineering team in project meetings and solution discussions


• Participate code review process


• Work with team members to achieve business results in a fast paced and quickly changing environment


• Pair up with data engineers to develop cutting edge Analytic applications leveraging AWS Big Data technologies Kafka PySpark Spark Hadoop Shell Scripting SQL


• Mentor and influence up and down the chain of command


• Perform other duties and or projects as assigned

Qualifications Requirements

• Bachelors degree in a quantitative field such as Engineering Computer Science Statistics Econometrics and a minimum of 9 years of experience


• Minimum 5 years experience working with and developing big data solutions


• Hands on experience on AWS writing shell scripts complex SQL queries Hadoop commands Kafka Spark and Git


• Experience with real ime data streaming systems


• Ability to write abstracted reusable code components


• Programming experience in at least two of the following languages Scala Java or Python

Desired Characteristics

• Strong business acumen


• Critical Thinking and Creativity


• Performance tuning experience


• Willingness to learn new technologies quickly


• Superior oral and written communication skills as well as the willingness to collaborate across teams of internal and external technical staff business analysts software support and operations staff


• Strong business acumen including a broad understanding of Synchrony Financial business processes and practices