Sr Data Developer Engineer I

Tutela Technologies LTD; Eastern Ontario; Remote; CAD 100,000 - 130,000; Full time

Job summary

A leading technology company is seeking a Senior Data Engineer (Remote) with extensive experience in AWS Spark, Python, and big data pipeline optimization. The successful candidate will improve data infrastructures and collaborate closely with data teams to modernize how data drives customer acquisition and retention strategies. An attractive benefits package and flexible remote working options are offered.

Benefits

95% remote work

Comprehensive private health care

Summer parties and social events

Multisport Card

Qualifications

• 5+ years of experience in building and optimizing big data pipelines in Apache Spark.
• 5+ years of experience with Python and Java.
• Advanced knowledge of relational SQL databases.
• 3+ years of experience with MSSQL, Postgres, AWS Athena, or Redshift.
• Experience in writing unit tests.
• Strong analytical skills in dealing with unstructured datasets.
• Ability to communicate effectively within cross-functional teams.

Responsibilities

• Improve big data pipelines in AWS Spark.
• Assemble complex data sets for business requirements.
• Build scalable data infrastructure for stakeholders and customers.
• Collaborate with data scientists and engineers on product development.

Skills

Building and optimizing big data pipelines in Apache Spark

Python

Java

Relational SQL databases

Unit testing

AWS cloud services

Analytic skills with unstructured datasets

Communication skills

Education

Bachelor’s degree

Tools

Spark

AWS

SQL

Apache Airflow

Job description

Senior Data Engineer (Spark)

Engineering

Engineering Manager

Canada (Remote)

What you will be doing

• Own and improve our big data pipelines in AWS Spark.
• Assemble large, complex data sets that meet business requirements, with engineering best practices in mind.
• Build scalable and resilient data infrastructure, as well as tools to extract and transform data used by stakeholders and customers.
• Work closely with our data scientists and our data engineers to create and evolve products that measure market dynamics in the Telecommunication space that drive our customers short term marketing campaign tactics and their longer-term customer acquisition and retention strategies.

Tech stack

• Spark, Python, Scala, SQL, Redshift, Athena, S3, Airflow, EMR

We're looking for

• 5+ years of experience with building and optimizing big data pipelines in Apache Spark
• 5+ years of experience with Python and Java
• Advanced with relational SQL databases and SQL
• 3+ years of experience with one of DB : MSSQL, Postgres, AWS Athena (Presto), Redshift
• 3+ years of experience in writing unit tests
• Experience with AWS cloud services like EC2, S3, EMR or equivalent
• Strong analytic skills in working with unstructured datasets.
• Experience in root cause analysis of data when asked to answer specific business questions
• Experience working with cross-functional teams
• Strong communication and collaboration skills
• Bachelor’s degree
• English (B2 or higher)

It'd be nice to have

• Experience with Scala
• Experience with data pipeline / workflow tools i.e. Apache Airflow
• Experience in AWS solution architecture
• Experience in implementing complex clustering and classification models on large datasets to support new product development

About Us

Opensignal is the leading global provider of independent insight and data into network experience and market performance. Our user-centric approach allows communication providers to constantly improve their network and maximize commercial performance. Leading analysts, investors and financial institutions place a high value on our independent analysis and we are regular contributors to their reports.

Real network experience is our focus and ultimately that’s what influences customer choice. Our mission is to advance connectivity for all and here at Opensignal, the team is leading the industry in enabling operators to link their network experience and market performance in a way that has never after been possible.

With offices in London, Boston and Victoria, British Columbia, we are truly global, with employees working across four continents and representing over 25 nationalities. We are an equal opportunity employer dedicated to building an inclusive and diverse workforce.

Benefits

• 95% remotely - the team meets in the Warsaw office for 1 day / month
• Summer party and other social events
• Comprehensive private health care package for you and your family (dental care included)
• Multisport Card