Senior Data Engineer

Wiser Solutions, Inc.; Toronto; Remote; CAD 120,000 - 140,000; Full time

Job summary

Wiser Solutions, Inc. seeks a Senior Data Engineer to spearhead the development of a high-performance Matching platform. The role involves designing data integration pipelines, optimizing algorithms, and leveraging cutting-edge technologies in a collaborative environment. Ideal candidates possess a strong background in software and data engineering with a passion for innovation.

Benefits

Performance-based bonuses

Continuous learning opportunities

Qualifications

• Over 7 years of professional experience in software and data engineering.
• Strong proficiency in Python and Node.js.
• Experience with data processing technologies such as Spark, Flink, and Airflow.

Responsibilities

• Design and implement robust data integration pipelines.
• Develop and optimize matching algorithms.
• Collaborate in architecting microservices-based architectures.

Skills

Python

Node.js

SQL

Data Structures

Algorithms

AWS

Docker

Kubernetes

Education

Bachelors/Master's degree in Computer Science

Tools

Apache Spark

Apache Airflow

MongoDB

Postgres

MySQL

Job description

Get AI-powered advice on this job and more exclusive features.

Sign in to access AI-powered advices

Continue with Google Continue with Google

Continue with Google Continue with Google

Continue with Google Continue with Google

Continue with Google Continue with Google

Continue with Google Continue with Google

Continue with Google Continue with Google

Company Description

Wiser Solutions is the global leader in omnichannel retail intelligence, empowering over 750 global brands and retailers to gain a decisive advantage at every consumer decision point. Every day, Wiser collects and analyzes billions of online and in-store data points with 98% accuracy, offering a single trusted source of insights into pricing dynamics, promotional effectiveness, competitive activity, and retail execution. Their portfolio of market-proven solutions equips brands and retailers to proactively guide, not just follow, the consumer journey, ensuring optimal visibility, execution, and profitability across every retail touchpoint.

Company Description

Wiser Solutions is the global leader in omnichannel retail intelligence, empowering over 750 global brands and retailers to gain a decisive advantage at every consumer decision point. Every day, Wiser collects and analyzes billions of online and in-store data points with 98% accuracy, offering a single trusted source of insights into pricing dynamics, promotional effectiveness, competitive activity, and retail execution. Their portfolio of market-proven solutions equips brands and retailers to proactively guide, not just follow, the consumer journey, ensuring optimal visibility, execution, and profitability across every retail touchpoint.

Job Description

Location of Job: Remote- Canada

We are a dynamic team dedicated to solving complex problems in the realm of online retail product data. Our mission is to collect, categorize, and analyze vast amounts of semi-structured data from online retailers across the US and Canada. We empower our customers to gain a competitive edge by uncovering valuable insights hidden within this data.



We are seeking a talented Senior Data Engineer to join our Matching team. As a key member of our team, you will play a pivotal role in developing the next-generation consolidated Matching platform capable of handling over 200 million transactions per day. Your expertise will be instrumental in designing, building, and optimizing high-performance, scalable solutions that enable our customers to extract maximum value from their data.

If you are a highly motivated and talented software engineer who thrives in a fast-paced environment, we encourage you to apply. Join our team and make a significant impact on the future of product data analysis.

Essential Functions

• Data Integration and Matching: Design and implement robust data integration pipelines to collect, clean, and standardize product data from various sources. Develop advanced matching algorithms to identify and correlate products across different retailers.
• Platform Software Development: Research, evaluate and synthesize users’ requirements and other technical information to design and develop our distributed software platform, ensuring its scalability, reliability, and performance. Collaborate with other engineers to architect and implement microservices-based architectures.
• Algorithm Optimization: Continuously optimize matching algorithms and data processing pipelines to improve efficiency and accuracy. Leverage your expertise in data structures, algorithms, and performance tuning to enhance system responsiveness.
• Technical Innovation: Apply the latest technologies to enhance software performance and security. Troubleshoot and resolve complex technical issues. Translate business needs into efficient technical solutions. Drive improvements in software development processes and promote continuous learning.
• Technical Leadership: Foster a collaborative team environment. Mentor and guide junior developers, fostering a culture of innovation and excellence. Share your knowledge and experience to drive best practices and ensure high-quality code. Coordinate between technical teams and stakeholders in the development of software and integrated information systems.
• Problem-Solving: Collaborate with cross-functional teams to identify and solve complex technical challenges. Apply your analytical skills and problem-solving abilities to deliver innovative solutions.
  
  

Technologies We Use

• Languages: Python, SQL , NodeJS/NestJS/Typescript, React/Redux
• Infrastructure: AWS, Docker, Kubernetes, Apache Spark, Apache Airflow, Terraform, GitHub Actions, ArgoCD
• Databases: MongoDB, Postgres, MySQL, Trino, Iceberg, Redis, Memcached
• Streaming and Queuing: Kafka, NATS, RabbitMQ, Keda
  
  

Qualifications

• Bachelors/Master's degree in Computer Science or relevant technical degree
• Over 7 years of professional experience in software and data engineering.
• Strong proficiency in Python and Node.js, with a deep understanding of distributed systems and cloud-native technologies
• Strong proficiency working of RDMS/NoSQL/Big Data solutions (Postgres, MongoDB, Trino, etc.)
• Proficiency working with data processing technologies such as Spark, Flink, and Airflow
• Solid understanding of Data Lakes, Data Warehouses, and modeling practices (Data Vault, etc.)
• Understanding of streaming solutions such as Kafka, Pulsar, Kinesis/Firehose, etc.
• Excellent understanding of Docker and Kubernetes
• Solid understanding of ETL/ELT and OLTP/OLAP concepts
• Solid understanding of columnar/row-oriented data structures (e.g. Parquet, ORC, Avro, etc.)
• Mastery of AWS, Linux and infrastructure as code.
• Experience leveraging data lake solutions (e.g. AWS Glue, DBT, Trino, Iceberg, etc.)
• Understanding of Domain Driven Design concepts and Microservices Architecture
• Experience working in an agile team environment
  
  

Bonus Points

• Experience working within a retail or ecommerce industry.
• Full stack engineering experience, including front end frameworks (React, Redux)
• Experience with CQRS
• Experience with C4 modeling
  
  

Additional Information

Other Duties - Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.

EEO STATEMENT - Wiser Solutions, Inc. is an Equal Opportunity Employer and prohibits Discrimination, Harassment, and Retaliation of any kind. Wiser Solutions, Inc. is committed to the principle of equal employment opportunity for all employees and applicants, providing a work environment free of discrimination, harassment, and retaliation. All employment decisions at Wiser Solutions, Inc. are based on business needs, job requirements, and individual qualifications, without regard to race, color, religion, sex, national origin, family or parental status, disability, genetics, age, sexual orientation, veteran status, or any other status protected by the state, federal, or local law. Wiser Solutions, Inc. will not tolerate discrimination, harassment, or retaliation based on any of these characteristics.

Base pay is one part of our total compensation package. Pay is established on an individual basis after considering multiple factors such as relevant experience, education, and other qualifications. In addition, we take into account geographical differentials and make sure pay is equitable with our current staff. For this position, our hiring range for base annual pay is estimated to be CAD$120,000 to $140,000, at the time of this posting.

Performance-based discretionary bonuses and variable pay plans are available for some positions.

If you require accommodation to complete any part of the application process or need an alternative manner to apply, please contact us at [e-mail] or call [phone]. "

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Industries

  Software Development

Referrals increase your chances of interviewing at Wiser Solutions, Inc. by 2x

Get notified about new Senior Data Engineer jobs in Toronto, Ontario, Canada.

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.