Data Engineer (Optimization Algorithms)

Brix; Remote; CAD 80,000 - 100,000; Full time

Job summary

A leading data services startup in Canada is seeking a Data Engineer to develop data solutions that leverage optimization algorithms. The ideal candidate will possess a Bachelor's degree in a relevant field and at least 2 years of experience in data engineering. You'll work with Python and SQL, deploying solutions on cloud platforms like AWS or Azure. Responsibilities include designing data pipelines and enhancing simulation tools. Join a team that values creativity and diversity, striving to disrupt traditional processes!

Qualifications

• 2+ years of experience in data engineering with a focus on optimization algorithms.
• Proficiency in Python, SQL, and familiarity with tools like Databricks and Apache Spark.
• Experience with optimization frameworks or modules such as CuOpt, Gurobi, or CPLEX.

Responsibilities

• Design, develop, and maintain data pipelines with optimization algorithms.
• Collaborate with data scientists to integrate optimization algorithms.
• Analyze system performance to improve efficiency and accuracy.

Skills

Data pipeline development

Optimization algorithms

Analytical skills

Problem-solving skills

Python

SQL

Cloud platforms

Education

Bachelor’s degree in Computer Science, Data Engineering, Operations Research, or a related field

Tools

Databricks

Apache Spark

CuOpt

Gurobi

CPLEX

Job description

Overview

About the job: Seeking a Data Engineer with experience in optimization algorithms and modules similar to Nvidia's CuOpt. In this role, you will be responsible for designing and implementing data-driven solutions that optimize complex systems and processes within our simulation environments.

Team Culture

Hey! At our startup, we're all about disrupting the norm and creating memorable customer experiences. We prioritize being customer-centric and embracing diversity and inclusion. My leadership style is centered around fostering creativity and daring to challenge traditional approaches. If you're inspired by disrupting industries, building outstanding customer journeys, and contributing to an inclusive team, reporting directly to me could be a thrilling adventure.

About The Company

Pentatonic

CA

1-50 employees

Seed Round

Data services

Description

• Design, develop, and maintain data pipelines that incorporate optimization algorithms for real-time decision-making.
• Implement and customize optimization modules similar to Nvidia CuOpt to enhance the performance of simulation tools.
• Collaborate with data scientists and engineers to integrate optimization algorithms into simulation workflows.
• Analyze system performance and provide recommendations for improving efficiency and accuracy.
• Work with cloud platforms (AWS, Azure) to deploy and manage optimization solutions at scale.

Requirements

• Education background: Bachelor’s degree in Computer Science, Data Engineering, Operations Research, or a related field.
• Experience: 2+ years of experience in data engineering with a focus on optimization algorithms.
• Technical skills: Proficiency in Python, SQL, and familiarity with tools like Databricks and Apache Spark; Experience with optimization frameworks or modules such as CuOpt, Gurobi, or CPLEX; Experience with cloud platforms and scalable data solutions is a plus.
• Soft skills: Strong analytical and problem-solving skills, with a focus on optimizing complex systems

Interview process

• AI interview
• Code assessment
• Technical assessment
• On-site interview
• Offer negotiation