Data Engineer II - Street Data

NextGenEnergyJobs; Canada; On-site; CAD 85,000 - 120,000; Full time

Benefits offered by this job

Health benefits

401(k) & profit-sharing

Vacation leave

Paid holidays

Growth opportunities

Job summary

NextGenEnergyJobs in Canada seeks a Data Engineer to design, implement, and maintain scalable ETL pipelines for ingesting and transforming street network data. You will work with Python, SQL, and orchestration tools to ensure data quality and timely updates.

Responsibilities include collaborating with providers and engineers, analyzing routing requests for data errors, and documenting data models and workflows.

Qualifications

• 2+ years of experience building and maintaining ETL pipelines.
• Proficiency in Python, SQL, and data-processing frameworks or orchestration tools (Airflow, Dagster).
• Strong understanding of relational databases (PostgreSQL, SQL Server).
• Experience with containerization (Docker) and CI/CD pipelines; version control (Git).
• Experience with geospatial data formats and cloud platforms (AWS, Azure).
• Exposure to big data technologies (Spark, Hadoop).
• Knowledge of transportation network modeling and routing APIs (OpenStreetMap, HERE, TomTom).

Responsibilities

• Design, implement, and maintain scalable ETL pipelines for street data ingestion and transformation.
• Automate and optimize data processing workflows to ensure timely updates to transportation network datasets.
• Collaborate with data providers, customers, and software engineers to meet data requirements.
• Develop and maintain processes to analyze routing requests for data-related errors and coordinate fixes.
• Document data models, workflows, and best practices.

Skills

Python

SQL

ETL

Airflow

Dagster

Docker

CI/CD

Git

GIS

AWS

Azure

Spark

Hadoop

OpenStreetMap API

HERE API

TomTom API

PostgreSQL

SQL Server

Education

Bachelor’s degree in Computer Science, Data Engineering, GIS, or related field

Tools

Airflow

Dagster

Docker

Git

PostgreSQL

SQL Server

Spark

Hadoop

OpenStreetMap API

HERE API

TomTom API

AWS

Azure

Job description

We are seeking a talented Data Engineer to join our team and play a key role in building world-wide street networks.

Key Responsibilities

• Design, implement, and maintain scalable ETL pipelines for ingesting, transforming, and loading street data from various sources
• Automate, maintain, and optimize data processing workflows to ensure timely and accurate updates to transportation network datasets
• Collaborate with data providers, customers, and software engineers to understand data requirements and deliver high-quality solutions
• Develop and maintain processes to analyze routing requests for data-related errors and collaborate with data providers to ensure issues are corrected in future data updates
• Document data models, workflows, and best practices

Requirements

• 2+ years of experience building and maintaining ETL pipelines
• Proficiency in Python, SQL, and data-processing frameworks or orchestration tools (such as Apache Airflow, Dagster)
• Strong understanding of relational databases (such as PostgreSQL, SQL Server)
• Experience with containerization (such as Docker) and CI/CD pipelines
• Familiarity with version control systems (such as Git)
• Excellent problem-solving and communication skills
• Bachelor’s degree in Computer Science, Data Engineering, GIS, or related field
• Experience with geospatial data formats
• Experience with cloud data platforms (such as AWS, Azure) and cloud-based ETL tools
• Exposure to big data technologies (such as Spark, Hadoop)
• Knowledge of transportation network modeling and routing algorithms
• Familiarity with APIs for street data (such as OpenStreetMap, HERE, TomTom)
• Understanding of data governance, quality, and security best practices
• #LI-EL1
• #LI-Onsite
• Esri’s competitive total rewards strategy includes industry-leading health and welfare benefits: medical, dental, vision, basic and supplemental life insurance for employees (and their families), 401(k) and profit-sharing programs, minimum accrual of 80 hours of vacation leave, twelve paid holidays throughout the calendar year, and opportunities for personal and professional growth. Base salary is one component of our total rewards strategy. Compensation decisions and the base range for this role take into account many factors including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs.
• A reasonable estimate of the base salary range is