Data Engineer

LanceSoft; Toronto; Hybrid; CAD 80,000 - 110,000; Full time

Job summary

An innovative firm is seeking a seasoned Data Engineer to join their dynamic team on a highly visible project. This role involves designing and maintaining robust data pipelines, automating workflows, and collaborating with stakeholders to meet data needs. With over a decade of experience in data platforms and cloud technologies, the ideal candidate will thrive in a fast-paced environment, ensuring high-quality data management and integration. This opportunity not only offers the chance to work on significant projects but also opens pathways for career advancement within the organization. If you're passionate about data engineering and eager to make an impact, this role is perfect for you.

Qualifications

• 10+ years of experience with Data Warehouse/Data Platforms.
• 5+ years creating ELT data pipelines with SQL.
• Experience with data ingestion tools and CI/CD.

Responsibilities

• Design and maintain robust data pipelines for large datasets.
• Collaborate with stakeholders to analyze data needs.
• Monitor application and pipeline performance.

Skills

Data Warehouse / Data Platforms

Creating ELT data pipelines

Data ingestion tools (Fivetran, Qlik, Airbyte)

Cloud (GCP)

Data integration processes

CI/CD and source control systems (Github, Bitbucket, Terraform)

Data modelling

Python

DBT

Education

Bachelor's degree in computer science or related field

Tools

Fivetran

Qlik

Airbyte

Github

Bitbucket

Terraform

Job description

Description:
Location Address: 44 King Street W 23rd Floor - Hybrid model ( 1 day a week in office- No specific days)
Contract Duration: 3 Months.
Possibility of extension & conversion to FTE – Possibly - Depending on performance and funding approval
Schedule Hours: 9 am-5 pm Monday-Friday (No overtime – to be discussed with the hiring manager if needed)

Candidate Value Proposition:
The successful candidate will have the opportunity to work on a highly visible project, opening up doors of opportunities within the organization.

Typical Day in Role:
• Design, develop and maintain robust data pipelines for ingestion, transformation, and distribution of large datasets.
• Utilize services and tools to automate data workflows and streamline the data engineering process.
• Collaborate with stakeholders and product managers to analyze, and build data mapping, models and reporting needs.
• Monitor application and pipeline performance.
• Conduct data quality checks

Candidate Requirements/Must Have Skills:
• 10+ years of experience with Data Warehouse / Data Platforms
• 5+ years of experience creating ELT data pipelines from scratch, working with structured, semi-structured, and unstructured data and SQL.
• 2+ years of experience configuring and using data ingestion tools such as Fivetran, Qlik, Airbyte or others.
• 3+ years of experience with Cloud: GCP
• 5+ years of experience working as a data developer, data engineer, programmer, ETL, ELT, with processes for data integration.
• 5+ years of continuous integrations and continuous deployment pipeline (CI/CD) and working with source control systems such as Github, Bitbucket, and Terraform

Nice-To-Have Skills:
• Experience in data modelling, manipulating large data sets and handling raw SQL, and handling other cleaning techniques.
• Python – nice to have
• DBT – nice to have

Education & Certificates:
Bachelor's degree in a technical field such as computer science, computer engineering or related field required or sufficient experience.

Best VS. Average Candidate:
The ideal candidate is someone who can quickly adapt to any change, solve problems effectively, and implement sustainable solutions.