Senior Data Engineer

Luxoft; Toronto; On-site; CAD 110,000 - 150,000; Full time

Job summary

Luxoft is seeking a hands-on Data Engineer to support the Total Fund Management Portfolio Management Technology team in Toronto. You will independently design and deliver cloud-native data solutions using platform tooling, with minimal oversight.

Responsibilities include owning timelines, framing designs, building backend services, developing data pipelines, and driving the full SDLC with a focus on production readiness. AWS experience is preferred.

Qualifications

• Strong Python with PySpark.
• Hands-on experience with Databricks, developing and operating data workloads.
• Schema design and data modelling experience.
• Working knowledge of Spark to build and troubleshoot PySpark workloads.
• Prior consulting, advisory, or client-facing delivery experience.
• Proven ownership and independent delivery without close supervision.
• Strong problem-solving skills in ambiguous situations.
• Strong communication and stakeholder management, proactive expectation management.
• Demonstrated adoption of AI-assisted engineering tools and practices.

Responsibilities

• Own timelines and deliverables, proactively managing scope, dependencies, and execution risks.
• Independently frame, design, and deliver software solutions by engaging stakeholders, clarifying ambiguous requirements, and challenging assumptions.
• Build backend services and RESTful APIs aligned to those designs.
• Develop cloud-native applications (AWS preferred).
• Implement workflow automation and data pipelines where needed.
• Contribute across the full software development lifecycle, including CI/CD.
• Ensure solutions are production-ready, including testing, documentation, and handover.
• Act as a reliable execution partner, proactively communicating progress, trade-offs, risks, and changes in expectations.

Skills

Python

PySpark

Databricks

Schema design

Spark

Client facing

Ownership

Problem solving

Communication

AI tools

Tools

Airflow

Job description

We are seeking a hands-on Data Engineer to support the Total Fund Management Portfolio Management Technology team. This role focuses on implementing reliable data solutions in a cloud-native environment using established platform tooling and patterns. You are expected to independently design and deliver data solutions with minimal oversight.

This is not a role for someone who requires detailed task breakdowns or constant direction. Once objectives and constraints are clear, you are expected to independently drive work to completion, proactively manage risks, communicate progress and trade-offs effectively, and manage stakeholder expectations.

Responsibilities

• · Own timelines and deliverables, proactively managing scope, dependencies, and execution risks
• · Independently frame, design, and deliver software solutions by engaging stakeholders, clarifying ambiguous requirements, and challenging assumptions
• · Build backend services and RESTful APIs aligned to those designs
• · Develop cloud-native applications (AWS preferred)
• · Implement workflow automation and data pipelines where needed
• · Contribute across the full software development lifecycle, including CI/CD
• · Ensure solutions are production-ready, including testing, documentation, and handover
• · Act as a reliable execution partner, proactively communicating progress, trade-offs, risks, and changes in expectations

Skills

Must have

• · Strong Python with PySpark
• · Hands-on experience with Databricks, including developing and operating data workloads
• · Schema design and data modelling experience
• · Working knowledge of Spark sufficient to build and troubleshoot PySpark workloads; deep Spark specialization is not required
• · Prior consulting, advisory, or client-facing delivery experience
• · Proven ownership and independent delivery without close supervision
• · Strong problem-solving skills, including the ability to frame and solve problems in ambiguous situations
• · Strong communication and stakeholder management skills, including proactive expectation management
• · Demonstrated adoption of AI-assisted engineering tools and practices as part of day-to-day engineering delivery

Nice to have

• · Experience with Apache Iceberg
• · AWS data services (Glue, Lake Formation)
• · Workflow orchestration tools (Airflow)
• · Experience with distributed data processing architectures