Senior Data Engineer/Architect

FGF Brands; Ontario; On-site; CAD 100,000 - 130,000; Full time

Job summary

FGF Brands is looking for a Senior Data Engineer/Architect to design and deliver real-time data solutions linking MongoDB applications with a Lakehouse architecture on Databricks. The role involves leading end-to-end data architecture and development, ensuring scalable solutions for intelligent insights, and collaborating with stakeholders. Candidates must have extensive experience with Azure Databricks and MongoDB, alongside a Computer Science degree or equivalent.

Benefits

Career growth and leadership training

Competitive compensation and health benefits

RRSP matching and tuition reimbursement

Qualifications

• 5+ years in Data Engineering, with 3+ years architecting on Azure Databricks.
• Strong hands-on experience with MongoDB, including change streams.
• Deep knowledge of Delta Lake, Medallion Architecture, Lakehouse patterns.
• Proficiency in Python and SQL for ETL/ELT development.
• Experience designing RESTful APIs for data services.
• Experience deploying and monitoring in production using Databricks Jobs and CI/CD workflows.

Responsibilities

• Architect and deliver real-time streaming solutions that ingest and transform data from MongoDB into Databricks for downstream analytics.
• Design and implement robust, scalable data pipelines supporting batch and real-time workloads.
• Develop and maintain a Lakehouse architecture using Delta Lake on Azure Databricks.
• Collaborate with stakeholders to understand data challenges and translate requirements into technical solutions.
• Lead the solutioning process from prototyping to deployment.
• Drive performance tuning, reliability, and monitoring strategies.
• Provide technical leadership and mentorship to data engineers and teams.

Skills

MongoDB

Azure Databricks

Spark Structured Streaming

Python

SQL

Delta Lake

Education

Degree in Computer Science, Data Engineering, or related fields

Tools

Azure Data Factory

Event Hubs

Kafka

Job description

Join to apply for the Senior Data Engineer/Architect role at FGF Brands

We are seeking a Databricks Engineer/Architect with deep expertise in designing and delivering real-time data solutions that bridge MongoDB applications with a Lakehouse architecture on Databricks. In this role, you will lead the end-to-end architecture, design, and development of scalable data solutions that enable intelligent, low-latency insights across the organization.

Key Responsibilities:

• Architect and deliver real-time streaming solutions that ingest and transform data from MongoDB into Databricks for downstream analytics.
• Design and implement robust, scalable data pipelines supporting batch and real-time workloads.
• Develop and maintain a Lakehouse architecture using Delta Lake on Azure Databricks.
• Collaborate with stakeholders to understand data challenges and translate requirements into technical solutions.
• Lead the solutioning process from prototyping to deployment.
• Drive performance tuning, reliability, and monitoring strategies.
• Provide technical leadership and mentorship to data engineers and teams.

Required Experience:

• 5+ years in Data Engineering, with 3+ years architecting on Azure Databricks.
• Strong hands-on experience with MongoDB, including change streams.
• Expertise in building streaming pipelines with Spark Structured Streaming.
• Degree in Computer Science, Data Engineering, or related fields.
• Deep knowledge of Delta Lake, Medallion Architecture, Lakehouse patterns.
• Proficiency in Python and SQL for ETL/ELT development.
• Experience with distributed computing concepts (RDDs, DataFrames, Spark SQL).
• Experience designing RESTful APIs for data services.
• Ability to translate requirements into scalable systems.
• Excellent communication and stakeholder management skills.
• Knowledge of tools like Azure Data Factory, Event Hubs, Kafka.
• Experience deploying and monitoring in production using Databricks Jobs and CI/CD workflows.
• Understanding of data governance, security, and lineage in cloud environments.

What FGF Offers:

• Career growth, leadership training, and unleashing your potential.
• Competitive compensation, health benefits, and flexible health spending.
• RRSP matching, tuition reimbursement, and discounts on various services.

Working at FGF Brands offers challenging and rewarding opportunities in a dynamic environment that fosters creativity and innovation. We support continuous learning and growth.