Solutions Architect - Databricks

Lumenalta; Toronto; On-site; CAD 100,000 - 130,000; Full time

Job summary

A leading technology solutions provider is seeking a Solutions Architect - Databricks in Toronto, Canada. The ideal candidate will have 7+ years of experience in data engineering and be proficient in designing scalable data architectures. This role offers the opportunity to work on innovative projects, driving the use of cloud technologies and leading technical teams. If you're analytical, solution-oriented, and thrive in a collaborative environment, apply now!

Qualifications

• 7+ years of experience in a senior data engineering or solutions architect role focusing on Databricks.
• Proven track record of designing data architectures supporting large-scale pipelines.
• Strong proficiency in Python, PySpark, and SQL for data manipulation.
• Hands-on experience creating ETL pipelines and handling large datasets.
• Experience with data warehousing concepts and data modeling.
• Fluency in English for complex technical communication.
• Personality traits: analytical, solution-oriented, proactive.

Responsibilities

• Architect scalable data solutions using Databricks and cloud-based services.
• Develop robust data architectures and implement ETL pipelines.
• Lead design and implementation of data platforms and mentor team members.
• Create pipelines for advanced analytics and machine learning initiatives.
• Collaborate with clients to understand needs and present solutions.
• Optimize data workflows and architecture for performance.

Skills

Python

PySpark

SQL

Data architecture design

ETL pipeline development

Data governance

Tools

Databricks

Azure

AWS

Job description

Join us to apply for the Solutions Architect - Databricks role at Lumenalta.

At Lumenalta, we partner with enterprise clients to build cutting-edge digital products that interact with hundreds of millions of customers, transactions, and data points. As a Databricks Solutions Architect, you will be pivotal in designing and implementing scalable, high-performance solutions to address demanding data challenges across various industries. You will have the opportunity to drive end-to-end architecture and help our clients unlock the full potential of their data using Databricks and other modern cloud technologies.

We are seeking someone who thrives in a fast-paced, collaborative environment, with experience in industries such as FinTech, Transportation, Insurance, Media, or other complex, multifactor environments.

Key Responsibilities:

1. Solutions Design: Architect end-to-end scalable data solutions using Databricks, Azure, AWS, and other cloud-based services to meet client requirements.
2. Data Strategy & Architecture: Develop robust data architectures, implement ETL pipelines, and establish data governance frameworks to ensure data accuracy and consistency.
3. Technical Leadership: Lead the design and implementation of data platforms, define best practices, and mentor team members to elevate technical competencies within the organization.
4. Advanced Analytics & Machine Learning: Create pipelines and workflows to support advanced analytics and machine learning initiatives, utilizing Databricks and other cloud-based services.
5. Collaboration & Client Engagement: Act as a trusted advisor, working closely with client stakeholders to understand business needs, present architectural solutions, and implement strategies that deliver high-impact results.
6. Performance Optimization: Identify bottlenecks and recommend solutions to optimize data workflows and architecture for both cost and performance.
7. Innovation & Experimentation: Champion the use of cutting-edge data technologies and methodologies to drive innovation and experimentation within client projects.

Qualifications & Experience:

• 7+ years of experience in a senior data engineering or solutions architect role, with a strong focus on Databricks, Azure, or AWS cloud ecosystems.
• Proven track record of designing and implementing data architectures supporting large-scale data pipelines and analytics.
• Strong proficiency in Python, PySpark, and SQL for data processing and manipulation.
• Hands-on experience creating ETL pipelines from scratch, handling large datasets, and developing solutions aligned with business goals.
• Experience with data warehousing concepts, data modeling, and building data marts.
• Industry experience in financial services, logistics, or other complex domains is highly desirable.
• Fluency in English, with the ability to communicate complex technical concepts to non-technical stakeholders.
• Personality traits: analytical, solution-oriented, proactive, team player, and continuous learner.

What it's like to work at Lumenalta?

Senior level: Mid-Senior level

Employment type: Full-time

Job function: Consulting, Engineering, Strategy / Planning

Industries: IT Services and Consulting, Software Development, Custom Software Development

J-18808-Ljbffr