Solutions Architect - Databricks

Lumenalta; Toronto; On-site; CAD 100,000 - 140,000; Full time

Job summary

A leading company in IT Services and Consulting is seeking a Solutions Architect specializing in Databricks. This mid-senior level role involves designing scalable data solutions and collaborating with clients to enhance their data strategies. The ideal candidate will have extensive experience in cloud ecosystems and a strong technical background, particularly in Python and SQL.

Qualifications

• 7+ years in a senior data engineering or solutions architect role.
• Proven track record in large-scale data architectures.
• Fluency in English and ability to communicate technical concepts.

Responsibilities

• Architect end-to-end scalable data solutions using Databricks, Azure, AWS.
• Develop data architectures and implement ETL pipelines.
• Lead design and implementation of data platforms.

Skills

Python

PySpark

SQL

Data Architecture

Data Governance

ETL Pipelines

Machine Learning

Data Warehousing

Job description

Join to apply for the Solutions Architect - Databricks role at Lumenalta

At Lumenalta, we partner with enterprise clients to build cutting-edge digital products that interact with hundreds of millions of customers, transactions, and data points. As a Databricks Solutions Architect, you will be pivotal in designing and implementing scalable, high-performance solutions to tackle demanding data challenges across various industries. You will have the opportunity to drive end-to-end architecture and help our clients unlock the full potential of their data using Databricks and other modern cloud technologies.

We are looking for someone who thrives in a fast-paced, collaborative environment, with experience in industries such as FinTech, Transportation, Insurance, Media, or other complex, multifactor environments.

Key Responsibilities:

1. Solutions Design: Architect end-to-end scalable data solutions using Databricks, Azure, AWS, and other cloud-based services to meet client requirements.
2. Data Strategy & Architecture: Develop robust data architectures, implement ETL pipelines, and establish data governance frameworks to ensure data accuracy and consistency.
3. Technical Leadership: Lead the design and implementation of data platforms, define best practices, and mentor team members to elevate technical competencies within the organization.
4. Advanced Analytics & Machine Learning: Create pipelines and workflows to support advanced analytics and machine learning initiatives, utilizing Databricks and other cloud-based services.
5. Collaboration & Client Engagement: Act as a trusted advisor, working closely with client stakeholders to understand business needs, present architectural solutions, and implement strategies that deliver high-impact results.
6. Performance Optimization: Identify bottlenecks and recommend solutions to optimize data workflows and architecture for both cost and performance.
7. Innovation & Experimentation: Champion using cutting-edge data technologies and methodologies to drive innovation and experimentation within client projects.

Qualifications & Experience:

1. 7+ years of experience in a senior data engineering or solutions architect role, with a focus on Databricks, Azure, or AWS cloud ecosystems.
2. Proven track record of designing and implementing data architectures supporting large-scale data pipelines and analytics.
3. Strong proficiency in Python, PySpark, and SQL for data processing and manipulation.
4. Hands-on experience with data warehousing concepts, data modeling, and building data marts.
5. Industry experience in financial services, logistics, or other complex domains is highly desirable.
6. Fluency in English, with the ability to communicate complex technical concepts to non-technical stakeholders.
7. Analytical, solution-oriented, proactive, team player, and committed to continuous learning.

What is it like to work at Lumenalta?

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Consulting, Engineering, Strategy/Planning

Industries

• IT Services and IT Consulting, Software Development, Custom Software Development