Solutions Architect - Databricks

Lumenalta; Calgary; On-site; CAD 100,000 - 130,000; Full time

Job summary

A leading company is seeking a Solutions Architect specializing in Databricks to design scalable data solutions. The ideal candidate will have extensive experience in cloud technologies and a strong ability to communicate with stakeholders. This role offers the chance to drive innovation and optimize data workflows in a collaborative environment.

Qualifications

• 10+ years in data engineering or solutions architect role.
• Experience with Databricks, Azure, or AWS.
• Fluency in English, able to communicate complex concepts.

Responsibilities

• Architect end-to-end scalable data solutions using Databricks.
• Develop robust data architectures and implement ETL pipelines.
• Lead design and implementation of data platforms.

Skills

Python

PySpark

SQL

Analytical

Solution-oriented

Proactive

Team player

Job description

Join to apply for the Solutions Architect - Databricks role at Lumenalta

At Lumenalta, we create impactful software solutions that drive innovation and transform businesses. Since 2000, we’ve partnered with visionary leaders to build cutting-edge tech, solve complex challenges, and deliver results faster through our elite teams and tech-driven approach. Join us in shaping the future of technology.

What You’ll Be Working On:

At Lumenalta, we partner with enterprise clients to build cutting-edge digital products that interact with hundreds of millions of customers, transactions, and data points. As a Databricks Solutions Architect, you will be pivotal in designing and implementing scalable, high-performance solutions to tackle the most demanding data challenges in various industries. You will have the opportunity to drive end-to-end architecture and help our clients unlock the full potential of their data using Databricks and other modern cloud technologies.

We are looking for someone who can thrive in a fast-paced, collaborative environment, with experience in industries such as FinTech, Transportation, Insurance, Media, or other complex, multifactor environments.

Key Responsibilities:

1. Solutions Design: Architect end-to-end scalable data solutions using Databricks, Azure, AWS, and other cloud-based services to meet client requirements.
2. Data Strategy & Architecture: Develop robust data architectures, implement ETL pipelines, and establish data governance frameworks to ensure data accuracy and consistency.
3. Technical Leadership: Lead the design and implementation of data platforms, define best practices, and mentor team members to elevate technical competencies within the organization.
4. Advanced Analytics & Machine Learning: Create pipelines and workflows to support advanced analytics and machine learning initiatives, utilizing Databricks and other cloud-based services.
5. Collaboration & Client Engagement: Act as a trusted advisor, working closely with client stakeholders to understand business needs, present architectural solutions, and implement strategies that deliver high-impact results.
6. Performance Optimization: Identify bottlenecks and recommend solutions to optimize data workflows and architecture for both cost and performance.
7. Innovation & Experimentation: Champion using cutting-edge data technologies and methodologies to drive innovation and experimentation within client projects.

Qualifications & Experience:

1. 10+ years of experience in a senior data engineering or solutions architect role, with a strong focus on Databricks, Azure, or AWS cloud ecosystems.
2. Proven track record of designing and implementing data architectures that support large-scale data pipelines and analytics.
3. Strong proficiency in Python, PySpark, and SQL for data processing and manipulation.
4. Extensive experience in creating ETL pipelines from scratch, handling large datasets, and developing solutions that align with business goals.
5. Extensive experience interacting with C-Suite level stakeholders.
6. Hands-on experience with data warehousing concepts, data modelling, and building data marts.
7. Industry experience in financial services, logistics, or other complex domains is highly desirable.
8. Fluency in verbal and written English, with the ability to communicate complex technical concepts to non-technical stakeholders.
9. Personality traits: Analytical, solution-oriented, proactive, team player, and continuously learning.

What's it like to work at Lumenalta?

Seniority level

• Director

Employment type

• Full-time

Job function

• Engineering, Information Technology, and Consulting

Industries

• IT Services and IT Consulting