Solutions Architect - Databricks

Lumenalta; Calgary; On-site; CAD 120,000 - 160,000; Full time

Job summary

A leading company is seeking a Solutions Architect - Databricks to design and implement high-performance data solutions for enterprise clients. This role involves working with cutting-edge technologies to tackle complex data challenges, requiring extensive experience in cloud ecosystems and data architecture. The ideal candidate will thrive in a collaborative environment and possess strong technical leadership skills.

Qualifications

• 10+ years of experience in a senior data engineering or solutions architect role.
• Strong focus on Databricks, Azure, or AWS cloud ecosystems.
• Proven track record of designing and implementing data architectures.

Responsibilities

• Architect end-to-end scalable data solutions using Databricks and cloud-based services.
• Develop robust data architectures and implement ETL pipelines.
• Lead the design and implementation of data platforms and mentor team members.

Skills

Python

PySpark

SQL

Data Architecture

ETL Pipelines

Data Governance

Advanced Analytics

Machine Learning

Collaboration

Performance Optimization

Job description

Join to apply for the Solutions Architect - Databricks role at Lumenalta

2 days ago Be among the first 25 applicants

Join to apply for the Solutions Architect - Databricks role at Lumenalta

Get AI-powered advice on this job and more exclusive features.

At Lumenalta, we create impactful software solutions that drive innovation and transform businesses. Since 2000, we’ve partnered with visionary leaders to build cutting-edge tech, solve complex challenges, and deliver results faster through our elite teams and tech-driven approach. Join us in shaping the future of technology.

What You’ll Be Working On:

At Lumenalta, we partner with enterprise clients to build cutting-edge digital products that interact with hundreds of millions of customers, transactions, and data points. As a Databricks Solutions Architect, you will be pivotal in designing and implementing scalable, high-performance solutions to tackle the most demanding data challenges in various industries. You will have the opportunity to drive end-to-end architecture and help our clients unlock the full potential of their data using Databricks and other modern cloud technologies.

We are looking for someone who can thrive in a fast-paced, collaborative environment, with experience in industries such as FinTech, Transportation, Insurance, Media, or other complex, multifactor environments.

Key Responsibilities:

• Solutions Design: Architect end-to-end scalable data solutions using Databricks, Azure, AWS, and other cloud-based services to meet client requirements.
• Data Strategy & Architecture: Develop robust data architectures, implement ETL pipelines, and establish data governance frameworks to ensure data accuracy and consistency.
• Technical Leadership: Lead the design and implementation of data platforms, define best practices, and mentor team members to elevate technical competencies within the organization.
• Advanced Analytics & Machine Learning: Create pipelines and workflows to support advanced analytics and machine learning initiatives, utilizing Databricks and other cloud-based services.
• Collaboration & Client Engagement: Act as a trusted advisor, working closely with client stakeholders to understand business needs, present architectural solutions, and implement strategies that deliver high-impact results.
• Performance Optimization: Identify bottlenecks and recommend solutions to optimize data workflows and architecture for both cost and performance.
• Innovation & Experimentation: Champion using cutting-edge data technologies and methodologies to drive innovation and experimentation within client projects.

Qualifications & Experience:

• 10+ years of experience in a senior data engineering or solutions architect role, with a strong focus on Databricks, Azure, or AWS cloud ecosystems.
• Proven track record of designing and implementing data architectures that support large-scale data pipelines and analytics.
• Strong proficiency in Python, PySpark, and SQL for data processing and manipulation.
• Extensive experience in creating ETL pipelines from scratch, handling large datasets, and developing solutions that align with business goals.
• Extensive experience interacting with C-Suite level stakeholders
• Hands-on experience with data warehousing concepts, data modelling, and building data marts.
• Industry experience in financial services, logistics, or other complex domains is highly desirable.
• Fluency in verbal and written English, with the ability to communicate complex technical concepts to non-technical stakeholders.
• Personality traits: Analytical, solution-oriented, proactive, team player, and continuously learning.