Solutions Architect - Databricks

Lumenalta; Ottawa; On-site; CAD 120,000 - 160,000; Full time

Job summary

Lumenalta is seeking a Databricks Solutions Architect to design and implement high-performance data solutions for enterprise clients. This role involves leading data strategy, architecture, and advanced analytics initiatives, requiring extensive experience in cloud ecosystems and data engineering. Join a dynamic team committed to innovation in technology and impactful software solutions.

Qualifications

• 10+ years in senior data engineering or solutions architect role.
• Experience with Databricks, Azure, or AWS ecosystems.
• Fluency in English with strong communication skills.

Responsibilities

• Architect end-to-end scalable data solutions using Databricks.
• Develop data architectures and implement ETL pipelines.
• Lead design and implementation of data platforms.

Skills

Python

PySpark

SQL

Data Architecture

ETL Pipelines

Data Governance

Machine Learning

Collaboration

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Azure

AWS

Job description

1 week ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

At Lumenalta, we create impactful software solutions that drive innovation and transform businesses. Since 2000, we’ve partnered with visionary leaders to build cutting-edge tech, solve complex challenges, and deliver results faster through our elite teams and tech-driven approach. Join us in shaping the future of technology.

What You’ll Be Working On:

At Lumenalta, we partner with enterprise clients to build cutting-edge digital products that interact with hundreds of millions of customers, transactions, and data points. As a Databricks Solutions Architect, you will be pivotal in designing and implementing scalable, high-performance solutions to tackle the most demanding data challenges in various industries. You will have the opportunity to drive end-to-end architecture and help our clients unlock the full potential of their data using Databricks and other modern cloud technologies.

We are looking for someone who can thrive in a fast-paced, collaborative environment, with experience in industries such as FinTech, Transportation, Insurance, Media, or other complex, multifactor environments.

Key Responsibilities:

1. Solutions Design: Architect end-to-end scalable data solutions using Databricks, Azure, AWS, and other cloud-based services to meet client requirements.
2. Data Strategy & Architecture: Develop robust data architectures, implement ETL pipelines, and establish data governance frameworks to ensure data accuracy and consistency.
3. Technical Leadership: Lead the design and implementation of data platforms, define best practices, and mentor team members to elevate technical competencies within the organization.
4. Advanced Analytics & Machine Learning: Create pipelines and workflows to support advanced analytics and machine learning initiatives, utilizing Databricks and other cloud-based services.
5. Collaboration & Client Engagement: Act as a trusted advisor, working closely with client stakeholders to understand business needs, present architectural solutions, and implement strategies that deliver high-impact results.
6. Performance Optimization: Identify bottlenecks and recommend solutions to optimize data workflows and architecture for both cost and performance.
7. Innovation & Experimentation: Champion using cutting-edge data technologies and methodologies to drive innovation and experimentation within client projects.

Qualifications & Experience:

• 10+ years of experience in a senior data engineering or solutions architect role, with a strong focus on Databricks, Azure, or AWS cloud ecosystems.
• Proven track record of designing and implementing data architectures that support large-scale data pipelines and analytics.
• Strong proficiency in Python, PySpark, and SQL for data processing and manipulation.
• Extensive experience in creating ETL pipelines from scratch, handling large datasets, and developing solutions that align with business goals.
• Extensive experience interacting with C-Suite level stakeholders.
• Hands-on experience with data warehousing concepts, data modelling, and building data marts.
• Industry experience in financial services, logistics, or other complex domains is highly desirable.
• Fluency in verbal and written English, with the ability to communicate complex technical concepts to non-technical stakeholders.
• Personality traits: Analytical, solution-oriented, proactive, team player, and continuously learning.

What's it like to work at Lumenalta?

Seniority level

• Director

Employment type

• Full-time

Job function

• Engineering, Information Technology, and Consulting

Industries

• IT Services and IT Consulting