Databricks Data Lead / Architect

Mindtris; Toronto; Remote; CAD 150,000 - 200,000; Full time

Job summary

An innovative firm is seeking a skilled Data Architect to lead data governance and architecture for their BI systems. This role involves designing robust data models, integrating diverse data sources, and optimizing BI performance. You will collaborate with stakeholders to translate business needs into scalable solutions while establishing data governance policies to ensure data quality and security. Join a dynamic team dedicated to digital transformation and innovation, where your expertise will drive impactful business growth and enhance customer experiences across various sectors. If you thrive in a fast-paced environment and are passionate about data, this opportunity is for you!

Qualifications

• 8-10 years of software development experience with strong SQL and Databricks skills.
• Hands-on experience with data modeling and ETL processes.

Responsibilities

• Design data architecture and modeling strategies for BI systems.
• Integrate data from various sources and ensure data quality.

Skills

SQL

Databricks

Ecommerce experience

Data modeling

ETL processes

Data governance

Scala

Python

APIs

Data analysis

Education

Bachelor's degree in Computer Science or related field

Tools

ADF

Datastage

SSAS

Cognos

Tableau

ThoughtSpot

GitHub

Jenkins

Spark

Hive

Job description

Title: Databricks Data Lead / Architect, Data Governance

Location: Remote - anywhere in Canada but must be able to work PST hours

Duration: 12+ months

Interview Process: 3 rounds

Note: Really needing someone who has strong skills in Data Bricks, SQL; and has Ecommerce experience.

Must Haves

• The Data Architect is responsible for designing the overall data architecture and data modeling strategies for the BI system. They collaborate with stakeholders to understand business requirements and translate them into a robust and scalable data model. Create logical and physical data models using best practices to ensure high data quality and reduced redundancy.
• Data Architect will work on integrating data from various sources, such as databases, warehouses, and external systems. They develop strategies for data extraction, transformation, and loading (ETL) processes to ensure data accuracy, consistency, and availability for reporting and analysis.
• Evaluate and select appropriate BI tools and technologies based on the organization's needs. Run POC and the implementation and configuration of BI software, including data visualization tools, reporting platforms, and analytics solutions.
• Monitor and optimize the performance of the BI system to ensure efficient data retrieval, processing, and reporting. They identify and resolve performance bottlenecks by tuning queries, optimizing data structures, and implementing caching mechanisms.
• Data Architect collaborates with business stakeholders, data analysts, developers, and IT teams to understand their requirements and deliver solutions that meet their needs. They communicate complex technical concepts to non-technical stakeholders and provide guidance on leveraging BI capabilities.
• They stay updated with the latest trends, technologies, and best practices in the BI field. They explore opportunities for process improvement, automation, and innovation to enhance the organization's data analytics capabilities.
• Data Architect needs to establish data governance policies and procedures to ensure data quality, consistency, and security. Define access controls, data privacy measures, and data retention policies to comply with regulatory requirements and protect sensitive information.

We’re Excited About You If You Have

• 8-10 years of software development and deployment experience with at least 5 years of hands-on experience with SQL, Databricks, ADF, Datastage (or other ETL tool), SSAS cubes, Cognos, Tableau, ThoughtSpot, and other BI tools
• Write SQL for processing raw data, Kafka ingestions, ADF pipelines, data validation, and QA
• Knowledge working with APIs to collect or ingest data
• Experience with Scala and Python
• Strong Database knowledge, SQL & No-SQL preferred
• Experience building data ingestion pipelines (simulating Extract, Transform, Load workload), data warehouse or database architecture
• Experience writing design documentation, Source to Target mapping documentation, manage Confluence pages.
• Experience in converting business functionalities into technical Jira stories
• Experience in analyzing huge datasets, identify trends, patterns, and outliers to extract meaningful insights
• Strong experience with data modeling, design patterns, building highly scalable Business Intelligence Solutions and distributed applications
• Knowledge of cloud platforms, for example: Azure, AWS or equivalent cloud platforms
• Experience with storing, joining, filtering, and analyzing data using SQL, Spark, Hive, etc.
• Experience working with continuous integration framework, building regression-able code within data world using GitHub, Jenkins, and related applications
• Experience with programming/scripting languages such as Scala/Java/Python/R, etc. (any combination)
• Analytical approach to problem-solving with an ability to work at an abstract level and gain consensus; excellent interpersonal, leadership, and communication
• Data-oriented personality. Motivated, independent, efficient, and able to handle several projects; work under pressure with a solid sense for setting priorities
• Ability to work in a fast-paced (startup-like) agile development environment
• Friendly, articulate, and interested in working in a fun, small team environment

Mindtris, a minority women-owned enterprise, is at the forefront of digital transformation, technology excellence, and business growth solutions. Specializing in talent mobilization and innovation, we are dedicated to enhancing customer experiences across diverse sectors such as Information Technology, Telecommunications, Healthcare, Engineering, and the Public sector. With a focus on deploying top-tier talent and fostering innovation, we empower businesses to thrive and excel in a rapidly evolving digital landscape, helping them reach new heights of success.

Mindtris is committed to fostering workforce diversity and is proud to be an equal opportunity employer.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Design, Art/Creative, and Information Technology

Industries

• IT Services and IT Consulting