Senior Databricks Resident Solutions Architect

Sohogtech; Canada; Remote; CAD 212,000 - 283,000; Full time

Job summary

Sohogtech is seeking a Senior Databricks Resident Solutions Architect to join our team as a high-impact technical leader. You will design, architect, and implement scalable data solutions on the Databricks Lakehouse for enterprise clients, employing Genie Spaces, Agents, and Genie Code to deliver production-grade architectures.

You will guide cloud data strategies across AWS, Azure, and GCP, mentor junior staff, and own end-to-end delivery from discovery through successful deployment while

Qualifications

• 12+ years of experience in data architecture, engineering, data platforms & analytics.
• Comfortable writing code in Python or Scala.
• Extensive working knowledge of Databricks required.

Responsibilities

• Lead design and deployment of end-to-end data architectures on the Databricks Lakehouse.
• Provide strategic technical guidance on cloud data strategies across AWS, Azure, and GCP.
• Mentor junior team members and manage complex client engagements.
• Design and implement CI/CD pipelines for production data environments.
• Build strong client relationships and serve as the primary technical point of contact.

Skills

Data architecture

Python

Scala

Databricks

Genie Spaces/Agents

Cloud ecosystems (AWS/Azure/GCP)

Distributed computing (Spark)

CI/CD

MLOps

Documentation

Client management

Project leadership

Tools

Databricks

Genie Spaces

Genie Code

Apache Spark

CI/CD tooling

MLOps tools

Job description

Senior Databricks Resident Solutions Architect

Location US Remote

Contract Principal US Citizens / GC only

Job Description

WeareseekingaSeniorDatabricksResidentSolutionsArchitecttojoinourteam.Inthisrole,youwillprovideexpert-levelsolutionstoourenterpriseclients.AsanRSA,youwillworkdirectlywithclientstodesign,architect,andimplementscalabledatasolutionsontheDatabricksplatform.Thisisahighimpacttechnicalleadershippositionthatrequiresdeepexpertiseindataengineering,cloudarchitectures,andApacheSparkinternals.Youwillmanagecomplexclientengagements,leadlarge-scaleprojects.

Youwilldesignanddeployproduction-gradeendtoenddataarchitecturesusingDatabricksLakehouse,leveragingadvancedconceptssuchasGenieSpaces,Agents,andGenieCode.

Youwillleadenterprisescaleprojectsfrominitialdiscoverythroughsuccessfuldelivery,managingmultipletechnicalandbusinessstakeholders.

YourexpertiseinApacheSparkanddistributedcomputingwillbecriticalasyouarchitectcomplexdatasystemsthatprocesslargevolumesofdataefficiently.

YouwillprovidestrategictechnicalguidanceonclouddatastrategiesacrossAWS,Azure,andGCP,helpingclientsmakeinformeddecisionsabouttheirdatainfrastructureinvestments.

Inaddition,youwilldevelopcomprehensivetechnicaldocumentationandarchitecturediagramstocommunicatecomplexsolutionstostakeholdersatalllevels.

Youwillbuildandmaintainstrongclientrelationships,servingastheprimarytechnicalpointofcontactforassignedaccounts.

YouwilldesignandimplementCI/CDpipelinesanddeploymentstrategiesforproductiondataenvironments.

Youwillmentorjuniorteammembersandcontributetothesuccessofbroaderinitiativeswithintheorganization.

Skills

• 12 + years of experience in data Architecture, engineering, data platforms & analytics.
• Comfortable writing code in either Python or Scala.
• Extensive Working knowledge of Databricks is required.
• Experience with advanced Databricks concepts such as Genie Spaces, Agents, and Genie Code.
• Experience handling or leading large-scale projects/customers.
• Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one.
• Deep experience with distributed computing with Apache Spark and knowledge of Apache Spark runtime internals
• Familiarity with CI/CD for production deployments
• Working knowledge of MLOps
• Capable of design and deployment of highly performant end-to-end data architectures
• Experience with technical project delivery – managing scope and timelines
• Documentation and white-boarding skills
• Experience working with clients and managing conflicts
• Experience in building scalable streaming and batch solutions using cloud-native components

Preferred Skills

• Databricks Certified Data Engineer Professional Certification.
• Experience working on high demanding projects and handling large clients.
• Prior experience working in the Databricks Partner Program