Senior Data Platform Lead (Hybrid, Cloud)

Medium; Toronto (OH); Hybrid; USD 99,552 - 127,996; Full time

Benefits offered by this job

Health coverage

Dental coverage

Vision coverage

Learning & development opportunities

Job summary

ShyftLabs is seeking a Senior/Lead Data Engineer to design and deliver enterprise-scale data platforms for Fortune 500 clients. You will own projects from discovery through production, mentоring engineers, and shaping technical direction.

You will lead architecture sessions, collaborate with stakeholders, and drive data modernization using Databricks, Delta Lake, and cloud platforms. This role requires strong leadership and hands-on expertise.

Qualifications

• 8+ years designing and building enterprise-scale data platforms.
• 5+ years hands-on with Databricks and Apache Spark.
• Proven experience leading enterprise data engineering projects from architecture through production delivery.
• Strong Python, SQL, and Spark skills for large-scale data processing.
• Deep understanding of Delta Lake and Lakehouse design patterns.
• Experience with AWS, Azure, or Google Cloud Platform.
• Knowledge of ETL/ELT, distributed computing, and data modeling.
• Experience implementing CI/CD pipelines and Infrastructure-as-Code.

Responsibilities

• Lead architecture, design, and delivery of enterprise-scale data platforms from inception to production.
• Own technical delivery across multiple client engagements with high-quality standards.
• Define solution architectures and roadmaps aligned with client goals.
• Conduct architecture and code reviews and establish engineering best practices.
• Mentor Data Engineers and foster technical excellence.
• Partner with Fortune 500 clients to translate business needs into scalable solutions.
• Lead discovery workshops and present designs to technical leadership.

Skills

Databricks

Apache Spark

Python

SQL

Delta Lake

Lakehouse architecture

Cloud platforms (AWS/Azure/GC)

CI/CD

Terraform

Unity Catalog

Data governance

Mentoring engineers

Education

Bachelor's or Master's in CS/Data Engineering/Software Engineering

Tools

Kubernetes

Docker

Job description

ShyftLabs is seeking a Senior/Lead Data Engineer to design and deliver enterprise-scale data platforms for Fortune 500 clients. You will own projects from discovery through production, mentоring engineers, and shaping technical direction.

You will lead architecture sessions, collaborate with stakeholders, and drive data modernization using Databricks, Delta Lake, and cloud platforms. This role requires strong leadership and hands-on expertise.