Senior Data Platform Engineer - Go & Databricks

Rivian; Vancouver; On-site; CAD 96,000 - 121,000; Full time

Job summary

A leading automotive technology company is seeking a Software Engineer to join the Data & AI team in Vancouver. This role focuses on developing a robust, petabyte-scale data processing framework using Go. The qualified candidate will have strong expertise in big data technologies and Kubernetes management. The position offers a salary range of CAD $96,800-$121,000 and includes comprehensive benefits from day one of employment.

Benefits

Robust medical/Rx insurance

Dental insurance

Vision insurance

Qualifications

• 5+ years of hands-on experience in data engineering or a similar role, with a proven track record of building and maintaining large-scale data processing systems.
• Deep proficiency in Go programming language with a strong understanding of its concurrency model and best practices for building high-performance applications.
• Exceptional analytical and problem-solving skills with the ability to break down complex problems into manageable components.

Responsibilities

• Design, develop, and enhance a petabyte-scale vehicle data processing framework using Go.
• Collaborate closely with the big data platform team to ensure seamless integration of the framework with our Databricks environment.
• Monitor the framework’s performance, identify bottlenecks, and implement optimizations.

Skills

Go programming language

Big data technologies

Kubernetes

Problem-solving skills

Communication & Collaboration

Education

Bachelor's or Master's degree in Computer Science, Data Science, or related field

Tools

Databricks

Spark

Delta Lake

Job description

A leading automotive technology company is seeking a Software Engineer to join the Data & AI team in Vancouver. This role focuses on developing a robust, petabyte-scale data processing framework using Go. The qualified candidate will have strong expertise in big data technologies and Kubernetes management. The position offers a salary range of CAD $96,800-$121,000 and includes comprehensive benefits from day one of employment.