Staff Software Engineer - Data Platform

Hive; San Francisco (CA); On-site; USD 140,000 - 200,000; Full time

Benefits offered by this job

Medical, dental and vision benefits plus FSA

Family leave

401(k) program

Unlimited Flex PTO

Commuter benefits

Paid lunch

Job summary

A cutting-edge technology company in San Francisco is seeking a Data Platform Engineer to drive architecture and implementation of core systems. The ideal candidate has extensive experience with backend systems and demonstrates strong analytical skills in fields such as ML and statistics. Responsibilities include planning technical roadmaps and collaborating across teams. Medical benefits, unlimited PTO, and commuter advantages are offered.

Qualifications

• Experience building production critical systems used by >= thousands of users.
• Deep backend experience with a large scale data platform, DB, ETL, distributed system, etc.
• Strong analytical skills in a relevant field like ML, math, statistics, quantitative economics, etc.
• Track record of deploying and maintaining large scale distributed systems.

Responsibilities

• Drive architecture, design, implementation, and eval of our core systems and data platforms.
• Partner across the company to ensure our systems are adaptable to emerging opportunities.
• Help plan technical roadmaps and lead higher level technical strategy.

Skills

Backend development

Distributed systems

Data engineering

ML infrastructure

Tools

Spark

EMR

MapReduce

Presto

Job description

Data Platform

Every day, we process data from millions of KM from 10s of thousands of high resolution sensors deployed around the world. A symphony of different Sensor Fusion, ML, AI, and 3D Sensing processes are performed at the edge, feeding an AI conflation system on our processing clusters called Map AI.

The Platform Engineering team is responsible for the core distributed systems, ML infrastructure, data model abstractions, and data engine that powers our data customers, consumer products, and user-facing AI technology.

We strongly believe in engineering design principles around abstraction and programmability that allow us to move quickly with minimal manual interventions. Our work is fast-paced, collaborative, and data-driven.

Responsibilities

• Drive architecture, design, implementation, and eval of our core systems and data platforms
• Partner across the company to ensure our systems are adaptable to emerging opportunities
• Help plan technical roadmaps and lead higher level technical strategy

Qualifications

• Experience building production critical systems used by >= thousands of users
• Deep backend experience with a large scale data platform, DB, ETL, distributed system, etc.
• Strong analytical skills in a relevant field like ML, math, statistics, quantitative economics, etc.
• Track record of deploying and maintaining large scale distributed systems

Nice to Have

• Experience with geospatial data, HD mapping, sensor fusion, ADAS or AV, etc.
• Experience managing, generating, and processing large amounts of geospatial or imagery data
• Experience with Spark, EMR, MapReduce, Presto, Trino, Mongo Sharding, or similar systems
• Experience with blockchain/web3 or scaling products or systems at hyper-growth startups

What We Offer

• Medical, dental and vision benefits plus FSA
• Family leave
• 401(k) program
• Unlimited Flex PTO
• Commuter benefits
• Paid lunch