Engineering Manager, Data Platform

Hayden AI Technologies, Inc.; San Francisco (CA); On-site; USD 140,000 - 200,000; Full time

Job summary

A leading technology company seeks a Data Engineering Manager to lead their Data Platform engineering team. This role will involve designing cloud data systems, managing a small team, and ensuring timely data accessibility for various stakeholders, including transit agencies and internal teams.

Qualifications

• 7+ years of Software Engineering experience, with 2+ years in leadership roles.
• Experience with data warehouse systems and broad knowledge of database technologies.
• Excellent communication skills.

Responsibilities

• Design, build, and operate cloud-based data warehouse and data lake.
• Manage a small engineering team and mentor less experienced members.
• Work with leadership to define a multi-quarter Data Platform roadmap.

Skills

Communication

Software Engineering

Data Warehouse Systems

ETL and Orchestrations

Business Intelligence

Hands-on Coding

Education

BS or MS in Computer Science or a related field

Tools

Amazon Redshift

Google BigQuery

Snowflake

SQL

NoSQL

Tableau

Looker

Python

Go

AWS

Terraform

Job description

About Us

At Hayden AI, we are on a mission to harness the power of computer vision to transform the way transit systems and other government agencies address real-world challenges.

From bus lane and bus stop enforcement to transportation optimization technologies and beyond, our innovative mobile perception system empowers our clients to accelerate transit, enhance street safety, and drive toward a sustainable future.

Summary:

Hayden AI seeks a data engineering manager to lead a Data Platform engineering team. Data Platform engineering supports a diverse set of stakeholders: from internal analytics, to ML Operations, to external reporting. This is a great opportunity for someone to deliver a big impact: you will operate on the intersection of Data Infrastructure, Data Engineering, Analytics, Data Science, and ML Ops. You will work with transit agencies, the customer success team, finance, product, company executives, and, last but not least, all of the Hayden engineers. You will enable all of them to get their data questions answered in a timely manner with a high accuracy.

Responsibilities:

• Design, build, and operate cloud-based data warehouse / data lake that enables large scale spatial and temporal data analytics.

• Operate the ETL pipelines that merge the data from multiple sources into a centralized data warehouse.

• Build derived canonical datasets from the raw data to simplify and speed up analytical queries and make analytics accessible to less technical audiences.

• Build dashboards that track various metrics and KPIs that the company relies on.

• Establish and lead the team's software development process, including design reviews, code reviews, and brainstorming sessions. Keep software development documents accurate and updated.

• Proactively remove roadblocks and escalate issues when encountered.

• Work with the leadership team on defining and executing a multi-quarter Data Platform roadmap.

• Manage in a hands-on fashion a small engineering team (2-4 engineers). Mentor and coach less experienced team members.

Required Qualifications:

• BS or MS in Computer Science or a related field.

• 7+ years of Software Engineering experience, with 2+ years in leadership roles

• Experience with data warehouse systems, such as Amazon Redshift, Google BigQuery, or Snowflake. From schema design to performance optimizations, and everything in between.

• Broad knowledge of database technologies, including SQL and NoSQL (e.g. PostgreSQL, InfluxDb, Redis, DynamoDB, etc). You do not need to know all of them, but you should be comfortable in some.

• Experience with ETL and orchestrations, such as Estuary, DBT, Flyte, and/or Airflow.

• Experience with Business Intelligence tooling, such as Tableau or Looker.

• Hands-on coding ability in modern programming languages. We use Python and Go, but you don’t have to be an expert in both.

• Experience with AWS and Terraform.

• Excellent communication, verbal and written.