Senior Data Engineer (Remote)

AllTrails; San Francisco (CA); Remote; USD 90,000 - 150,000; Full time

Job summary

Join a forward-thinking company dedicated to enhancing outdoor experiences! As a data engineer, you'll tackle complex challenges, transforming data into actionable insights. This role involves working with cutting-edge technologies in a collaborative environment, ensuring the integrity and accessibility of high-volume datasets. With a strong focus on innovation, you'll have the chance to influence outdoor exploration for millions. Enjoy a flexible, remote work culture with ample opportunities for personal and professional growth while being part of a passionate team committed to making a difference in the outdoor community.

Benefits

Health, dental and vision benefits

Unlimited PTO

Flexible parental leave

Remote employee equipment stipend

Annual continuing education stipend

Discounts on subscription and merchandise

Trail Days - no meetings first Friday of each month

Qualifications

• 5+ years of experience in data engineering with strong SQL and Python skills.
• Expertise in data modeling and high volume datasets management.

Responsibilities

• Own projects from inception to completion, converting requirements into technical specs.
• Orchestrate data pipelines and monitor performance using various tools.

Skills

Data Engineering

SQL

Python

Data Cleansing

Data Modeling

Project Management

Data Pipeline Orchestration

Container Orchestration

Monitoring and Metrics

Collaboration

Tools

BigQuery

Redshift

Snowflake

Dataform

dbt

Google Dataflow

Apache Spark

Apache Airflow

Docker

Kubernetes

Job description

About AllTrails
AllTrails is the most trusted and used outdoors platform in the world. We help people explore the outdoors with hand-curated trail maps along with photos, reviews, and user recordings crowdsourced from our community of millions of registered hikers, mountain bikers, and trail runners in 150 countries. AllTrails is frequently ranked as a top-5 Health and Fitness app and has been downloaded by over 75 million people worldwide.
Every day, we solve incredibly hard problems so that we can get more people outside having healthy, authentic experiences and a deeper appreciation of the outdoors. Join us!
This is a U.S.-based remote position. San Francisco Bay Area employees are highly encouraged to come into the office one day a week.

What You’ll Be Doing:

• 5+ years of experience working in data engineering
• Expertise in using both SQL and Python for data cleansing, transformation, modeling, pipelining, etc.
• Proficiency in working with high volume datasets in SQL-based warehouses such as BigQuery, Redshift, Snowflake, or others, preferably using ELT tools like Dataform or dbt
• Experience with parallelized data processing frameworks such as Google Dataflow, Apache Spark, etc.
• Proficiency in working with other stakeholders and converting requirements into detailed technical specifications; owning projects from inception to completion
• Deep understanding of data modeling, access, storage, caching, replication, and optimization techniques
• Ability to orchestrate data pipelines through tools such as Apache Airflow
• Experienced in container and pod orchestration (e.g. Docker, Kubernetes)
• Understanding of the software development lifecycle and CI/CD
• Monitoring and metrics-gathering (e.g. Datadog, NewRelic, Cloudwatch, etc.)
• Proficiency with git and working collaboratively in a shared codebase
• Willingness to participate in an on-call support rotation - currently the rotation is monthly
• Self-motivation and a deep sense of pride in your work
• Passion for the outdoors
• Comfort with ambiguity, and an instinct for moving quickly
• Humility, empathy and open-mindedness - no egos

Requirements:

• Proficient in working with other stakeholders and converting requirements into detailed technical specifications; owning projects from inception to completion
• Expertise both in using SQL and Python for data cleansing, transformation, modeling, pipelining, etc.
• Proficiency in working with high volume datasets in SQL-based warehouses such as BigQuery, Redshift, Snowflake, or others, preferably using ELT tools like Dataform or dbt
• Experience with parallelized data processing frameworks such as Google Dataflow, Apache Spark, etc.
• Deep understanding of data modeling, access, storage, caching, replication, and optimization techniques
• Ability to orchestrate data pipelines through tools such as Apache Airflow
• Experienced in container and pod orchestration (e.g. Docker, Kubernetes)
• Understanding of the software development lifecycle and CI/CD
• Monitoring and metrics-gathering (e.g. Datadog, NewRelic, Cloudwatch, etc.)
• Willingness to participate in an on-call support rotation - currently the rotation is monthly
• Proficiency with git and working collaboratively in a shared codebase
• Excellent documentation skills
• Self-motivation and a deep sense of pride in your work
• Passion for the outdoors
• Comfort with ambiguity, and an instinct for moving quickly
• Humility, empathy and open-mindedness - no egos

Bonus Points:

• Experience working in a multi-cloud environment
• Experience working with a data stack in Google Cloud Platform
• Experience with Amplitude
• Experience with infrastructure-as-code, such as Terraform
• Experience with machine learning frameworks and platforms such as VertexAI, SageMaker, MLFlow, or related frameworks

What We Offer:

• A competitive and equitable compensation plan. This is a full-time, salaried position that includes equity
• Physical & mental well-being including health, dental and vision benefits
• Trail Days: No meetings first Friday of each month to go test the app and explore new trails!
• Unlimited PTO
• Flexible parental leave
• Remote employee equipment stipend to create a great remote work environment
• Annual continuing education stipend
• Discounts on subscription and merchandise for you and your friends & family
• An authentic investment in you as a human being and your career as a professional