Senior Data Engineer - Remote, Scale Data Pipelines

Afresh; San Francisco (CA); Remote; USD 156,000 - 211,000; Full time

Job summary

Afresh is hiring a Senior Data Engineer to scale and improve how we ingest and process customer data. You will design ETLs, build tooling for faster onboarding, and contribute to new product features powering our ML grocery solution.

You will collaborate with product, engineering and GTM teams, mentor engineers, and tackle real-world data quality challenges on a platform used across many large retailers.

Qualifications

• Strong experience designing and maintaining ETLs for large-scale datasets.
• Able to mentor engineers and lead technical discussions.
• Proven ability to collaborate with product, engineering and GTM teams.
• Demonstrated problem-solving skills with ambiguous data.
• Experience working with complex, unclean data and deriving signals.

Responsibilities

• Build tools and frameworks that streamline customer integrations and onboarding.
• Create robust ETLs in PySpark and DBT for billions of records.
• Investigate new technologies to improve the data platform.
• Collaborate with product and engineering to deliver data solutions for new features.
• Optimize ETL performance and scalability for faster integrations.
• Mentor engineers and contribute to technical leadership.

Skills

ETL design

Mentoring

Problem solving

Cross-functional collaboration

Data-driven decision making

Education

Bachelor's degree in CS/Engineering

Tools

Python

PySpark

SQL

Databricks

Snowflake

DBT

Job description

Afresh is hiring a Senior Data Engineer to scale and improve how we ingest and process customer data. You will design ETLs, build tooling for faster onboarding, and contribute to new product features powering our ML grocery solution.

You will collaborate with product, engineering and GTM teams, mentor engineers, and tackle real-world data quality challenges on a platform used across many large retailers.