Senior Data Engineer: Data Platform & Pipelines

Alchemy; San Francisco (CA); On-site; USD 205,000 - 230,000; Full time

Benefits offered by this job

Private Health Insurance

Gym Reimbursement

Commuter Benefits

Flexible Time Off

In-Office Group Meals

Learning & Development Stipend

Company Sponsored Conferences & Events

Books & Audiobook subscription

Job summary

Alchemy is building and running an internal data platform to understand product usage, revenue, and the cost of serving customers. You will own ingestion, schema changes, and checks ensuring datasets are current and correct, collaborating with analytics engineers and data scientists to define datasets for reporting and AI-assisted tools.

You will work on batch and streaming pipelines, improve data quality, and optimize Snowflake usage while partnering with stakeholders to deliver reliable data

Qualifications

• Strong SQL and Python skills, including testing and debugging.
• Experience with Snowflake or a comparable warehouse and access management.
• Proficiency with workflow orchestration and transformation tools (Airflow, dbt).
• Understanding of data modeling, incremental processing, and data-quality testing.
• Ability to trace data discrepancies from reports back to sources and fix root causes.
• Able to turn recurring requests into reusable datasets or tooling.

Responsibilities

• Build batch and streaming pipelines connecting operational databases, product events, billing systems, and external sources to the internal data platform.
• Ensure ingestion recoverability with change-data capture, schema changes, idempotent processing, and safe backfills.
• Operate and improve Snowflake, including access controls, workload management, and cost optimization.
• Enhance orchestration and deployment workflows for safer testing, shipping, and debugging of pipelines.
• Create data-quality checks to detect anomalies before downstream usage.
• Collaborate with analytics partners on shared data models, source definitions, and documentation.

Skills

SQL

Python

Snowflake

Airflow

dbt

Data modeling

Tools

Snowflake

Airflow

dbt

Kafka

Apache Iceberg

Job description

Alchemy is building and running an internal data platform to understand product usage, revenue, and the cost of serving customers. You will own ingestion, schema changes, and checks ensuring datasets are current and correct, collaborating with analytics engineers and data scientists to define datasets for reporting and AI-assisted tools.

You will work on batch and streaming pipelines, improve data quality, and optimize Snowflake usage while partnering with stakeholders to deliver reliable data