Senior Data Engineer - Scalable Pipelines & Platform

Alchemy; New York (NY); In loco; USD 120.000 - 160.000; Tempo pieno

Vantaggi offerti da questo lavoro

Private Health Insurance

Gym Reimbursement

Commuter Benefits

Flexible Time Off

In-Office Group Meals

Learning & Development Stipend

Company Sponsored Conferences & Events

Books & Audiobook subscription with B‑

Descrizione del lavoro

Alchemy is seeking a Data Engineer to build and run the internal data platform that powers understanding of product usage, revenue, and serving costs. You will own ingestion, schema changes, and data quality checks while collaborating with analytics engineers and data scientists to define datasets for reporting and AI tools.

You will work with analytics partners on shared data models, ownership, and upstream dependencies, striving for reusable, self-service data capabilities and robust

Competenze

• Experience building and operating production data pipelines and the infrastructure around them.
• Strong SQL and Python skills, including testing and debugging.
• Experience with Snowflake or a comparable warehouse and with access management.
• Experience with workflow orchestration and transformation tools (Airflow, dbt).
• Understanding of data modeling, incremental processing, and data-quality testing.
• The ability to trace data discrepancies from downstream reports to their sources and fix them.
• Good judgment turning recurring requests into reusable datasets or tooling.

Mansioni

• Build batch and streaming pipelines connecting databases, product events, billing, and external sources.
• Make ingestion recoverable via change-data-capture, schema-change handling, idempotent processing.
• Operate and improve Snowflake, including access controls and cost management.
• Improve orchestration and deployment workflows for safe testing and shipping.
• Build data-quality checks to detect stale, missing, or inconsistent records.
• Collaborate with analytics partners on data models, definitions, and ownership.
• Reduce manual work by building reusable self-service data tools.
• Participate in production support and incident response for pipelines.

Conoscenze

SQL

Python

Data pipelines

Data quality

Troubleshooting

Strumenti

Snowflake

Airflow

dbt

Kafka

Apache Iceberg

Spark

Trino

Descrizione del lavoro

Alchemy is seeking a Data Engineer to build and run the internal data platform that powers understanding of product usage, revenue, and serving costs. You will own ingestion, schema changes, and data quality checks while collaborating with analytics engineers and data scientists to define datasets for reporting and AI tools.

You will work with analytics partners on shared data models, ownership, and upstream dependencies, striving for reusable, self-service data capabilities and robust