Data Engineer — Scale ML Pipelines & Ingestion (Equity)

raydar; New York, Northern (NY, KY); Hybrid; USD 200,000 - 250,000; Full time

Benefits offered by this job

Comprehensive benefits package

Equity

Job summary

Raydar is seeking a data engineer to own the end-to-end data engineering work behind a large analytics and machine learning platform. You will handle ingestion, modeling, and transformation, while expanding connections to external systems and ensuring data reliability as volumes grow.

You will collaborate with data scientists to productionize workflows, scale them, and safeguard data quality. You will build interfaces for AI-driven apps to query data and work with cloud data warehouses.

Qualifications

• Experience owning end-to-end ingestion pipelines for large data sources.
• Proven track record delivering analytics or ML use cases via pipelines.
• Experience operating data systems at high volume with reliability.

Responsibilities

• Own ingestion, modeling and transformation for large-scale data assets.
• Expand connections to external business systems as data grows.
• Collaborate with data scientists to productionize workflows and ensure data quality.
• Build interfaces for AI-driven applications to query data programmatically.
• Work with cloud data warehouse, orchestration tools, and major cloud providers.

Skills

Ingestion pipelines

Analytics engineering

Data modeling

Airflow

Dagster

Prefect

dbt

SQLMesh

Cloud data warehouse

Education

CS degree

Tools

Airflow

Dagster

Prefect

dbt

SQLMesh

Job description

Raydar is seeking a data engineer to own the end-to-end data engineering work behind a large analytics and machine learning platform. You will handle ingestion, modeling, and transformation, while expanding connections to external systems and ensuring data reliability as volumes grow.

You will collaborate with data scientists to productionize workflows, scale them, and safeguard data quality. You will build interfaces for AI-driven apps to query data and work with cloud data warehouses.