Senior Analytics Engineer - Data Pipelines & AI (Remote)

Carbon Arc; New York (NY); Remote; USD 110,000 - 140,000; Full time

Benefits offered by this job

Fully paid healthcare benefits

Remote work options

Paid time off

Generous parental leave policies

Job summary

A cutting-edge analytics firm is seeking a Senior Analytics Engineer based in New York City. The role involves ownership of critical data pipelines, ensuring data quality, and contributing to advanced ML and AI applications. Candidates should have over 4 years of relevant experience, strong proficiency in Python and SQL, and a deep understanding of data transformation frameworks. The company offers a remote-first working environment along with comprehensive benefits and a strong focus on team collaboration.

Qualifications

• 4+ years of experience building and maintaining production data pipelines.
• Deep proficiency in Python and SQL.
• Experience with columnar data formats and lakehouse architectures.

Responsibilities

• Own alternative datasets end-to-end through our data pipeline.
• Build and maintain Entity Explorer Data (EXD) tables.
• Design and execute ontology mapping pipelines.

Skills

Python

SQL

PySpark

Entity Resolution

Data Transformation

Education

BS or MS in Computer Science, Data Science, Statistics, Engineering

Tools

Apache Iceberg

Parquet

DBT

Airflow

Job description

A cutting-edge analytics firm is seeking a Senior Analytics Engineer based in New York City. The role involves ownership of critical data pipelines, ensuring data quality, and contributing to advanced ML and AI applications. Candidates should have over 4 years of relevant experience, strong proficiency in Python and SQL, and a deep understanding of data transformation frameworks. The company offers a remote-first working environment along with comprehensive benefits and a strong focus on team collaboration.