Senior Data Engineer, Production Pipelines — On‑Site NYC

Twenty; New York (NY); On-site; USD 140,000 - 200,000; Full time

Benefits offered by this job

Health insurance

Parental leave

401(k)

Job summary

Twenty’s New York City office seeks an experienced data engineer to build pipelines and data integrations for its mission-critical platform. You’ll own end-to-end data ingestion, processing, and quality, collaborating with forward deployed engineers and on-site teams to deploy to restricted environments.

This hands-on role requires Python, Spark, SQL, and stellar instincts for production systems, with on-site work in NYC and an onboarding stint in Arlington, VA.

Qualifications

• 5+ years of experience in data engineering or software engineering with data focus.
• Expert Python and PySpark for production pipelines.
• Hands-on ETL/ELT with Spark and AWS Glue jobs.
• Strong SQL, schema design, and data modeling skills.
• Experience with ClickHouse or similar analytical DBs.
• Ability to diagnose production data issues under time pressure.
• Willingness to work on-site in New York City with Arlington onboarding.

Responsibilities

• Design and build data pipelines to ingest, transform, and load data into Twenty’s apps.
• Develop Spark/PySpark ETL jobs, primarily on AWS Glue.
• Define schemas and data models for performance and analytics.
• Write testable, maintainable code and robust runbooks.
• Operate and monitor pipelines, ensure data quality and freshness.
• Collaborate with field engineers to deploy in restricted environments.

Skills

Data engineering

Python

PySpark

SQL

Data modeling

Production debugging

Independent work

On-site NYC

Tools

AWS Glue

ClickHouse

Grafana

PostgreSQL

Job description

Twenty’s New York City office seeks an experienced data engineer to build pipelines and data integrations for its mission-critical platform. You’ll own end-to-end data ingestion, processing, and quality, collaborating with forward deployed engineers and on-site teams to deploy to restricted environments.

This hands-on role requires Python, Spark, SQL, and stellar instincts for production systems, with on-site work in NYC and an onboarding stint in Arlington, VA.