Production Data Engineer - End-to-End Pipelines & Ops

Twenty; New York (NY); On-site; USD 192,000 - 455,000; Full time

Benefits offered by this job

Health insurance

Parental leave

Flexible PTO

401(k) plan with HSA/FSA

Job summary

Twenty Technologies in New York City is seeking an experienced Data Engineer to build and operate data integrations for our mission-critical platform. You will design data pipelines, process and integrate data sources, and ensure health and reliability in restricted environments.

You will collaborate with forward-deployed engineers, own production systems end-to-end, and contribute to incident response and runbooks while working on-site at our NYC office with initial onboarding in Arlington, VA.

Qualifications

• 5+ years of experience in data engineering or data-focused software engineering.
• Expert Python skills with production-grade code.
• Hands-on experience building ETL/ELT pipelines with Spark (PySpark).
• Strong SQL and schema design skills.
• Experience with columnar databases (ClickHouse/Redshift).
• Ability to work on-site at Twenty’s NYC office with Arlington onboarding.

Responsibilities

• Design, build, and maintain data pipelines feeding the mission-critical platform.
• Monitor data quality and pipeline health across environments.
• Collaborate with forward-deployed engineers for field deployments.
• Set up runbooks and documentation for owned components.
• Respond to incidents and perform root-cause analysis.

Skills

Data engineering

Python

Spark PySpark

SQL & Schema

ClickHouse

Production debugging

On-site NYC

Tools

Docker

CI/CD

Grafana

Kafka

Job description

Twenty Technologies in New York City is seeking an experienced Data Engineer to build and operate data integrations for our mission-critical platform. You will design data pipelines, process and integrate data sources, and ensure health and reliability in restricted environments.

You will collaborate with forward-deployed engineers, own production systems end-to-end, and contribute to incident response and runbooks while working on-site at our NYC office with initial onboarding in Arlington, VA.