Remote Staff Data Engineer - Platform & Governance Lead

UniteUs Group; New York (NY); Remote; USD 175,000 - 200,000; Full time

Benefits offered by this job

Paid Parental Leave

401K Match

Flexible Vacation Time

Medical, Dental and Vision Coverage

Commuter Benefits

Job summary

Unite USA Inc. dba Unite Us is hiring a Staff Data Engineer in New York, NY. You will lead enterprise-wide data architecture, design data platforms, govern data and shape product/data roadmaps.

You will implement ETL pipelines with Airflow, Python and Snowflake, and build streaming pipelines with Kafka for real-time analytics. You will also design monitoring, CI/CD pipelines, and data quality frameworks while collaborating with cross-functional teams; telecommuting is available nationwide in the

Qualifications

• Master's degree or foreign equivalent in Data Science, Applied Computer Science, Computer Science or a related field.
• 4 years of experience with developing and optimizing scalable data pipelines.
• Experience with ETL/ELT design, data governance, and large-scale data platforms.
• Strong knowledge of SQL, data warehousing, and cloud data services.
• Proficiency with Airflow, Kafka, Spark, Hive, and Python in production systems.
• Experience with AWS and containerization (Docker) and orchestration (Kubernetes).
• Experience with CI/CD and monitoring (Datadog, Jenkins).

Responsibilities

• Lead enterprise-wide data architecture strategy and long-term data platform design.
• Evaluate and approve major technical designs and establish engineering best practices.
• Develop ETL and data pipelines loading a data warehouse using Airflow, DBT, Python, Snowflake.
• Build streaming pipelines with Kafka and Confluent for event-driven processing.
• Create dashboards and monitors for pipeline health, uptime, and data quality.

Skills

Airflow

Python

Kafka

Hive

Spark

SQL

AWS

Datadog

Docker

Kubernetes

Jenkins

GitHub

Windows

Linux

Education

Master's degree in Data Science/CS or related field

Tools

Airflow

Python

Kafka

Snowflake

Job description

Unite USA Inc. dba Unite Us is hiring a Staff Data Engineer in New York, NY. You will lead enterprise-wide data architecture, design data platforms, govern data and shape product/data roadmaps.

You will implement ETL pipelines with Airflow, Python and Snowflake, and build streaming pipelines with Kafka for real-time analytics. You will also design monitoring, CI/CD pipelines, and data quality frameworks while collaborating with cross-functional teams; telecommuting is available nationwide in the