VP, Data Engineering — Lakehouse & AI Platform Lead

The Goldman Sachs Group; New York (NY); On-site; USD 120,000 - 150,000; Full time

Job summary

A leading global investment firm in New York is seeking a Data Engineer for their Lakehouse and AI Data Platform team. The role involves designing and supporting data pipelines, ensuring data quality, and collaboration with various engineering teams. Candidates should have 7-12+ years of experience, strong programming skills in Python or Java, and familiarity with SQL and distributed processing technologies like Apache Spark. This is an opportunity to contribute to modern data solutions in a fast-paced environment.

Qualifications

• 7-12+ years of experience in data engineering.
• Strong hands-on programming experience in Python or Java.
• Good working knowledge of SQL including optimization.
• Experience with Apache Spark and distributed data processing frameworks.

Responsibilities

• Design and support data pipelines on the data platform.
• Develop raw, refined and curated datasets.
• Implement data quality controls across pipelines.
• Work closely with engineers and data consumers to ensure delivery.

Skills

Python

Java

SQL

Apache Spark

Data analysis

Education

Bachelor's or Master's degree in a relevant discipline

Tools

Apache Spark

Kafka

Snowflake

Databricks

Job description

A leading global investment firm in New York is seeking a Data Engineer for their Lakehouse and AI Data Platform team. The role involves designing and supporting data pipelines, ensuring data quality, and collaboration with various engineering teams. Candidates should have 7-12+ years of experience, strong programming skills in Python or Java, and familiarity with SQL and distributed processing technologies like Apache Spark. This is an opportunity to contribute to modern data solutions in a fast-paced environment.