Data Engineer - AWS Lakehouse Migration

Delta System & Software, Inc.; Dallas (TX); Vor Ort; USD 110.000 - 150.000; Vollzeit

Zusammenfassung

Goldman Sachs seeks an experienced Data Engineer to join the Datastore Migration Factory, migrating on-prem data lakes to an AWS Lakehouse. You’ll drive data pipelines, ensure data integrity, and optimize workloads for Snowflake and Iceberg, collaborating with global teams to deliver a production-ready migration.

You’ll leverage Python/Java, ANSI SQL, Spark, and modern data architectures, with strong emphasis on quality, governance, and stakeholder communication throughout the project lifecycle.

Qualifikationen

• Bachelor’s or Master’s degree in CS, Engineering, Applied Mathematics, or related field.
• 3–5 years hands-on software development or data engineering experience.
• Strong SQL troubleshooting and scripting skills.
• Experience working in collaborative, team-based engineering environments.
• Excellent communication, stakeholder management, and problem-solving skills.

Aufgaben

• Migrate on-prem data pipelines to AWS Lakehouse environment.
• Migrate extraction logic and job scheduling from legacy to AWS Lakehouse.
• Ensure data integrity and consistency during migrations.
• Convert and optimize legacy SQL and Spark workloads for Snowflake and Iceberg.
• Analyze data consumption patterns and deliver business-ready data products.
• Perform data reconciliation, validation, and quality checks.
• Collaborate with data owners and stakeholders for migration handoffs and sign-offs.
• Work with cross-functional teams to troubleshoot issues and ensure successful delivery.

Kenntnisse

Python

ANSI SQL

Apache Spark

AWS

Snowflake

Kafka

Hadoop

ETL/ELT

Data Modeling

CI/CD

Kubernetes

Ausbildung

Bachelor’s or Master’s degree in CS/Engineering/Math

Tools

Kubernetes

Spark

Snowflake

Jobbeschreibung

Goldman Sachs seeks an experienced Data Engineer to join the Datastore Migration Factory, migrating on-prem data lakes to an AWS Lakehouse. You’ll drive data pipelines, ensure data integrity, and optimize workloads for Snowflake and Iceberg, collaborating with global teams to deliver a production-ready migration.

You’ll leverage Python/Java, ANSI SQL, Spark, and modern data architectures, with strong emphasis on quality, governance, and stakeholder communication throughout the project lifecycle.