Spark Data Engineer - Hybrid ETL Modernization (McLean)

Swoon; McLean (VA); Hybrid; USD 83,000 - 110,000; Full time

Job summary

Swoon is seeking an experienced Data Engineer to support a large-scale ETL modernization in McLean, VA. You will migrate legacy ETL workloads to a Spark/Scala-based architecture while ensuring data accuracy throughout the migration.

This 12-month contract role requires hands-on Spark, ETL modernization, and data validation expertise. The position offers a hybrid schedule with on-site presence in McLean.

Qualifications

• Hands-on Apache Spark experience (required).
• ETL modernization or migration experience.
• Data comparison, validation, or reconciliation experience.
• Experience with legacy-to-modern architecture migrations.
• Hybrid work schedule in McLean, VA.

Responsibilities

• Build and maintain large-scale data pipelines using Spark and Scala.
• Modernize legacy ETL workloads into a newer data architecture.
• Perform data comparison, reconciliation, and validation between legacy and modern pipelines.
• Identify and troubleshoot data discrepancies during migration.
• Ensure migrated pipelines maintain data quality and accuracy.

Skills

Apache Spark

Scala

ETL modernization

Data validation

Legacy-to-modern migrations

Ab Initio

Job description

Swoon is seeking an experienced Data Engineer to support a large-scale ETL modernization in McLean, VA. You will migrate legacy ETL workloads to a Spark/Scala-based architecture while ensuring data accuracy throughout the migration.

This 12-month contract role requires hands-on Spark, ETL modernization, and data validation expertise. The position offers a hybrid schedule with on-site presence in McLean.